Compare
Whisper apps for Mac: the name tells you nothing
"Powered by Whisper" can mean a model file on your disk or a call to OpenAI's servers. They are opposite things with the same brand on them, and the difference is the whole privacy question.
Last updated
What Whisper actually is
Whisper is a family of speech recognition models published openly by OpenAI. They come in sizes — tiny, base, small, medium, large — trading accuracy against memory and speed. Because the weights are downloadable, Whisper turned high-quality speech recognition from a service you rent into a file you can hold.
That is why so many Mac dictation apps appeared at once. Whisper removed the hardest part of building one.
The three things "uses Whisper" can mean
- A local Whisper model. The weights sit on your disk, usually run through an optimised implementation such as whisper.cpp. Nothing is transmitted. This is what most people assume and what many apps do.
- OpenAI's hosted Whisper API. Your audio is uploaded to OpenAI and the text comes back. Convenient, cheap for the developer, and the audio has definitively left your machine.
- Either, depending on a setting. Increasingly common, and the most misleading, because the default decides what actually happens and the marketing describes whichever option sounds better.
How to tell which you have
- Look for a model download on first run A local app fetches a few hundred megabytes to a few gigabytes once. An API-based app has nothing to download.
- Look for a model size setting Choosing between small, medium and large is a local implementation. There is no reason to expose it if a server is doing the work.
- Run the aeroplane-mode test Network off, dictate. Text means local; an error means an API call.
- Check whether it asks for an API key If it does, that path is a hosted service — though many apps use a key only for optional extras, so check which.
- Watch the network if you want certainty Little Snitch or nettop while you dictate. Local apps are quiet apart from licence and update checks.
Whisper is not the only local option
Whisper's openness made it the default, but it is no longer the only serious choice for local dictation. NVIDIA's Parakeet models are notably fast on Apple Silicon and specialise in English; Moonshine and SenseVoice target low-latency streaming. For live dictation — where the text needs to land within a second — those differences are significant in a way they are not for batch transcription.
Vaitly Voice ships Parakeet and Whisper-family models and chooses based on your Mac. The comparison is at Whisper vs Parakeet for local dictation.
| Whisper family | Parakeet family | |
|---|---|---|
| Strength | Broad multilingual coverage, well understood | Speed on Apple Silicon, strong English |
| Typical use | Transcription and dictation | Low-latency dictation |
| Model sizes | tiny through large | Several, generally compact |
| Runs locally | Yes | Yes |
A general orientation, not a benchmark. Both families change with each release.
Why a dictation app is more than a model
Whisper being open means the recognition is close to a commodity. That is exactly why the model is a poor basis for choosing an app — everyone has access to the same thing. What differs is everything around it:
- Voice activity detection, so the model is not asked to transcribe silence. See what VAD is.
- Getting text into the app you are in reliably, which is harder than it sounds and is where most dictation tools actually fail.
- Custom vocabulary, because the model has never heard of your colleagues.
- Latency management: keeping the model warm without holding a gigabyte of RAM all day.
- What happens when something goes wrong — a history you can replay beats a lost paragraph.
Questions
Is Whisper free?
The models are openly available, so an app can run them on your machine at no per-use cost. OpenAI's hosted Whisper API is a paid service. An app built on the first can be sold outright; one built on the second generally cannot.
Does using Whisper mean my audio goes to OpenAI?
Only if the app calls OpenAI's hosted API. An app running the weights locally sends nothing to anyone. The name does not distinguish the two — the aeroplane-mode test does.
Which Whisper model size should I use?
For live dictation, smaller and faster usually wins, because a large model that takes four seconds to return is unpleasant regardless of accuracy. For transcribing recordings, where latency does not matter, larger is better. Apps that do dictation well tend to choose for you.
Does VV use Whisper?
VV ships Whisper-family and Parakeet models and selects based on your Mac. Both run locally. The model is downloaded and checksum-verified on first run, and lives in the app's own data directory.