Does yogurt support proper diarization? Can’t seem to find confirmation.
Also, what’s the current best STT model? Apple’s dictation model isn’t good which is one big reason why I don’t use STT much.
newman314
I live in a two party consent state and have yet to pull the trigger on an AI transcription service. Yogurt is the first appropriate implementation of the service in my opinion, both for personal privacy and to limit potential issues if Granola or similar service gets hacked and transcriptions go public.
I appreciate that you included a default warning for the owner to let everyone on the call know they are being recorded. It might be ideal to take that a step further and have the popup occur again if another party joins the call and should also be notified of the recording.
lavendermon
It's a lot of fun to see what people can do with the voice transcription tools available now that are all open source.
I've been building my own Jarvis, and I still haven't built my own meeting mode for him yet, though it's on the trajectory. I may borrow some ideas from this.
I really like the filter for the whispered, hallucinated words that Whisper sometimes hears, like, "Thanks for watching," when it's silent. That's cool.
I do a similar splitting of speech, but I think a slightly different mechanism. So I'll have to take a look at how well yours works.
And, I'm not checking the loudness of the mic and the computer audio to figure out when the speaker output is leaking. That's nice.
If there was anything I would add to yours, it would be diarization on the same inputs. So the room mic might have two or three people behind it, and to have diarization for that to know who is talking at any one time would be probably helpful. I use NVIDIA's Nemotron on the Mac. https://huggingface.co/nvidia/Nemotron-3-Diarization
Great job! It's refreshing to see something not limited to Macs/Apple Silicon.
When starting out, did you consider:
- Handy, either forking it or adding PRs?
- If you disliked the Handy UI, what about the choice of backend? Did you look into RealtimeSTT? The author is really serious about ASR and transcription
There are a 1000 Mac ASR and transcription projects, so it's really refreshing to see something that others outside the Mac garden can use - my worry is that by not reusing more mature foundations, you end up taking too much of a burden and burn out. The non Apple Silicon space needs more projects like these!
ProblemExplorer
Great work! Personally would love the option to skip out on some of local model post processing features or optionally offload it to openrouter, the summarization steps and the ask feature eat up tons of resources.
austinhutch
I also got frustrated with Granola earlier this year and have been building my replacement - Noted: https://takenoted.com/
It shares similar principles but is (currently) closed source and mac-only.
Take a look at anarlog as well - it's a great project and I wish I'd found it earlier as I probably would have contributed instead of starting my own: https://anarlog.so/
Let me know if you want to compare notes - I am sure we have hit a lot of the same issues.
zaius
Enable transcription and at the end summarize it, and those are your notes. Anything critical, pressing, or deserves immediate attention, you write it down. That’s it! Not sure why there are so many apps redoing it over and over again in a very similar way.
Yogurt team - congratulations on your launch. I am not throwing a wrench at you. Those are my thoughts about this category in general.
mandeepj
The electron use is giving me pause. It’s going to eat up memory.
Aniket-N
I made something like this myself but because I didn't want anyone to know I was doing it, no bot in the call, I couldn't diarise the notes. I have what's been said, but not who said it. Did you manage to solve this?
comments (10)
Also, what’s the current best STT model? Apple’s dictation model isn’t good which is one big reason why I don’t use STT much.
newman314
I appreciate that you included a default warning for the owner to let everyone on the call know they are being recorded. It might be ideal to take that a step further and have the popup occur again if another party joins the call and should also be notified of the recording.
lavendermon
I've been building my own Jarvis, and I still haven't built my own meeting mode for him yet, though it's on the trajectory. I may borrow some ideas from this.
I really like the filter for the whispered, hallucinated words that Whisper sometimes hears, like, "Thanks for watching," when it's silent. That's cool.
I do a similar splitting of speech, but I think a slightly different mechanism. So I'll have to take a look at how well yours works.
And, I'm not checking the loudness of the mic and the computer audio to figure out when the speaker output is leaking. That's nice.
If there was anything I would add to yours, it would be diarization on the same inputs. So the room mic might have two or three people behind it, and to have diarization for that to know who is talking at any one time would be probably helpful. I use NVIDIA's Nemotron on the Mac. https://huggingface.co/nvidia/Nemotron-3-Diarization
And, I have enrollment for voices with speaker embeddings using this: https://github.com/wenet-e2e/wespeaker
mickdarling
How does it differ from Muesli[1] and OpenOats[2]?
0. https://opensource.builders/alternatives/granola
1. https://github.com/pHequals7/muesli
2. https://github.com/yazinsai/OpenOats
theturtletalks
When starting out, did you consider:
- Handy, either forking it or adding PRs?
- If you disliked the Handy UI, what about the choice of backend? Did you look into RealtimeSTT? The author is really serious about ASR and transcription
There are a 1000 Mac ASR and transcription projects, so it's really refreshing to see something that others outside the Mac garden can use - my worry is that by not reusing more mature foundations, you end up taking too much of a burden and burn out. The non Apple Silicon space needs more projects like these!
ProblemExplorer
austinhutch
It shares similar principles but is (currently) closed source and mac-only.
Take a look at anarlog as well - it's a great project and I wish I'd found it earlier as I probably would have contributed instead of starting my own: https://anarlog.so/
Let me know if you want to compare notes - I am sure we have hit a lot of the same issues.
zaius
Yogurt team - congratulations on your launch. I am not throwing a wrench at you. Those are my thoughts about this category in general.
mandeepj
Aniket-N
walthamstow