Personal Assistant Recipes voice-first · No. 4

i mumble, so dictation misses me. now every voice note i send my ai is saved with its transcript, building a corpus to fine-tune a speech model on my voice

From a conversation with my assistant, 28 August 2026

Recipe No. 4

Turn Everyday Voice Notes into a Training Set for Your Own Speech Model

Serves People with an accent, a mumble, or a speech pattern that dictation keeps getting wrong

Save every voice note together with its transcript into one private folder, so the pairs become a training corpus for a speech-to-text model fine-tuned on his voice.

You will need

Method

  1. Ask the agent to save each voice note's audio and its transcript side by side, with a date.

  2. Fix wrong transcripts when you notice them; each correction makes a better training pair.

  3. Have it write a small local training script you can point at the folder once you have a few hours of audio.

  4. Fine-tune, then compare old versus new accuracy on a few notes it never saw.

See also

  1. 47
    asked my ai what mini app it could build and launch for me. it pitched a few, then checked and told me straight up which ones already exist
  2. 5
    asked my ai to explain a chip startup like i'm 5, 10, and 15. then had it map the whole chip supply chain from dirt to ai demand, with diagrams
  3. 48
    modeled ev charging vs gas using my driving routes and current rates (i was just curious)