From Voice Note to Finished Draft: A Workflow With Your AI Agent

You’ve been capturing ideas by voice for a few weeks. There are dozens of notes now, maybe hundreds. This is where most note systems stall: the notes exist, but turning them into something (a plan, an article, a decision) still depends on you finding the time to reread everything.

This post shows the other half of the loop: how to let the AI agent you already use read your SpeakPen notes and do the first round of thinking with you. It takes about five minutes to set up.

There’s a second payoff. Once your agent can read your notes, you stop starting every chat from zero, re-explaining your project, your constraints and what you decided last week. The agent looks it up in what you already said. More on that in Stop re-explaining yourself to AI.

The loop in one picture

1. Speak: an idea shows up, you say it into SpeakPen on your phone or in the browser.
2. Land: SpeakPen transcribes it and saves a note with a title, a summary and the full text, in the language you spoke.
3. Think: your agent searches and reads those notes when you ask it to.
4. Ship: together you turn them into a plan, a draft, a decision or a to-do list.

Then the next idea starts from a sharper place, because you’ve just thought the last one through.

Step 1: Connect your agent (once)

SpeakPen has an MCP server, the open standard most AI assistants now use to connect to outside tools. Once connected, your agent gets three tools: search to find notes by topic, list_recent_notes to pull notes from a time range, and fetch to read a note in full.

The Connect page has step-by-step instructions for each client. The short version:

• Claude (web or desktop): Customize → Connectors → Add custom connector, and paste https://speakpen.app/mcp. Sign in to SpeakPen when asked.
• ChatGPT: turn on Developer mode, then add SpeakPen as a plugin with the same address. Whether this is available depends on your plan.
• Claude Code, Codex, Cursor, Gemini CLI and other coding agents: paste this sentence into the agent and it will set itself up:

Connect to my SpeakPen notes: read https://speakpen.app/connect and set it up.

Access is read-only. Your agent can search and read your notes, but it can’t create, change or delete them, and it never receives your audio. You can disconnect any assistant from your SpeakPen settings at any time.

To check that it works, ask: “What did I record recently?”

Step 2: Three prompts that turn notes into output

Copy these, then adjust the topics and time ranges to your own work.

The weekly review

Once a week, 20 minutes. This is the habit that stops notes from piling up unread.

Look at my SpeakPen notes from the last 7 days.
1. Group them into themes. For each theme, list the notes it comes from.
2. Which ideas showed up more than once? Those are the ones I keep coming back to.
3. List any open questions I asked myself.
4. Suggest the 3 most worthwhile next actions, each small enough to do this week.
5. Name anything that looks safe to drop.

Recurring ideas are the signal here. One note about a feature is a passing thought. The same idea said three times in different words, on different days, is something you actually care about.

From scattered ideas to a draft

When you want to write something: a blog post, a proposal, a strategy memo.

Search my SpeakPen notes for everything about [topic].
Read the relevant ones in full. Then:
- Summarize my actual position, in my own words where you can.
- Point out where my notes contradict each other.
- Draft an outline for a [blog post / proposal / memo] built from my
  arguments, not generic ones. Mark the gaps I still need to think about.

The result isn’t a finished piece, and it shouldn’t be. It’s a first draft built from weeks of your own thinking, which is a much better starting point than a blank page or a generic AI essay.

Prepare for a meeting or decision

I have a meeting about [project] tomorrow. Search my SpeakPen notes for
anything related: decisions, worries, ideas, follow-ups I promised.
Give me a one-page brief: what I said before, what's still open,
and the 3 points I most want to make.

This works especially well if you’ve been doing quick voice debriefs right after meetings, as described in Five moments your best ideas get lost.

When you don’t need an agent

Not everything needs a full agent session. For a single note, SpeakPen’s built-in AI is faster: rewrite the note as an email, a blog post, a LinkedIn post, an outline or a task list, pull out its action items, or use Ask to ask questions across all your notes, with answers that cite the notes they came from.

A good rule of thumb: one note → built-in AI. Many notes, or real thinking → your agent.

If you live in Obsidian

If your notes and agent workflows already live in an Obsidian vault, the SpeakPen Sync plugin brings each voice note into the vault as plain Markdown. Sync goes one way, from SpeakPen into your vault, so your agent can read your voice notes next to everything else you’ve written. Setup is on the Connect page.

What makes this work

The workflow is simple, but it depends on what goes in. Agents do their best work on notes that hold one idea each, say why it matters, and use the names you’d search for. If you haven’t yet, read Capture first, think later. It’s the other half of this post.

Start small: connect your agent today, record whatever comes up this week, and run the weekly review prompt on Friday. You may be surprised how much you already thought.