Skip to content

Add AssemblyAI voice agent tutorial using server-side HTTP tools - #1065

Open
vicdevman wants to merge 6 commits into
lablab-ai:mainfrom
vicdevman:assemblyai-voice-agent-http-tools
Open

vicdevman wants to merge 6 commits into
lablab-ai:mainfrom
vicdevman:assemblyai-voice-agent-http-tools

Conversation

@vicdevman

Copy link
Copy Markdown
Contributor

Covers the stored-agent path of AssemblyAI's Voice Agent API, where tools carry a URL and AssemblyAI makes the HTTP request itself, rather than the inline function-tool path that needs a client-side dispatcher held open for the whole call.

Walks through agent.json as the unit of deployment, a FastAPI booking service whose responses are written to be spoken, and three findings from building it: tool-schema rejection is opaque to the agent and silently turns a correct E.164 rule into a lost booking; an empty slot list conflates closed-for-the-weekend with fully-booked; and logging tool calls from FastAPI middleware needs content-length dropped from the copied headers.

Reference implementation: vicdevman/assemblyai-voice-agent-scheduler, with every code block linked to a pinned commit.

Images are not live yet - the three tags and the cover point at Cloudflare custom IDs whose uploads are blocked on a deactivated account.

Covers the stored-agent path of AssemblyAI's Voice Agent API, where tools
carry a URL and AssemblyAI makes the HTTP request itself, rather than the
inline function-tool path that needs a client-side dispatcher held open
for the whole call.

Walks through agent.json as the unit of deployment, a FastAPI booking
service whose responses are written to be spoken, and three findings from
building it: tool-schema rejection is opaque to the agent and silently
turns a correct E.164 rule into a lost booking; an empty slot list conflates
closed-for-the-weekend with fully-booked; and logging tool calls from
FastAPI middleware needs content-length dropped from the copied headers.

Reference implementation: vicdevman/assemblyai-voice-agent-scheduler,
with every code block linked to a pinned commit.

Images are not live yet - the three <Img> tags and the cover point at
Cloudflare custom IDs whose uploads are blocked on a deactivated account.
…AssemblyAI tutorial

Rewrites the introduction to open on what the Voice Agent API actually
offers and where the gap in coverage is, following the shape used in the
Alpaca and MindsDB tutorials, instead of leading with an abstract claim
about architecture.

Points the three Img tags at the uploaded screenshots on
lablab-static-eu: the full demo page mid-call, the tool-call feed
showing the BAD PHONE recovery, and the Demo data panel.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant