Voice AI phone ordering agent
A phone agent that takes food orders by voice, built on telephony, an LLM with tool use and speech synthesis.
Problem
01 — OverviewRestaurants lose orders when phones ring during rush hours, and staff spend time repeating the menu and taking details by hand.
Answer calls automatically, take a complete and valid order in natural conversation, and hand structured order data to the kitchen system.
Solution
02 — Build- 01
A telephony backend on Telnyx receives the call and streams audio to the conversation layer.
- 02
Claude drives the conversation with a small set of tools: look up menu items, add to order, confirm order.
- 03
A separate prototype explored the same flow with an ElevenLabs conversational agent to compare voice quality and latency.
Architecture
03 — SystemAI workflow
04 — SequenceGreet the caller and ask for the order
Match spoken items to the menu with a lookup tool
Ask for missing details such as size or quantity
Read back the full order and ask for confirmation
Emit the structured order only after confirmation
Technology & role
05 — DeliveryAgent design, conversation flow, backend integration and tool design.
Want something similar built?
Send a short brief. We'll reply personally with questions or a suggested next step — usually a technical discovery call.