Skip to content
Indian Software Developers
Menu

Case study, status: prototype

Voice AI phone ordering agent

A phone agent that takes food orders by voice, built on telephony, an LLM with tool use and speech synthesis.

Overview

Problem

Restaurants lose orders when phones ring during rush hours, and staff spend time repeating the menu and taking details by hand.

Objective

Answer calls automatically, take a complete and valid order in natural conversation, and hand structured order data to the kitchen system.

Solution

  • A telephony backend on Telnyx receives the call and streams audio to the conversation layer.
  • Claude drives the conversation with a small set of tools: look up menu items, add to order, confirm order.
  • A separate prototype explored the same flow with an ElevenLabs conversational agent to compare voice quality and latency.

Architecture

  1. Caller

  2. Telnyx telephony

  3. Ordering backend

  4. Claude (tool use)

  5. Menu + order tools

  6. Order output

AI workflow

  1. 1Greet the caller and ask for the order
  2. 2Match spoken items to the menu with a lookup tool
  3. 3Ask for missing details such as size or quantity
  4. 4Read back the full order and ask for confirmation
  5. 5Emit the structured order only after confirmation

Technology

  • Telnyx
  • Claude API
  • ElevenLabs

Want something similar built?

Send a short brief. We'll reply personally with questions or a suggested next step — usually a technical discovery call.