Problem
A phone agent needs to remember the call objective, follow the conversation, and use tools without losing track of the task.
Implementation
I connected Gemini Live and Twilio, with call objectives, conversation history, tool outputs, and transcripts managed throughout each call. Configuration and validation control which actions the agent can take.
Technical decisions
- Integrated Gemini Live with Twilio for live phone conversations.
- Managed relevant context across objectives, transcripts, and tool responses.
- Introduced input and output validation and controlled tool execution.
- Focused workflow optimization on latency, context usage, model efficiency, and traceability.
Results
The application connects phone conversations to tool calls and records transcripts and outputs for review.