OpenAI's Breakthrough Low Latency Voice API v2.1
TL;DR – Executive Summary Low latency voice takes a massive leap with gpt-realtime-2.1 and gpt-realtime-2.1-mini . Internal benchmarks show round-trip audio delay dropping below 200 ms (machine‑side) in production. Real‑time WebSocket connections now support chunked audio streaming and interrupt‑first semantics out of the box. We’ll walk through deployment‑ready YAML, raw curl commands, and two 💡 Pro Tips that saved us from falling back to pre‑recorded IVR trees. We still remember the first time we plugged a cloud STT‑LLM‑TTS pipeline into a customer‑facing phone line. The latency was so bad the caller thought the agent had hung up. Voice AI that stumbles isn’t artificial intelligence—it’s artificial rudeness. OpenAI’s new Realtime API 2.1 models finally let us treat voice as a first‑class modality, not a franken‑pipeline of independent services. The Latency Tax We’ve All Been Paying Before the Realtime API, assembling a voice agent meant stringing together a V...