AACA — AI Contact-Center Platform

Aug 1, 2025 · 1 min read
projects

Project Details

01

Microservices Architecture

Separated a latency-sensitive realtime voice edge from a stateful business control plane for independent scaling, deployment, and ownership.
02

Low-Latency Voice Edge

Developed FastAPI and WebSocket services for streaming call audio and realtime agent interactions.
03

Telephony Integration

Bridged Twilio Media Streams to the OpenAI Realtime API with native G.711 u-law audio to minimize transcoding overhead.
04

Speech Performance

Delivered bidirectional speech-to-speech interaction with sub-second voice AI latency.
05

RAG & Tool Calling

Used OpenAI embeddings and Milvus retrieval with tools for knowledge search, customer verification, and ticket workflows.
06

Secure Operations

Enforced identity verification before sensitive tool operations inside live voice sessions.
07

Agent Handoff

Designed Redis pub/sub channels for cross-instance WebSocket delivery, call assignment, transfer, and human handoff coordination.
08

Deployment Stack

Containerized MongoDB, Redis, Milvus, MinIO, and PostgreSQL with Docker Compose for Cloud Run horizontal scaling.

Tech Stack

Voice & AI

Python GCP GenAI LLMs Agents RAG OpenAI Realtime API Twilio WebSockets

Backend & Data

FastAPI Milvus Redis MongoDB JWT

Deployment

Docker Docker Compose MinIO Postgres Cloud Run
Shiv Kumar
Authors
Lead Engineer — GenAI / Agentic AI & Applied ML

Lead Engineer with 5 years of hands-on experience developing and deploying GenAI, RAG, Agentic AI, and deep learning systems from scratch. I build production-grade AI platforms for realtime voice interaction, enterprise knowledge retrieval, regulatory search, and automated finance analysis. My work spans NLP, autonomous driving, computer vision, and Camera-LiDAR-Radar fusion, with a focus on reliable architecture, model optimization, and scalable data pipelines.

Stack: Python, GCP, GenAI, LLMs, Agents, Docker, FastAPI, Cloud SQL, Google ADK, Vertex AI, Agent Engine, Cloud Run, OpenAI Realtime API, WebSockets, Redis, MongoDB, Milvus, JWT, Docling, BM25, ModernBERT, vLLM, and FAISS.