
Voice AI Consultant
Posted Sep 17

Posted Sep 17
This is a fully remote position, open to applicants in Poland, +5 more countries.
• Conduct an audit of the current Twilio ↔ Realtime-AI call bridge, encompassing media streams, ConversationRelay, and bi-directional contracts with the AWS-hosted platform.
• Analyze inbound invokes, outbound callbacks, retries, and reconciliation processes.
• Evaluate the production-readiness of the voice service, which includes health checks, capacity limits, alerting mechanisms, and incident response strategies.
• Identify any gaps in production readiness.
• Examine AI/session logic that drives calls, including relevant routes, background jobs, and schema.
• Produce a findings report alongside a prioritized roadmap for implementation.
• Offer part-time advisory support throughout the implementation phase.
• Review architectural and technical decisions associated with the project.
• Provide guidance on webhook contracts and telephony integration design.
• Advise on best practices for production operability.
• Proven experience with containerized AI workloads on AWS.
• Familiarity with tools and platforms such as Cursor, OpenAI, Twilio, ElevenLabs, GPT-4.0-mini, S3, Amazon Connect, KVS, Swagger, and OpenAI tools.
• Experience working with PostgreSQL databases.
• Experience utilizing Linear for project management.
• Proficient in TypeScript/JavaScript for real-time web and edge integrations.
• Experience with natural language processing libraries and speech processing toolkits, including deep learning frameworks like PyTorch or TensorFlow.
• Familiarity with speech recognition APIs, such as Amazon Transcribe.
• Experience with voice synthesis engines like Amazon Polly or Text-to-Speech.
• A strong understanding of GitHub, CI/CD pipelines, and Docker is highly desirable.
• Knowledge of real-time communication protocols, including WebSockets, gRPC, and WebRTC.
• Understanding of real-time and streaming LLM sessions, focusing on latency, interruption handling, turn-taking, and graceful degradation.
• Experience in designing prompts and system messages for constrained, task-specific voice agents.
• Experience with sentiment and outcome extraction from completed calls, along with validation methods.
• Competitive salary.
• Flexible working hours.
• Opportunities for professional development and training.
• Collaborative and inclusive work environment.
• Access to cutting-edge technology and tools.
Mercor
Mercor
Mercor
Mercor
Get handpicked remote jobs straight to your inbox weekly.