Voice AI Consultant

Posted Sep 17

This is a fully remote position, open to applicants in Poland, +5 more countries.

📋 Description

• Conduct an audit of the current Twilio ↔ Realtime-AI call bridge, encompassing media streams, ConversationRelay, and bi-directional contracts with the AWS-hosted platform.

• Analyze inbound invokes, outbound callbacks, retries, and reconciliation processes.

• Evaluate the production-readiness of the voice service, which includes health checks, capacity limits, alerting mechanisms, and incident response strategies.

• Identify any gaps in production readiness.

• Examine AI/session logic that drives calls, including relevant routes, background jobs, and schema.

• Produce a findings report alongside a prioritized roadmap for implementation.

• Offer part-time advisory support throughout the implementation phase.

• Review architectural and technical decisions associated with the project.

• Provide guidance on webhook contracts and telephony integration design.

• Advise on best practices for production operability.


⛳️ Requirements

• Proven experience with containerized AI workloads on AWS.

• Familiarity with tools and platforms such as Cursor, OpenAI, Twilio, ElevenLabs, GPT-4.0-mini, S3, Amazon Connect, KVS, Swagger, and OpenAI tools.

• Experience working with PostgreSQL databases.

• Experience utilizing Linear for project management.

• Proficient in TypeScript/JavaScript for real-time web and edge integrations.

• Experience with natural language processing libraries and speech processing toolkits, including deep learning frameworks like PyTorch or TensorFlow.

• Familiarity with speech recognition APIs, such as Amazon Transcribe.

• Experience with voice synthesis engines like Amazon Polly or Text-to-Speech.

• A strong understanding of GitHub, CI/CD pipelines, and Docker is highly desirable.

• Knowledge of real-time communication protocols, including WebSockets, gRPC, and WebRTC.

• Understanding of real-time and streaming LLM sessions, focusing on latency, interruption handling, turn-taking, and graceful degradation.

• Experience in designing prompts and system messages for constrained, task-specific voice agents.

• Experience with sentiment and outcome extraction from completed calls, along with validation methods.


🏝️ Benefits

• Competitive salary.

• Flexible working hours.

• Opportunities for professional development and training.

• Collaborative and inclusive work environment.

• Access to cutting-edge technology and tools.

People also viewed

Mercor22 hours ago

AI Safety Red Teamer

US flagUnited States OnlyFreelanceArtificial Intelligence$70 – $84/hour
ApplyView job
Mercor23 hours ago

AI Safety Expert – English, Telugu

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor23 hours ago

AI Safety Experts, English, Punjabi

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor1 day ago

AI Safety Expert, English, Gujarati

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor1 day ago

AI Safety Experts – English, Punjabi

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor1 day ago

AI Safety Expert – English, Gujarati

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers