
Senior AI Engineer, Ops Labs
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Mexico.
• Develop, construct, and expand autonomous AI agents tailored for both product and internal operations.
• Collaborate with Operations leadership to convert operational challenges into AI-enhanced workflows.
• Create solutions that incorporate predictive triggers, LLM-driven categorization, decision automation, and alert systems.
• Design, deploy, and manage stateful production AI agents that utilize tools, transition cases among queues, and maintain state throughout case lifecycles.
• Implement monitoring, tracing, and observability for agent-based workflows.
• Integrate AI agents into customer experience platforms, compliance and hold queues, and transaction tools using least-privilege access principles.
• Oversee containerization, CI/CD deployment, and post-launch stability.
• Develop automated evaluation pipelines utilizing LLM-as-a-judge, semantic similarity assessments, adversarial benchmarking, and trajectory evaluations.
• Enhance RAG pipelines and agent loops through caching, prompt compression, and model routing strategies.
• Mentor junior engineers and promote best practices in asynchronous programming, error handling, and structured data validation.
• Establish autonomy limits, confidence thresholds, escalation protocols, approval gates, and audit trails.
• Collaborate with AI leaders, engineering teams, and product managers to translate AI strategy into actionable roadmaps.
• A minimum of 5 years of hands-on software engineering experience, with at least 2 years focused on building and deploying production-grade AI/ML applications centered on LLMs or generative AI.
• Proficiency in Python is essential.
• Strong familiarity with at least one primary LLM API or framework, such as OpenAI SDK, Google AI SDK, CrewAI, or LangChain.
• Demonstrated experience in delivering production AI agents capable of executing actions, including tool invocation, multi-step orchestration, state management, human-in-the-loop escalation, guardrails, and error handling.
• Solid understanding of software development best practices, including Git/GitHub and CI/CD pipelines.
• Ability to convert ambiguous operational briefs into testable hypotheses and validate assumptions through experimentation.
• Capability to translate high-level business requirements into concrete, maintainable, and thoroughly tested code.
• Experience in creating AI solutions for customer experience, support, compliance, or other operational teams.
• Equivalent competencies in the aforementioned areas will also be taken into account.
• Competitive salary.
• Initial stock options grant.
• Annual performance bonus.
• Unlimited PTO.
• Paid parental leave.
• Work model: currently fully remote, with plans to transition to a hybrid setup in the future.
• Health, dental, and vision plans.
• Continuous learning opportunities.
• Empowering opportunities for growth in a dynamic entrepreneurial environment.
World Vision
FICO
Guidehouse
Workiva
Get handpicked remote jobs straight to your inbox weekly.