
Senior AI Engineer, Ops Labs
Posted 10 hours ago

Posted 10 hours ago
This is a fully remote position, open to applicants in Argentina, +3 more countries.
• Design, develop, and scale autonomous AI agents for both product and internal operations.
• Create comprehensive AI strategies and use cases aimed at automating and enhancing CX Operations.
• Collaborate with the Head of Ops Labs and operations leadership to pinpoint operational opportunities and transform challenges into AI-supported workflows.
• Design predictive triggers, LLM-powered categorization, decision automation, and alert systems.
• Architect, deploy, and maintain stateful production AI agents capable of calling tools, transferring cases between queues, and preserving state throughout case lifecycles.
• Implement LLMOps monitoring, tracing, and observability for agent workflows.
• Integrate AI agents with CX platforms, compliance and hold queues, and transaction tools while utilizing least-privilege access.
• Oversee containerization, CI/CD deployment, and ensure post-launch stability.
• Develop automated evaluation pipelines utilizing LLM-as-a-judge, semantic similarity testing, adversarial benchmarking, and trajectory evaluations.
• Enhance RAG pipelines and agent loops through caching, prompt compression, and model routing.
• Mentor junior engineers and promote best practices in asynchronous programming, error handling, and structured data validation.
• Define autonomy boundaries, confidence thresholds, escalation paths, approval gates, and audit trails.
• A minimum of 5 years of hands-on experience in software engineering, including at least 2 years focused on building and deploying production-grade AI/ML applications centered on LLMs or generative AI.
• Proficiency in Python is essential.
• Extensive knowledge of at least one core LLM API or framework, such as OpenAI SDK, Google AI SDK, CrewAI, or LangChain.
• Demonstrated experience in shipping production AI agents that perform actions, including tool invocation, multi-step orchestration, state management, human-in-the-loop escalation, guardrails, and failure handling.
• Strong grasp of software development best practices, including Git/GitHub and CI/CD pipelines.
• Ability to convert ambiguous operational briefs into testable hypotheses and validate assumptions through experimentation.
• Capability to translate high-level business requirements into concrete, maintainable, and well-tested code.
• Experience in developing AI solutions for CX, support, compliance, or other operational teams.
• Equivalent competencies in the specified areas will also be taken into account.
• Familiarity with RAG and vector databases is a plus.
• Experience with personal projects or notable GitHub contributions is highly advantageous.
• Knowledge of AHT, FCR, CSAT, and SLA is considered a strong plus.
• Competitive salary.
• Initial stock options grant.
• Annual performance bonus.
• Unlimited PTO.
• Paid parental leave.
• Work model: currently fully remote, with plans for a future transition to a hybrid setup.
• Health, dental, and vision plans.
• Continuous learning opportunities.
• Empowering opportunities for growth in a dynamic entrepreneurial environment.
Vanta
Moxie
Banyan Software
Get handpicked remote jobs straight to your inbox weekly.