Senior AI/Machine Learning Analyst

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and manage large-scale workflows for AI agents utilizing LLMs, adhering to stringent latency, reliability, and cost parameters.

• Oversee the complete lifecycle of hybrid AI systems that integrate LLM-based agents with conventional Machine Learning models.

• Create and enhance resilient, stateful workflow orchestration tailored for prolonged, significant review processes.

• Establish and implement comprehensive evaluation strategies for LLM agents, encompassing offline datasets, quality metrics, regression testing, and monitoring in production.

• Spearhead end-to-end LLMOps: selecting providers, optimizing costs, managing rate limits, upgrading models, and implementing failover strategies.

• Convert product specifications into technical designs, evaluate feasibility, and address risks associated with stochastic AI systems.

• Collaborate intimately with Product, Compliance, and global Engineering teams to articulate system capabilities, limitations, and risk profiles.

⛳️ Requirements

• Demonstrated experience in developing and managing LLM-based agents within large-scale production settings.

• Strong comprehension of agent architectures, prompt engineering, structured outputs, guardrails, and optimization of cost and latency.

• Practical experience with agent orchestration and observability frameworks (e.g., LangGraph, LangSmith, LangFuse, or similar).

• Robust background in traditional Machine Learning pipelines, model evaluation, and serving.

• Strong software engineering proficiency in Python, encompassing async programming, API design, testing, CI/CD, and cloud-native infrastructure (Docker/Kubernetes, GCP/AWS).

• Hands-on knowledge of LLMOps, focusing on cost control, rate limits, model lifecycle management, and multi-provider strategies.

• Advanced or fluent English proficiency.

• Completion of a Bachelor's degree.

🏝️ Benefits

• We cover 100% of medical and dental plans for Sinchers and eligible dependents through Bradesco Saúde.

• With the Caju flexible benefit card, our Sinchers can select benefits for food, education, and home office assistance.

• Our Sinchers are entitled to paid maternity leave for 180 days and paternity leave for 30 days, along with daycare assistance for children up to five years old.

• We collaborate with Wellhub to facilitate access to gyms and wellness options for our Sinchers.

• Our partnership with Prudential life insurance provides coverage for all Sinchers in cases of unexpected absences, serious illness, accidents, and disabilities.

• We offer annual reimbursements for certain expenses related to disabilities and/or transgender needs.

• Our Sinchers can take a day off on their birthday to celebrate with their loved ones.