
Senior AI Engineer – LLMs, Agentic AI
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Brazil.
• Develop and sustain MCP servers, tool definitions, and context management functionalities.
• Design and execute workflows for intent evaluation, classification, and routing.
• Coordinate resolution into the appropriate API and data source calls, aggregating information from multiple sources.
• Integrate Anthropic and OpenAI models into live production environments.
• Oversee prompt versioning, fallback strategies, and optimization of LLM performance.
• Create and maintain frameworks for assessing model quality and performance in production.
• Write SQL queries for evaluating and monitoring model inputs and outputs.
• Support the backend operations of the chat/MCP interface.
• Collaborate with software engineers and AI specialists to provide production-ready AI solutions.
• Engage in architectural discussions and contribute to the design of the AI platform.
• Continuously enhance AI systems through experimentation, optimization, and adherence to engineering best practices.
• A Bachelor's Degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, or a related field is preferred, or equivalent professional experience.
• High proficiency in Python and adherence to software engineering best practices.
• Strong SQL skills for working with cloud data warehouses.
• Practical experience in developing production-grade LLM and agentic AI applications.
• Familiarity with implementing tool calling, MCP servers, context management, and multi-step orchestration.
• Experience in integrating hosted LLM APIs such as Anthropic and OpenAI into production systems.
• Knowledge of prompt engineering, prompt versioning, fallback strategies, and cost/latency optimization.
• Proven experience in designing intent classification and routing solutions for natural language applications.
• Background in building conversational AI solutions or multi-API orchestration workflows.
• Experience in developing methodologies for LLM evaluation.
• Capability to reverse-engineer and navigate a partially documented, brownfield codebase.
• Ability to articulate personal technical work in detail during sustained technical inquiries.
• Proficiency in professional English sufficient for conducting a technical interview or in-depth discussion.
• Senior-level experience in developing production AI applications utilizing Python and LLM technologies.
• Must have personally developed an MCP server.
• Experience in designing and implementing conversational AI or agentic AI solutions.
• Strong background in prompt engineering, LLM integrations, and evaluation methodologies.
• Conversational proficiency in English.
• Nice to have: experience in deploying, fine-tuning, and evaluating open-source models using Hugging Face.
• Nice to have: experience with GPU acceleration and inference optimization.
• Nice to have: familiarity with MLOps practices, including CI/CD, observability, and reproducible pipelines.
• Nice to have: knowledge of vector databases and Retrieval-Augmented Generation (RAG).
• Nice to have: applied NLP experience.
• Nice to have: experience in building client-facing AI products.
• Availability of remote work.
• Confidential handling of applicant information in accordance with EEO guidelines.
Vericast
Kovo
MUTT DATA
Docker, Inc
Get handpicked remote jobs straight to your inbox weekly.