Senior AI Engineer – LLMs, Agentic AI

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Construct and uphold MCP servers, tool definitions, and context management functionalities.

• Create and execute workflows for intent evaluation, classification, and routing.

• Coordinate resolutions into the appropriate API and data source calls, aggregating information across multiple sources.

• Integrate Anthropic and OpenAI models into production settings.

• Oversee prompt versioning, fallback strategies, and optimization of LLM performance.

• Develop and sustain evaluation frameworks to verify model quality and performance in production.

• Write SQL queries against model inputs and outputs to assist in evaluation and monitoring.

• Provide support for the backend functionalities of the chat/MCP interface.

• Work collaboratively with software engineers and AI experts to deliver production-ready AI solutions.

• Engage in architectural discussions and contribute to the design of the AI platform.

• Continuously enhance AI systems through experimentation, optimization, and adherence to engineering best practices.

⛳️ Requirements

• A Bachelor's Degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, or a related field is preferred, or equivalent professional experience.

• Strong expertise in Python and adherence to software engineering best practices.

• Proficient SQL skills for working with cloud data warehouses.

• Practical experience in developing production-grade LLM and agentic AI applications.

• Experience in implementing tool calling, MCP servers, context management, and multi-step orchestration.

• Familiarity with integrating hosted LLM APIs such as Anthropic and OpenAI into production environments.

• Background in prompt engineering, prompt versioning, fallback strategies, and optimizing cost/latency.

• Experience in designing intent classification and routing solutions for natural language applications.

• Proven experience in building conversational AI solutions or multi-API orchestration workflows.

• Knowledge of developing LLM evaluation methodologies.

• Ability to reverse-engineer and navigate a partially documented, brownfield codebase.

• Capability to articulate technical work in detail during sustained technical questioning.

• Professional proficiency in English sufficient for conducting full technical interviews or in-depth discussions.

• Senior-level experience in building production AI applications using Python and LLM technologies.

• Must have personally authored or developed an MCP server.

• Experience in designing and deploying conversational AI or agentic AI solutions.

• Strong background in prompt engineering, LLM integrations, and evaluation methodologies.

• Conversational proficiency in English.

• Nice to have: Experience in deploying, fine-tuning, and evaluating open-source models using Hugging Face.

• Nice to have: Experience with GPU acceleration and inference optimization.

• Nice to have: Experience in implementing MLOps practices, including CI/CD, observability, and reproducible pipelines.

• Nice to have: Experience with vector databases and Retrieval-Augmented Generation (RAG).

• Nice to have: Applied experience in NLP.

• Nice to have: Experience in building client-facing AI products.

🏝️ Benefits

• Availability of remote work.

• Confidential treatment of applicant information in accordance with EEO guidelines.