AI Engineering Manager

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Oversee the complete delivery of AI projects, ensuring effective governance, robust communication with stakeholders, and dependable execution.

• Develop and construct solid RAG systems, agentic frameworks, and LLM-driven solutions tailored for production settings.

• Utilize prompt engineering methodologies such as instructional design, few-shot prompting, structured outputs, and tool/agent prompts.

• Conduct feasibility evaluations across various methods including prompting, RAG, fine-tuning, classical ML, and hybrid solutions.

• Create AI evaluation frameworks employing LLM-as-a-judge, custom metrics, recall@k, precision@k, and go/no-go gates.

• Execute structured experiments focusing on prompts, retrievers, chunking methodologies, embeddings, reranking strategies, and models.

• Detect and classify model failures, including hallucinations, retrieval misses, instruction-following errors, and quality regressions.

• Establish scalable inference infrastructure and CI/CD pipelines for AI and ML models.

• Automate the MLOps/LLMOps lifecycle encompassing tracking, versioning, deployment, monitoring, retraining, and ongoing enhancement.

• Design APIs, microservices, and orchestration layers that are optimized for latency, cost, reliability, and scalability.

• Mentor junior engineers to foster their professional growth.

• Contribute to proposals, solution designs, and initiatives for new business ventures.

• Engage in communication with engineering teams, senior stakeholders, and clients.

⛳️ Requirements

• Minimum of 6 years of professional experience in developing and deploying AI, ML, or data-driven/software solutions within production environments.

• Profound knowledge of Python programming.

• Strong proficiency in Git practices.

• Practical experience with LLM-driven solutions, RAG systems, and contemporary GenAI development methodologies.

• Hands-on experience with chunking, embeddings, retrieval, reranking, and evaluation processes.

• Solid understanding of prompt engineering, structured outputs, few-shot prompting, instructional design, and tool/agent prompts.

• Experience in formulating AI evaluation strategies, which include metrics, dataset curation, structured experimentation, and quality gates.

• Familiarity with MLOps/LLMOps practices and tools like MLflow, Weights & Biases, or similar platforms.

• Strong cloud experience, particularly with AWS, Azure, or GCP; Azure experience is preferred.

• Proficient in containerization, orchestration, scalable inference, APIs, and microservices.

• Understanding of event-driven architectures and production-quality engineering practices.

• Capability to communicate effectively with engineering teams, senior stakeholders, and clients.

• A pragmatic approach that balances innovation, reliability, cost, latency, and business value.

• Advanced proficiency in English for both written and verbal communication is required.

• Nice to have: Experience with Databricks MLOps, LLM fine-tuning, agentic GenAI systems, Infrastructure as Code, security and observability for AI services, classical machine learning, or contributions to open-source and public technical work.

🏝️ Benefits

• Flexible working arrangements.

• All necessary equipment to maximize your potential (MacBook and accessories).

• Daily lunches at headquarters, including vegetarian, vegan, gluten-free, and sugar-free options.

• Gourmet meals every Friday with an on-site chef at headquarters.

• Snacks and beverages readily available each day at headquarters.

• After-office events, including football, tennis, and game nights at headquarters.

• Opportunities for participation in a football league, pool games, tennis courts, chess championships, and music nights.

• AWS certifications, study plans, courses, and other certification opportunities.

• English language lessons available.

• Tech Tuesdays for learning and development.

• Mentoring and professional development opportunities.

• Gifts for anniversaries and birthdays.