Applied AI Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and manage AI functionalities within an enterprise platform.

• Engage in agent runtimes, model routing, RAG, tool/function invocation, guardrails, assessment, monitoring, cost management, latency enhancement, and quality control in production.

• Deliver AI functionalities that are operational in production environments rather than just demonstrations.

• Transition AI systems from prototypes to monitored production environments.

• Conduct thorough evaluations of AI behavior.

• Collaborate with product and engineering teams to assess when AI is an appropriate solution.

• Convert experiments into features ready for production.

• Integrate evaluation discipline throughout the delivery process.

• Assist client teams in making knowledgeable decisions regarding the genuine value AI can provide.

• Provide AI functionalities that are effective, reliable, measurable, safe, and cost-efficient.

⛳️ Requirements

• Proven experience in deploying software supported by LLMs, ML models, RAG systems, or agent-based workflows to actual production users.

• Background in designing or implementing agent runtimes, orchestration, model routing, tool/function invocation, or AI workflow methodologies.

• In-depth knowledge of RAG, grounding, retrieval quality, prompt design, context management, and evaluation techniques.

• Experience in developing evaluation harnesses, golden sets, regression checks, quality gates, or measurable AI performance frameworks.

• Capability to prioritize cost, latency, reliability, and safety as essential engineering parameters.

• Background in establishing guardrails and controls for AI systems, encompassing untrusted retrieved content, tool output risks, and potential failure modes.

• Experience in monitoring the behavior of production AI and enhancing systems based on empirical evidence.

• Strong software engineering abilities and a collaborative spirit with backend, platform, product, and security teams.

• Excellent communication and teamwork skills suitable for client-facing consulting situations.

• Pragmatic approach with the ability to prioritize business value and deliver effective AI functionalities swiftly and responsibly.

• Desired: Familiarity with Claude, GPT, Azure OpenAI, open-source models, model routing, fine-tuning, distillation, or small/edge models.

• Desired: Experience with MCP, A2A, multi-agent orchestration, AI tool invocation, or agent evaluation.

• Desired: Knowledge of LLM-as-judge methodologies calibrated against human assessment.

• Desired: Experience with semantic knowledge management, ontologies, knowledge graphs, or semantic layers.

• Desired: Familiarity with AI development lifecycle practices across data, build, evaluation, deployment, monitoring, and continuous improvement.

• Desired: Experience with AI-assisted development tools while ensuring rigorous review, testing, and safety standards.

🏝️ Benefits

• Direct-hire permanent employee position.

• Remote work arrangement.