AI Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and enhance harnesses for the execution and management of AI agents

• Establish orchestration patterns, tool utilization, and context management

• Formulate and version prompts with explicit quality standards

• Create regression tests for LLM-based behaviors

• Develop automated evaluations (evals) to assess output quality

• Implement telemetry systems and monitor performance alongside costs

• Transform quality standards into automated gates

• Create reusable tools for engineering teams

• Examine model failures and unexpected behaviors

• Participate in the ongoing enhancement of the agent fleet's quality

⛳️ Requirements

• Over 5 years of experience in Software Engineering

• At least 1 year of experience in developing LLM-based applications in a production environment

• Proficiency in agent orchestration

• Competence in tool utilization

• Familiarity with RAG (Retrieval-Augmented Generation)

• Expertise in context design and management

• Structured and methodical prompt engineering skills

• Experience in prompt versioning

• Knowledge of testing and regression practices

• Systematic evaluation of modifications

• Experience in building automated evaluations (evals)

• Telemetry skills for AI-based applications

• Monitoring of response quality

• Token cost management and oversight

• Experience in creating automated gates

• Ability to translate quality criteria into objective assessments

• Capacity to automate validations that can prevent out-of-standard deliveries

• Development of reusable tools for various teams

• A Bachelor's or Technologist degree (as specified in the job posting)

🏝️ Benefits

• Wellhub

• Starbem

• Avus (extendable to up to 4 dependents)

• Clube iFood

• Paid leave as mutually agreed

• Monthly performance and results bonuses through iFood Benefícios