
AI Engineer
Posted 19 hours ago

Posted 19 hours ago
This is a fully remote position, open to applicants in Brazil.
• Design and enhance harnesses for the execution and management of AI agents
• Establish standards for orchestration, tool utilization, and context management
• Develop and version prompts, regression tests, and automated evaluations (evals)
• Implement telemetry systems to monitor application quality, performance, and costs
• Convert quality criteria into automated gates that can block non-compliant releases
• Create reusable tools to assist engineering teams
• Investigate model failures and continuously enhance the quality of the agent fleet
• Standardize the application of agents and LLMs across various development teams
• Collaborate and communicate effectively with different engineering teams
• Minimum of 5 years of experience in Software Engineering
• At least 1 year of experience in developing production LLM applications
• Practical expertise in agent orchestration, tool utilization, RAG, and context management
• Experience in prompt engineering and versioning, including regression testing and systematic evaluation of modifications
• Proficiency in building automated evaluations (evals) and monitoring response quality
• Knowledge of AI application telemetry, performance tracking, and token cost management
• Experience in creating quality gates and automated checks based on objective criteria
• Development of reusable tools for engineering teams
• Bachelor’s degree or Technology degree
• Willingness to work as an independent contractor
• Wellhub
• Starbem
• Avus, with the option to include up to 4 dependents
• iFood Club
• Paid time off in accordance with the agreed terms
• Monthly performance and results bonus through iFood Benefits
• Health insurance
Extend
OhioHealth
Capital One
Software Mind
Get handpicked remote jobs straight to your inbox weekly.