Forward Deployed Machine Learning Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Collaborate with the General Manager and initial customers to establish robust evaluations across various domains.

• Work alongside researchers to create and develop benchmarks.

• Set standards for handling multiple modalities.

• Develop backend infrastructure that includes data pipelines, execution environments, storage solutions, and orchestration.

• Create isolated environments for agentic evaluations that require tools, code execution, or multi-step processes.

• Recognize repeatable evaluation patterns, identify gaps in infrastructure, and uncover product opportunities from active engagements.

• Collaborate with DataLab on domain-specific data and research inquiries.

• Enhance understanding of the evaluation landscape, strategy, customer needs, and capabilities of platform/data partners.

• Identify significant technical investments and deliver multiple iterations of evaluation infrastructure.

• Take ownership of the engineering aspects of customer engagements from start to finish.

⛳️ Requirements

• Minimum of 4 years of engineering experience.

• Practical experience in machine learning, specifically in evaluating models.

• Previous responsibility for backend and infrastructure development.

• Ability to thrive in uncertain environments and a proactive approach to action.

• Comfort in working under pressure to satisfy market needs.

• Excellent written communication skills.

• Prior experience in creating benchmarks, evaluations, or human data pipelines for LLMs is a plus.

• Experience in a cutting-edge lab, an evaluation-focused team, or a research organization is advantageous.

• Background as a founding member or early engineer in a rapidly growing startup is desirable.

• Familiarity with agentic systems, reinforcement learning environments, code-execution sandboxes, and TEE/TREs is a plus.

🏝️ Benefits

• Competitive salary and equity options.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work opportunities.

• Professional development and learning opportunities.

• Supportive and inclusive company culture.