Senior AI Engineer

This is a fully remote position, open to applicants in North America.

📋 Description

• Manage open challenges from research and prototyping through to production.

• Design and deliver agent-powered functionalities such as root-cause analysis, incident triage, and monitor generation.

• Collaborate with engineering teams to integrate agent-powered features into the platform.

• Develop evaluation infrastructure including golden datasets, regression suites, and both offline and online scoring.

• Take ownership of retrieval and context pipelines concerning customer metadata, lineage, and query history.

• Monitor agent behavior in production using traces, failure taxonomies, cost budgets, and latency budgets.

• Work closely with data science teams focusing on detection quality and experiment design.

• Collaborate with product management on agent functionalities and behavior.

• Establish technical patterns, guardrails, and reusable internal tools for LLM development.

⛳️ Requirements

• Proven experience in building autonomous agents in a production environment.

• Experience in running evaluations and monitoring agents following their launch.

• Responsible for an evaluation framework featuring golden datasets, regression suites, and both offline and online scoring.

• Proficient in Python as a primary programming language.

• Strong backend development skills.

• Background in ML or data science.

• Understanding of model behavior.

• Capability to navigate ambiguous problem statements and implement solutions in production.

• Regular use of AI tools such as Claude or similar.

• Experience in backend and model-layer tasks; frontend experience is not required.

• Ability to prioritize effective solution delivery over excessive polish.

• Nice to have: knowledge of statistics and hypothesis testing.

• Nice to have: experience in building and maintaining MCP servers.

• Nice to have: familiarity with Snowflake, Databricks, dbt, or Airflow.

🏝️ Benefits

• Equity.

• Stock Options.

• Healthcare plans.

• 401k Retirement Plan.

• Wellness Stipend.

• Home Office Stipend.

• Cell Phone or WIFI reimbursement.

• Paid Parental Leave.

• Flexible Time Off.

• Generous Travel Policy.

• Remote-first environment.