Senior AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop AI agents, encompassing RAG pipelines, orchestration workflows, and tool invocation.

• Create evaluation frameworks to assess system accuracy, latency, cost, and reliability.

• Establish observability and monitoring throughout the AI system lifecycle.

• Collaborate with various AI providers and create abstraction layers for multi-model architectures.

• Enhance AI systems for better performance, cost efficiency, and scalability.

• Construct and deploy AI-driven applications that are closely integrated with real business workflows.

• Incorporate AI systems into current enterprise platforms and APIs.

• Troubleshoot and optimize systems in live production environments.

• Work collaboratively with client and internal engineering teams.

• Engage in technical design discussions centered around implementation.

⛳️ Requirements

• Over 4 years of experience in building and deploying AI/ML systems in production settings.

• Proven history of architecting, developing, and delivering AI/ML or software solutions utilizing contemporary AI-assisted workflows.

• In-depth knowledge of AI system evaluation and measurement, including offline metrics, online monitoring, LLM-as-judge processes, regression testing, and cost/latency tracking.

• Practical insight into retrieval and agent design trade-offs, encompassing RAG, agent loops, and workflows.

• Hands-on experience with LLM platforms such as OpenAI, Anthropic, or Google Vertex, along with orchestration and harness patterns.

• Proficient in Python.

• Strong backend engineering capabilities, including API development and deployment, Docker, and cloud-native environments.

• Solid foundation in software engineering principles and the ability to produce maintainable, production-quality code.

• Familiarity with CI/CD pipelines, infrastructure as code, and production observability.

• Ability to debug and optimize systems currently in production.

• Excellent communication skills with the capability to articulate technical trade-offs to non-technical stakeholders.

• Preferred familiarity with prompt optimization or evaluation tools like DSPy, MLflow, promptfoo, or RAGAS.

• Experience in LLMOps/MLOps is preferred.

• Previous harness engineering experience is preferred.

• Databricks experience is preferred.

• Familiarity with AWS, Azure, or GCP is preferred.

• Experience with FastAPI, Pydantic, PostgreSQL, MySQL, or DuckDB is preferred.

• Experience using the Claude SDK or OpenAI SDK is preferred.

• Knowledge of TypeScript or Go is preferred.

• Experience mentoring or enhancing the skills of fellow engineers is preferred.

🏝️ Benefits

• Bonus of 10% of base salary, with a bonus range of $14.5K–$19.1K for the Senior Engineer tier.

• Flexible remote work arrangement.

• Inclusive and diverse work environment.