Senior AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of AI workflows from start to finish, including decisions on construction, deployment, measurement, and enhancement.

• Create agentic and LLM-based systems that integrate extraction, retrieval, reasoning, and tool utilization with defined human-in-the-loop checkpoints.

• Draft design documents, evaluate build-vs-buy and model options, and establish success metrics for workflows.

• Develop production-quality LLM pipelines featuring prompt and context design, structured outputs, validation, fallbacks, and confidence scoring.

• Connect AI services with Jeeves's backend via clear API agreements, retries, graceful degradation, and isolation of customer data.

• Oversee cost management and latency across models.

• Create evaluation sets and automate evaluations to identify regressions.

• Equip AI components with logging, tracing, dashboards, and alerts.

• Maintain a record of AI decisions for compliance with regulated financial products.

• Establish shared AI engineering standards, tools, and practices.

• Educate the broader team on the effective utilization of coding agents and AI tools.

• Review the AI system designs of colleagues and share insights gained.

⛳️ Requirements

• A minimum of 7 years of professional software engineering experience, including at least 2 years focused on building and managing LLM or AI-driven systems in a production environment.

• Proven experience in owning a significant system or workflow from initial scoping and design through to launch and iterative improvements, with minimal guidance.

• Practical experience in deploying LLM-powered applications utilizing APIs such as Anthropic, OpenAI, or equivalent, including structured outputs, error management, and evaluations.

• Skilled in designing agentic or multi-step AI workflows (tool usage, orchestration, human review steps).

• Strong expertise in Python, alongside solid backend fundamentals: REST APIs, PostgreSQL or comparable relational databases, async patterns, and a major cloud provider (AWS, GCP, or Azure).

• Experience in observability for AI systems, covering logging, tracing, dashboards, and quality monitoring.

• Professional fluency in English, both written and spoken.

🏝️ Benefits

• Competitive salary along with performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote working options.

• Opportunities for continuous learning and professional development.

• Supportive and collaborative team environment.