Senior Software Engineer – Applied AI

This is a fully remote position, open to applicants in New York.

📋 Description

• Develop and troubleshoot code within a live, real-time voice pipeline, where user-facing latency and accuracy are critical.

• Create control systems for LLMs, including guardrails, budgets, watchdogs, and secure fallback options.

• Construct and manage LLM evaluation and batch-analysis workflows.

• Take ownership of traditional ML processes, from data handling to scheduled production inference.

• Investigate production issues, tracing them from metric anomalies to root causes, including compiling evidence when a vendor is involved.

⛳️ Requirements

• Over 7 years of experience in building and managing production backend systems, with robust general-purpose programming abilities (primarily in Python).

• Proficient in running distributed systems in cloud environments; adept at debugging from telemetry to root cause analysis.

• Practical experience in production settings with LLMs or generative AI (from any provider or framework), along with the discernment to determine when a model should not be utilized.

• Familiarity with the complete traditional machine learning lifecycle (ability to productionize without the need for publication).

• Methodical approach in a regulated environment, ensuring small, reviewable changes and careful management of sensitive information.

🏝️ Benefits

• Comprehensive health insurance coverage.

• Opportunities for professional development.