Senior Software Engineer – Applied AI

This is a fully remote position, open to applicants in Maryland.

📋 Description

• Develop and troubleshoot code within a live, real-time voice pipeline where latency and accuracy are critical to user experience.

• Create control systems that focus on large language models (LLMs), incorporating guardrails, budgets, watchdogs, and safe fallback mechanisms.

• Construct and manage LLM evaluation and batch-analysis pipelines.

• Oversee traditional machine learning workflows, guiding them from data collection to scheduled production inference.

• Investigate production issues, tracing them from metric anomalies to their root causes, including gathering evidence when the cause involves a vendor.

⛳️ Requirements

• A minimum of 7 years of experience in building and managing production backend systems, with strong programming skills in general-purpose languages (primarily Python).

• Proven experience operating distributed systems in the cloud, with confidence in debugging from telemetry to root cause.

• Practical experience working with LLMs or generative AI (from any provider or framework), along with the discernment to recognize when not to utilize a model.

• Proficient understanding of the traditional machine learning lifecycle; you focus on productionization rather than publication.

• Adherence to disciplined practices in a regulated environment, ensuring small, reviewable changes and careful management of sensitive data.

🏝️ Benefits

• Health insurance

• 401(k) matching

• Flexible work hours

• Professional development opportunities