Senior Software Engineer – Applied AI

This is a fully remote position, open to applicants in Massachusetts.

📋 Description

• Develop and troubleshoot code on a live, real-time voice pipeline where latency and accuracy impact the user experience.

• Create control systems surrounding LLMs: including guardrails, budgets, watchdog mechanisms, and safe fallback options.

• Construct and maintain LLM evaluation and batch-analysis pipelines.

• Manage traditional ML workflows from data ingestion to scheduled production inference.

• Diagnose production issues from metric anomalies to their root causes, including gathering evidence when the issue involves a vendor.

⛳️ Requirements

• Over 7 years of experience in developing and managing production backend systems, with strong general programming skills (our primary language is Python).

• Proficient in operating distributed systems in the cloud and comfortable with debugging from telemetry data to root causes.

• Practical production experience with LLMs or generative AI (regardless of provider or framework), as well as the discernment to understand when not to utilize a model.

• Working knowledge of the traditional machine learning lifecycle (you implement; publishing is not required).

• Methodical in a regulated environment: making small, reviewable changes and carefully handling sensitive information.

🏝️ Benefits

• Health insurance

• Retirement plans

• Paid time off

• Flexible work arrangements

• Professional development