Staff ML Software Engineer – Platform Systems

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and manage observability, evaluation, and tooling subsystems for next-generation ML architecture.

• Validate subsystems on existing AIMS operations, encompassing anomaly detection, root cause analysis, and operational automation.

• Create observability systems that illuminate model behavior, training pipeline health, serving latency, and data quality.

• Lead cost optimization initiatives across AIMS training and serving infrastructure through increasingly automated frameworks and tools.

• Architect improvements in reliability across the AIMS AI/ML stack, minimizing manual work and enhancing on-call ergonomics.

• Play a role in shaping the target architecture and migration strategy for the upgraded AIMS AI/ML stack.

• Collaborate with teams spearheading the AIMS modernization initiative.

• Assess emerging infrastructure patterns, model paradigms, and platform capabilities, translating them into a forward-thinking roadmap.

⛳️ Requirements

• Extensive experience in designing, developing, and managing production AI/ML systems at scale.

• Experience with training pipelines and familiarity with model serving and online inference under high traffic conditions.

• Practical experience in constructing subsystems for advanced agentic architectures, including memory, trace, evaluation, and replay pipelines, or orchestration and routing layers.

• Profound expertise in Python.

• Proficient in at least one JVM language: Scala or Java.

• Demonstrated success in enhancing AI/ML system reliability, lowering infrastructure costs, and increasing operational scalability.

• Experience in building observability and monitoring systems for AI/ML workloads across training, serving, and data pipelines.

• Strong foundation in distributed systems, including batch processing at scale and real-time serving infrastructure.

• Experience working with partner teams to drive cross-functional technical programs, manage dependencies, and build consensus without formal authority.

• High technical judgment with the ability to recognize patterns, develop reusable frameworks, and make practical investment decisions.

• Capability to operate with incomplete information, define problems, devise approaches, and adapt as necessary.

• Preferred: familiarity with LLM evaluation, trace, or replay tools.

• Preferred: knowledge of feature stores, model serving platforms, and experiment frameworks.

• Preferred: hands-on experience in migrating production AI/ML systems across different technology generations.

• Preferred: applied experience in personalization domains such as recommendation systems, search, or discovery.

🏝️ Benefits

• Annual salary-only compensation structure with the option to choose between salary and stock options.

• Health Plans.

• Mental Health support.

• 401(k) Retirement Plan with employer matching.

• Stock Option Program.

• Disability Programs.

• Health Savings and Flexible Spending Accounts.

• Family-forming benefits.

• Life and Serious Injury Benefits.

• Paid leave of absence programs.

• Full-time salaried employees are entitled to flexible time off immediately.