Staff ML Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Establish the technical direction for ML training, serving, and observability.

• Act as the final escalation point for complex infrastructure issues related to GPU capacity, Spark tuning, and production incidents.

• Take ownership of and enhance the paved-road framework, which includes shared CI/CD, model-workflow scaffolding, and Databricks Asset Bundles.

• Lead the architecture for LLM endpoint serving across Databricks, AWS, Snowflake, and self-hosted deployments.

• Tackle challenges related to latency, cost, caching, evaluation, and PHI-safe routing for LLM serving.

• Manage standards and tools for MLflow, model registry, training image supply chain, and observability.

• Collaborate with Data & ML Platform, Data Science, App Dev, and Operations teams.

• Provide technical insights for vendor and platform selection processes.

• Mentor senior engineers and offer guidance to platform users.

• Write high-impact code and engage in hands-on Infrastructure-as-Code development.

⛳️ Requirements

• Over 10 years of software engineering experience, including a minimum of 3 years in designing, evolving, and operating enterprise-scale ML platforms in production.

• Strong technical judgment in ambiguous situations and a proven record of establishing standards and influencing colleagues.

• Production experience with Databricks and/or Amazon SageMaker.

• Familiarity with MLflow or a similar tracking and registry system.

• Experience with at least one core ML framework, such as PyTorch or TensorFlow.

• Proficiency in Java or a JVM equivalent, along with Python.

• Extensive experience with Apache Spark for large-scale data and distributed computing.

• In-depth knowledge of AWS, including networking, IAM, GPU compute, storage, and messaging services.

• Proficiency in Terraform, containers, Kubernetes, and GitHub-based CI/CD for ML workloads.

• Direct experience in serving LLMs in production, including cost management, evaluation harnesses, and secure handling of sensitive prompts and outputs.

• Regular use of Claude Code, Cursor, Copilot, or similar AI coding tools.

• Excellent written and verbal communication skills, particularly in asynchronous remote environments.

• This position is not eligible for employment sponsorship.

• Preferred: experience in technical leadership for healthcare or regulated-industry ML platforms; knowledge of Databricks Asset Bundles, Unity Catalog, Iceberg, Delta; specialized inference pipelines; GPU capacity planning; Kafka or Kinesis; clinical or safety-sensitive AI evaluation and red teaming; open-source ML infrastructure or production ML publications.

🏝️ Benefits

• Comprehensive total rewards compensation strategy.

• Post-offer health screenings and vaccinations as mandated by clients.

• Reasonable accommodations provided for individuals with physical and mental disabilities.

• Equal employment opportunity protections.