Machine Learning Engineer, Ops

This is a fully remote position, open to applicants in Europe.

📋 Description

• Design and sustain the inference infrastructure for architectures of generative audio models.

• Implement and oversee high-performance inference engines.

• Manage service deployments using Kubernetes (K8S), applying advanced autoscaling strategies to efficiently accommodate varying traffic loads.

• Create and automate robust CI/CD pipelines to optimize the testing and deployment of model artifacts and inference configurations.

• Monitor production systems, establishing observability practices to assess latency, resource utilization, and overall model performance.

• Work closely with research teams to enhance model serving paths and assess diverse inference strategies.

• Enhance inference performance for both streaming and batch applications.

⛳️ Requirements

• In-depth knowledge of contemporary audio model architectures (e.g., TTS, ASR) and their specific inference requirements.

• Extensive hands-on experience with Kubernetes (K8S), container orchestration, and the implementation of autoscaling strategies for production workloads.

• Strong background in MLOps, including CI/CD automation and management of scalable cloud infrastructure.

• Proficient in software engineering principles and experienced in Python or Go for infrastructure tooling and backend services.

• Familiarity with GPU-accelerated inference and performance profiling techniques.

• Experience with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni) is a plus.

🏝️ Benefits

• Competitive salary and generous company equity

• Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina

• 42 days of paid time off, including:

• 15 PTO days

• 10 sick days

• 15 company holidays

• 2 floating holidays

• Generous parental leave & fertility support

• 401(k) retirement savings plan

• Lifestyle spending account – $500/month to use however you’d like

• Complimentary lunch and snacks for in-office employees

• One Medical membership, and more!