Senior MLOps Engineer

Posted 4 days ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, implement, and manage MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM).

• Develop automated CI/CD pipelines, Infrastructure as Code solutions, and monitoring/alerting systems for RAG applications, AI agents, and production deployments.

• Oversee Linux server management, networking, security endpoints, and resolve production issues in collaboration with AI engineering teams.

• Create and enforce organization-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates.

• Collaborate with AI Developers and RAG Engineers on system architecture, deployment strategies, tool selection, and production readiness.

• Convert feature requirements into dependable, secure, and cost-effective infrastructure, while maintaining extensive system documentation.

• Provision containerized workloads, Linux servers, and infrastructure using Terraform and Ansible across cloud and on-premises environments.

• Manage CI/CD processes with GitHub Actions and Azure DevOps, utilize observability tools such as Prometheus and Grafana, ensure secure networking, and support GPU-enabled hardware.

• Diagnose platform incidents, conduct root cause analysis, and ensure operational resilience.


⛳️ Requirements

• 5+ years of senior-level experience in DevOps/SRE/platform engineering, including at least 1 year of deploying ML models and LLM inference engines (Ollama, vLLM) in production environments.

• Proficient in Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP).

• Practical experience with Infrastructure as Code tools (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), as well as Bash and Python scripting.

• Strong foundation in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2).

• Familiarity with ML tools (MLflow, Kubeflow), vector databases, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.


🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Opportunities for professional development and continuous learning.

• Flexible work hours and remote work options.

• Collaborative and innovative work environment.

People also viewed

Memory Bridge10 hours ago

Senior Applied ML Engineer

US flagUnited States OnlyFull-timeMachine Learning Engineer
ApplyView job
Entrada11 hours ago

Senior Machine Learning Engineer, Databricks

PL flagPoland, +2 more countriesFull-timeMachine Learning Engineer
ApplyView job
Find Your Talent (FYT)13 hours ago

Senior Machine Learning Engineer

US flagUnited States OnlyFull-timeMachine Learning Engineer
ApplyView job
Inmetrics13 hours ago

Machine Learning Engineer

BR flagBrazil OnlyFull-timeMachine Learning Engineer
ApplyView job
SandboxAQ15 hours ago

Staff Machine Learning Engineer – Medical Devices

CA flagCanada OnlyFull-timeMachine Learning EngineerC$146k – C$258k/year
ApplyView job
StackAdapt15 hours ago

Staff Applied Machine Learning Scientist – Identity

US flagUnited States, +1 more countryFull-timeMachine Learning Engineer$182.4k – $250.8k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers