
Senior MLOps Engineer
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in United States.
• Design, implement, and manage MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM).
• Develop automated CI/CD pipelines, Infrastructure as Code solutions, and monitoring/alerting systems for RAG applications, AI agents, and production deployments.
• Oversee Linux server management, networking, security endpoints, and resolve production issues in collaboration with AI engineering teams.
• Create and enforce organization-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates.
• Collaborate with AI Developers and RAG Engineers on system architecture, deployment strategies, tool selection, and production readiness.
• Convert feature requirements into dependable, secure, and cost-effective infrastructure, while maintaining extensive system documentation.
• Provision containerized workloads, Linux servers, and infrastructure using Terraform and Ansible across cloud and on-premises environments.
• Manage CI/CD processes with GitHub Actions and Azure DevOps, utilize observability tools such as Prometheus and Grafana, ensure secure networking, and support GPU-enabled hardware.
• Diagnose platform incidents, conduct root cause analysis, and ensure operational resilience.
• 5+ years of senior-level experience in DevOps/SRE/platform engineering, including at least 1 year of deploying ML models and LLM inference engines (Ollama, vLLM) in production environments.
• Proficient in Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP).
• Practical experience with Infrastructure as Code tools (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), as well as Bash and Python scripting.
• Strong foundation in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2).
• Familiarity with ML tools (MLflow, Kubeflow), vector databases, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.
• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance.
• Opportunities for professional development and continuous learning.
• Flexible work hours and remote work options.
• Collaborative and innovative work environment.
Memory Bridge
Entrada
Find Your Talent (FYT)
Inmetrics
Get handpicked remote jobs straight to your inbox weekly.