
Senior MLOps Engineer
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in Romania.
• Design and oversee scalable ML infrastructure on GCP utilizing Vertex AI, Google Kubernetes Engine, Google Cloud Storage, Cloud Run, and GPU/TPU compute instances.
• Take responsibility for the complete deployment lifecycle of machine learning models.
• Develop high-throughput, low-latency inference services using containerization and specialized serving frameworks.
• Create automated and reproducible pipelines for model training, testing, evaluation, and deployment.
• Implement monitoring systems for overall health and ML-specific metrics, including automated triggers for retraining.
• Provide scalable training environments, optimized runtime infrastructure, and standardized deployment templates for AI engineers.
• Collaborate with Data Engineers on feature stores, dataset versioning, and stream/batch data processing workflows.
• Lead the transformation of AI prototypes and notebooks into robust, secure, auto-scaling microservices.
• Work alongside AI Researchers, Data Engineers, and Backend teams to connect experimentation with production systems.
• A minimum of 5 years of practical experience in designing, deploying, and maintaining production ML workloads within cloud environments.
• Extensive, hands-on experience with Google Cloud Platform, including Vertex AI, Cloud Storage, GKE, Cloud Run, and IAM/VPC configurations.
• Proficiency in containerization with Docker and Kubernetes/GKE.
• Advanced knowledge of specialized serving tools such as Triton, vLLM, and MLflow.
• Established track record with Airflow, Vertex AI Pipelines, GitHub Actions, and ArgoCD.
• Strong experience in managing cloud resources using Terraform.
• Skills in Python and SQL for scripting, automation, API development, and data manipulation.
• Practical experience with logging, telemetry, and drift detection tools like Grafana, Prometheus, GCP Cloud Monitoring, or specialized ML observability frameworks.
• Experience with large-scale LLM or deep learning inference/training workloads is a plus.
• Possession of GCP Professional Machine Learning Engineer or GCP Professional Cloud Architect certification is a plus.
• Familiarity with feature stores such as Feast or Vertex AI Feature Store is a plus.
• Opportunity to explore new technologies, products, and markets in a dynamic, growth-oriented environment.
• Collaborate with skilled individuals at an inclusive company where people are valued.
• Individual contributions are recognized, allowing employees to see their impact.
Shield AI
Weekday (YC W21)
Roadpass Digital
Get handpicked remote jobs straight to your inbox weekly.