
Lead Consultant – Machine Learning Platform
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in Illinois.
• Act as the technical leader for the architecture of the ML platform, steering system design, scalability, performance, and reliability.
• Design and construct ML platform services, which include training and computing infrastructure, feature stores, model registries, inference runtimes, and data pipelines.
• Lead architectural decisions for distributed systems, cloud-native frameworks, and automated MLOps workflows.
• Assess and incorporate emerging ML platform technologies, tools, and best practices.
• Create and implement MLOps pipelines for experiment tracking, data and model versioning, CI/CD for ML, automated retraining, and model governance.
• Develop automated workflows to ensure reproducible model training, validation, deployment, and lifecycle management.
• Establish monitoring and observability for model performance, data quality, drift detection, and inference reliability.
• Construct and enhance cloud-based ML infrastructure using Kubernetes, containerization, and infrastructure-as-code.
• Develop scalable batch and streaming data pipelines.
• Integrate security, compliance, responsible AI, and cost optimization practices into platform architecture and operations.
• Collaborate with data scientists to build scalable, reusable, and self-service platform capabilities.
• Work alongside security, compliance, and governance teams for safe and compliant AI/ML deployment.
• Partner with application engineering teams to promote the adoption of ML services and facilitate production deployments.
• Offer technical mentorship, establish engineering standards, and contribute to documentation and platform enhancements.
• Extensive experience in ML engineering, platform engineering, or large-scale distributed systems.
• Profound hands-on expertise with MLOps tools, ML frameworks, model deployment methods, and ML lifecycle automation.
• Strong proficiency in Python and backend development for machine learning systems.
• Experience with Azure ML Studio, AWS SageMaker, and/or Google Vertex AI.
• Familiarity with Azure Fabric/OneLake, AWS S3, and Google Cloud Storage (GCS).
• Experience with cloud-native scanning and security tools such as Azure Defender, Microsoft Purview, AWS Security Hub, Amazon Inspector, GCP Security Command Center, or equivalent services.
• Strong understanding of Kubernetes, Docker, CI/CD, Terraform/Infrastructure-as-Code, and associated technologies.
• Solid knowledge of system design, APIs, data pipelines, and scalable ML infrastructure patterns.
• Proven ability to lead technical initiatives and influence engineering decisions across teams.
• 6+ years of progressively related experience.
• Required to undergo a background investigation.
• Must have a dedicated, private workspace that is free from distractions, with appropriate desk and seating, and reliable internet with minimum speeds of 50 MB download and 5 MB upload.
• Allstate generally does not sponsor individuals for employment-based visas for this position.
• Comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse.
• Monthly connectivity reimbursement for eligible employees working from home.
Memory Bridge
Entrada
Find Your Talent (FYT)
Inmetrics
Get handpicked remote jobs straight to your inbox weekly.