Senior Machine Learning Engineer – Databricks

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Oversee the production pipelines within Databricks Jobs, linking tasks using depends_on and managing various failure modes (ALL_SUCCESS / ALL_DONE).

• Set up and sustain deployments through Databricks Asset Bundles (DABs), facilitating promotion from development to QA and production targets, along with resource/deployment files for each country.

• Administer the lifecycle of models and artifacts in MLflow and Unity Catalog, encompassing registration, versioning, Champion/Challenger aliases, and rollback procedures.

• Guarantee operational continuity by managing computing resources across workspaces, standardizing cost-monitoring tags (FinOps), and integrating with AIOps/observability solutions.

• Acquire comprehensive knowledge of the product to troubleshoot runtime incidents and collaborate with development teams.

• Take ownership of deployment, job configuration, and the complete operation of AI Factory products across multiple countries.

⛳️ Requirements

• Demonstrated experience in orchestrating data and ML pipelines on Databricks (Jobs, Workflows, cluster policies).

• Strong CI/CD experience (Azure DevOps, gitflow, PRs).

• Proficiency in Infrastructure as code using Databricks Asset Bundles (DABs).

• Adherence to code quality standards: black, isort, mypy.

• Advanced skills in Python.

• Proficient in SQL.

• Familiarity with Delta / Unity Catalog.

• Experience with multi-country schemas, drift/cost monitoring, and deployment automation is a plus.

• Background in developing AI agents or agentic infrastructure (e.g., Mosaic AI Agent Framework, agent orchestration, MCP) is advantageous.

• Residing in Mexico or in a similar time zone that allows for significant overlap with Mexico's working hours is a plus.

🏝️ Benefits

• Embrace a remote-first culture – work from anywhere.

• Full coverage for AWS, DBT, Google Cloud, Azure, and Databricks certifications.

• Enjoy a day off for your birthday plus an additional vacation week (Mutt Week! 🏖️).

• Receive referral bonuses.

• Access to Maslow: Monthly credits to spend in our benefits marketplace.

• Participate in the annual Mutters' Trip – an unforgettable getaway with the team.