Senior Python Developer – Databricks AI Platform, Alerting & Monitoring

This is a fully remote position, open to applicants in India.

📋 Description

• Automation & AI Integration with Databricks: Develop Python-based workflows for MLOps, LLMOps, and application deployment within Databricks. Improve workspace onboarding by incorporating Unity Catalog, permissions, and environment setup utilizing reusable Python modules. Seamlessly integrate Mosaic AI components (Gateway, Model Serving, Agents) into platform automation. Assist with Delta Lake (Bronze/Silver/Gold) architecture and the MLflow model lifecycles.

• Alerting & Monitoring through Python: Set up automated health checks for AWS resources and Databricks applications. Create and configure alerting systems using AWS CloudWatch, SNS, and EventBridge. Develop Python automations to ensure configuration consistency across various AWS accounts and identify anomalies or misconfigurations. Establish automated service request workflows that connect alerting with ticketing systems (Slack, Jira, etc.).

⛳️ Requirements

• Mastery of Python (6+ Years): Comprehensive knowledge of Python internals, including GIL behavior, multiprocessing versus multithreading, and memory overhead trade-offs.

• Familiarity with the Databricks Ecosystem: Practical experience with Unity Catalog, MLflow, and Mosaic AI.

• Proficiency in AWS Automation: Strong skills in AWS Lambda, API Gateway, CloudWatch, and EventBridge.

• Experience in Reliability Engineering: Knowledge of Docker image immutability, automated rollback strategies, and production stability patterns.

• Understanding of Authentication: Experience with Service Principal-based authentication for secure bridging between Databricks and AWS.

• Ideal Candidate Profile: Over 6 years of professional experience in Python development and cloud automation. A dual mindset: passionate about building new AI capabilities while equally focused on proactive monitoring and achieving 99.9% uptime. Capability to work independently in a remote, global setting. Immediate availability is highly preferred.

🏝️ Benefits

• Ecosystem of Opportunity: Join a network where client engagements, thought leadership, and mentorship paths are interconnected.

• Outcome-Focused Culture: We prioritize smart execution, autonomy, and ownership over "hours at a desk."

• Leading Edge: Participate in projects that shape the future of AI and large-scale cloud infrastructure.