Databricks Practice Lead

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Oversee the technical strategy and advancement of the Databricks Practice, setting standards, best practices, and reusable solution accelerators.

• Architect and evaluate enterprise-scale data platform designs utilizing Databricks, Apache Spark, and Microsoft Azure.

• Offer technical leadership and architectural insights across various client projects.

• Collaborate with clients to identify business challenges and propose scalable data and analytics solutions.

• Facilitate technical discovery sessions, solution workshops, architecture assessments, and design conversations with clients.

• Guide and mentor Data Engineers, Technical Leads, and Solution Architects, promoting technical excellence and career growth.

• Establish best practices in data engineering, software engineering, DevOps, security, governance, and operational excellence.

• Create standards for ETL/ELT development, ensuring data quality, monitoring, performance enhancement, and production support.

• Promote the adoption of modern data architectures, including Lakehouse, Delta Lake, and event-driven data processing.

• Work alongside Delivery Managers and Engineering Managers to assist with project planning, staffing, technical risk management, and solution quality.

• Engage in pre-sales activities, including solution design, technical proposals, effort estimation, client presentations, and proof-of-concept projects.

• Stay updated on Databricks platform functionalities and emerging technologies, identifying chances to enhance services and broaden practice offerings.

• Advocate for the use of AI-assisted software development and engineering best practices across the practice.

⛳️ Requirements

• Over 8 years of professional experience in Data Engineering, Data Platform Engineering, or related fields.

• More than 3 years of experience leading technical teams, architecture projects, or data engineering practices.

• In-depth expertise with Databricks, including workspace management, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture.

• Strong skills in developing scalable data pipelines using Apache Spark (PySpark).

• Extensive experience with Microsoft Azure, covering services like Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Event Hubs, Azure Key Vault, and Azure DevOps.

• Proficient programming skills in Python, emphasizing clean coding practices and object-oriented programming principles.

• Familiarity with orchestration tools such as Apache Airflow or Dagster.

• Experience with streaming technologies like Apache Kafka or Azure Event Hubs.

• Solid understanding of data architecture, dimensional data modeling, metadata management, and enterprise data platform design.

• Proven experience in implementing data governance, data quality, security, and compliance practices.

• Skilled in building and optimizing enterprise ETL/ELT solutions.

• Strong knowledge of SQL and relational database principles.

• Experience deploying cloud-native data solutions, preferably on the Microsoft Azure platform.

• Excellent consulting, presentation, and stakeholder management skills, with a background in direct interaction with enterprise clients.

• Experience facilitating architecture discussions, technical governance, and solution evaluations.

• Ability to manage multiple initiatives simultaneously while providing technical direction across distributed teams.

• Experience working within Agile development frameworks.

🏝️ Benefits

• 15 days of paid time off (PTO) in the first year, with 3 days accruing each subsequent year.

• 5 days of leave for the passing of immediate family members, negotiable.

• Comprehensive Major Medical Expenses Insurance covering immediate dependents (spouse and children).

• Annual performance bonus approximately 10% of annual salary.

• Annual salary review and adjustment.

• Employee Referral Bonus.

• Funding for paid certifications and courses through a Coursera License.

• 5% Savings Fund.

• 5% Grocery Vouchers.