Data Platform Architect, Databricks

This is a fully remote position, open to applicants anywhere in the world.

📋 Description

• Collaborate closely with enterprise IT teams to create analytics and data solutions that align with business strategies.

• Establish architectural patterns for data ingestion, transformation, and serving layers.

• Set best practices for Unity Catalog, Delta Lake, and orchestration processes.

• Provide guidance to pod-based delivery teams.

• Define development standards for pipelines, notebooks, and continuous integration/continuous deployment (CI/CD).

• Enhance pipeline performance and cost-effectiveness.

• Integrate Databricks within the Azure ecosystem and with Power BI.

• Implement governance practices utilizing Unity Catalog.

• Create reusable frameworks and templates.

⛳️ Requirements

• Over 10 years of consulting experience.

• More than 3 years of significant experience with Databricks (including Spark, Delta Lake, notebooks, and pipelines).

• Familiarity with Unity Catalog and governance models.

• Experience with Azure Data Lake and data transformation frameworks.

• Proven track record in designing enterprise-scale data platforms.

• Experience in optimizing large-scale pipelines and distributed systems.

• Leadership experience in global, matrixed environments.

• Valid Databricks certification.

🏝️ Benefits

• Competitive salary.

• Flexible working hours.

• Professional development budget.

• Home office setup allowance.

• Global team events.