Digital Consulting, Databricks Technical Architect – Manager

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Set up and configure Databricks environments from start to finish

• Design and implement medallion (bronze/silver/gold) data pipelines

• Establish infrastructure-as-code and CI/CD foundations utilizing Databricks Asset Bundles, Terraform, and GitHub Actions or Azure DevOps

• Develop applied AI solutions using Mosaic AI

• Enhance Delta Lake performance and design for scalability, reliability, and cost-effectiveness

• Integrate Databricks with the larger enterprise ecosystem through Lakehouse Federation, Delta Sharing, and more

• Collaborate with functional teams and MDM/data governance leaders

• Document and convey architectural decisions

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field

• Minimum of 4 years of practical experience with Databricks

• Databricks Certified Data Engineer Professional or Machine Learning Professional (mandatory)

• Extensive hands-on knowledge of Delta Lake, Unity Catalog, Delta Live Tables / Lakeflow, Structured Streaming, and Databricks Workflows

• Practical experience with Mosaic AI (Agent Framework, Vector Search, Model Serving)

• Proficient in Python, SQL, and PySpark; familiarity with Scala is an advantage

• Experience with infrastructure-as-code (Terraform, Databricks Asset Bundles) and CI/CD for data platforms

• Knowledge of Lakehouse Federation, Delta Sharing, and interoperability patterns with Salesforce Data Cloud, Snowflake, or Microsoft Fabric

• Experience with MDM, data quality, or data governance workflows is a plus

• Strong communication, collaboration, and problem-solving abilities

🏝️ Benefits

• Medical, dental, and vision coverage

• Wellness programs

• 401(k) plan with a generous employer match

• Employee stock purchase plan

• Generous Paid Time Off policy

• Paid parental leave and adoption assistance