Databricks Solution Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead the design and execution of scalable, secure, and high-performance data architecture utilizing Databricks.

• Define complete data pipelines (ingestion, transformation, serving) leveraging Spark and Delta Lake technologies.

• Drive initiatives for migration and modernization from legacy systems to Databricks.

• Establish best practices in data engineering, performance enhancement, and cost management.

• Design and implement frameworks for data governance, security, and compliance.

• Collaborate with business stakeholders, data scientists, and engineering teams to convert requirements into technical solutions.

• Provide technical leadership, mentorship, and direction to development teams.

• Ensure data quality, reconciliation, and reliability throughout data workflows.

• Integrate Databricks with enterprise tools (e.g., MuleSoft, Alteryx, BI/reporting platforms).

• Stay updated with Databricks innovations and advocate for the adoption of new capabilities (e.g., ML, AI, DBSQL, Unity Catalog).

⛳️ Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline.

• 9-12+ years of experience in data engineering, data architecture, or analytics platforms.

• Strong practical knowledge of Databricks, Apache Spark, and Delta Lake.

• Experience with cloud platforms such as Azure (preferred), AWS, or GCP.

• Proven ability to design and implement scalable data pipelines and architectures.

• Proficient in SQL, Python, and/or Scala.

• Familiarity with data integration tools (e.g., MuleSoft, Alteryx) and contemporary data ecosystems.

• Understanding of data governance, security frameworks, and compliance best practices.

• Experience in performance tuning, optimization, and cost management within Databricks.

• Strong problem-solving capabilities and the ability to thrive in a cross-functional, collaborative setting.

• Excellent communication and stakeholder management abilities.

• Exposure to AI/ML use cases, Databricks SQL, and Unity Catalog is advantageous.

🏝️ Benefits

• Competitive salary and comprehensive benefits package.

• Opportunities for professional development and continuous learning.

• Dynamic and inclusive work environment.

• Flexible work arrangements to promote work-life balance.