Databricks Solution Architect

This is a fully remote position, open to applicants in Colorado, +6 more states.

📋 Description

• Oversee the design and execution of Databricks solution architectures that facilitate data engineering, analytics, AI/ML, and the delivery of governed data products.

• Manage Databricks workspaces, including account-level settings, workspace configurations, user management, groups, service principals, permissions, secrets, jobs, and platform objects.

• Create and oversee Unity Catalog structures, which encompass metastores, catalogs, schemas, external locations, storage credentials, access controls, lineage, and metadata standards.

• Establish compute, cluster policy, SQL warehouse, job orchestration, runtime, and workload management strategies that effectively balance performance, cost, security, and delivery requirements.

• Convert business, technical, security, and governance requirements into Databricks-native architectural patterns, implementation strategies, technical architecture documentation, and platform standards.

• Collaborate with cloud, cybersecurity, identity management, networking, and DevOps teams to ensure secure platform integration across Azure, AWS, or GCP environments.

• Generate reusable architectural guidance, reference implementations, deployment patterns, and operational playbooks for both Databricks platform teams and delivery teams.

• Diagnose platform issues concerning permissions, compute performance, job execution, storage access, networking, workspace configuration, and production operations.

• Counsel clients on platform governance, cost management, auditability, release management, environment strategy, and separation of duties to facilitate enterprise Databricks adoption.

• Support delivery teams with technical leadership, architecture assessments, code and configuration reviews, documentation, and communication with stakeholders.

⛳️ Requirements

• Bachelor’s degree in computer science, engineering, or a related field.

• 5-10 years of pertinent experience in data architecture, cloud data platforms, data engineering, platform engineering, or technical solution delivery.

• Practical experience in designing, implementing, or managing Databricks environments, including workspaces, jobs, clusters, SQL warehouses, notebooks, repos, and platform configurations.

• Proficient in SQL, Python, and Spark-based development for data engineering, automation, and platform operations.

• Extensive experience with Unity Catalog, focusing on access controls, catalogs, schemas, external locations, storage credentials, lineage, and organized governed data.

• Familiarity with cloud platforms such as Azure, AWS, or GCP, including considerations related to identity, networking, storage, security, and deployment for cloud-native data platforms.

• Experience in creating architecture artifacts, technical designs, platform standards, implementation roadmaps, and operational documentation for both technical and non-technical audiences.

• Capability to lead technical discussions with clients, assess trade-offs, communicate architectural decisions, and operate effectively in consulting or project-based environments.

• Knowledge of data governance, DevOps, CI/CD, infrastructure automation, monitoring, cost management, and secure software delivery practices.

🏝️ Benefits

• Competitive compensation

• Flexible benefits package