
Databricks Architect
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in United States.
• Take ownership of the target-state Lakehouse architecture for enterprise projects, encompassing ingestion, storage, transformation, serving, and governance layers.
• Lead assessments of existing architectures and develop migration strategies that consider sequencing, risks, and resource efforts.
• Establish data modeling standards and Medallion layer conventions, ensuring engineering teams adhere to these across multiple workstreams.
• Develop the governance framework for Unity Catalog, detailing catalogs, schemas, access patterns, lineage, and audit posture.
• Analyze and document platform trade-offs related to compute sizing, storage formats, streaming versus batch processing, and build versus buy decisions, providing rationale based on cost and performance.
• Offer technical insights for scoping and estimating efforts on new projects, including pre-sales exploration and proof-of-concept designs.
• Mentor senior engineers, review design proposals, and elevate the architectural standards across the organization.
• Create reference architectures, diagrams, and internal accelerators.
• A minimum of 8 years in data engineering/architecture or development of analytics platforms.
• Proven experience in managing end-to-end architecture for at least two enterprise-scale data platforms, from initial design to production deployment.
• Extensive experience in migrating legacy data warehouses or ETL systems to modern cloud platforms (such as Teradata, Informatica, Hadoop, Netezza, or equivalent).
• Strong expertise in Python and SQL.
• Familiarity with Apache Spark and basic principles of distributed processing.
• Experience in data modeling across dimensional, normalized, and Lakehouse architectures.
• Proficient in CI/CD and DevOps practices for deploying data platforms.
• Experience in healthcare or life sciences is preferred but not mandatory.
• Databricks Certified Data Engineer Professional or Platform Architect certification is preferred.
• Hands-on experience with Databricks at scale, including Unity Catalog, Delta Lake, Lakeflow, and Asset Bundles is preferred.
• Familiarity with MLOps or operationalizing machine learning workloads is preferred.
• Background in professional services, consulting, or customer-facing architecture is preferred.
• Experience contributing to pre-sales scoping or technical proposals is preferred.
• Unlimited PTO
• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA)
• Life Insurance (Basic, Voluntary & AD&D)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Training & Development
• Work from Home 3 days per week
• Databricks certification roadmap taught in-house by Databricks-approved trainers
• Dedicated Employee Success Manager
WRA, Inc.
Akamai Technologies
Polaris Inc.
Get handpicked remote jobs straight to your inbox weekly.