Databricks Architect

atv4c.aiRemoteUS flagUnited StatesFull-timeArchitectSeniorLead$170k – $220k/year

Posted 4 days ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the target-state Lakehouse architecture for enterprise projects, encompassing ingestion, storage, transformation, serving, and governance layers.

• Lead assessments of existing architectures and develop migration strategies that consider sequencing, risks, and resource efforts.

• Establish data modeling standards and Medallion layer conventions, ensuring engineering teams adhere to these across multiple workstreams.

• Develop the governance framework for Unity Catalog, detailing catalogs, schemas, access patterns, lineage, and audit posture.

• Analyze and document platform trade-offs related to compute sizing, storage formats, streaming versus batch processing, and build versus buy decisions, providing rationale based on cost and performance.

• Offer technical insights for scoping and estimating efforts on new projects, including pre-sales exploration and proof-of-concept designs.

• Mentor senior engineers, review design proposals, and elevate the architectural standards across the organization.

• Create reference architectures, diagrams, and internal accelerators.


⛳️ Requirements

• A minimum of 8 years in data engineering/architecture or development of analytics platforms.

• Proven experience in managing end-to-end architecture for at least two enterprise-scale data platforms, from initial design to production deployment.

• Extensive experience in migrating legacy data warehouses or ETL systems to modern cloud platforms (such as Teradata, Informatica, Hadoop, Netezza, or equivalent).

• Strong expertise in Python and SQL.

• Familiarity with Apache Spark and basic principles of distributed processing.

• Experience in data modeling across dimensional, normalized, and Lakehouse architectures.

• Proficient in CI/CD and DevOps practices for deploying data platforms.

• Experience in healthcare or life sciences is preferred but not mandatory.

• Databricks Certified Data Engineer Professional or Platform Architect certification is preferred.

• Hands-on experience with Databricks at scale, including Unity Catalog, Delta Lake, Lakeflow, and Asset Bundles is preferred.

• Familiarity with MLOps or operationalizing machine learning workloads is preferred.

• Background in professional services, consulting, or customer-facing architecture is preferred.

• Experience contributing to pre-sales scoping or technical proposals is preferred.


🏝️ Benefits

• Unlimited PTO

• Health Care Plan (Medical, Dental & Vision)

• Retirement Plan (401k, IRA)

• Life Insurance (Basic, Voluntary & AD&D)

• Family Leave (Maternity, Paternity)

• Short Term & Long Term Disability

• Training & Development

• Work from Home 3 days per week

• Databricks certification roadmap taught in-house by Databricks-approved trainers

• Dedicated Employee Success Manager

People also viewed

Salesforce10 hours ago

Experience Architect

BR flagBrazil OnlyFull-timeArchitect
ApplyView job
WRA, Inc.11 hours ago

Landscape Architect

US flagCalifornia, +1 more stateFull-timeArchitect$105k – $140k/year
ApplyView job
Akamai Technologies12 hours ago

Senior Technical Enablement Architect

CR flagCosta Rica OnlyFull-timeArchitect
ApplyView job
Polaris Inc.12 hours ago

Application Architect

US flagMinnesota OnlyFull-timeArchitect$150k – $175k/year
ApplyView job
Weekday (YC W21)12 hours ago

Business Architect

IN flagIndia OnlyFull-timeArchitect₹1.5M – ₹2.8M/year
ApplyView job
VSP Vision Care13 hours ago

Principal Architect

US flagUnited States OnlyFull-timeArchitect
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers