Solution Architect, Delivery, Databricks

atInfinitiveRemoteUS flagUnited StatesFull-timeSolutions EngineerSeniorLead$140k – $210k/year

Posted Nov 11

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop enterprise-level, production-ready Lakehouse solutions utilizing the Databricks Data Intelligence Platform, Medallion Architecture, Delta Lake, and Databricks SQL.

• Design and implement enterprise security and governance frameworks employing Unity Catalog, row/column-level filtering, data masking, ABAC, and Delta Sharing.

• Spearhead the strategy and technical execution of transitioning legacy data warehouses and Hadoop systems to Databricks.

• Identify and establish batch and low-latency streaming patterns using Structured Streaming, Delta Live Tables, Auto Loader, and Apache Spark.

• Guide engineering teams by setting up reference architectures, performing architectural reviews, evaluating pull requests, and standardizing CI/CD pipelines.

• Troubleshoot and resolve Spark and Delta performance issues by optimizing query plans, partitioning, Z-Ordering, caching, and Photon configurations.

• Create compute governance frameworks, cluster policies, auto-termination/autoscaling rules, serverless compute setups, and chargeback/showback tagging models.

• Collaborate with ML and AI engineers to incorporate MLflow, Feature Store, Model Serving, and Vector Search/RAG pipelines.

• Provide guidance to client Chief Architects, Directors of Engineering, and CDOs through technical workshops, design sessions, and POC evaluations.

• Work alongside Databricks Partner Solutions Architects and field engineering teams to align on platform capabilities and best practices.

• Develop reusable architectural templates, reference architectures, migration accelerators, and boilerplate configurations for Infinitive’s intellectual property library.


⛳️ Requirements

• Over 8 years of experience in data architecture, data engineering, or enterprise software development.

• A minimum of 3 years of experience designing enterprise solutions focused on Apache Spark and the Databricks Data Intelligence Platform.

• Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional certification is required.

• Strong architectural knowledge in at least one major cloud platform: AWS, Azure, or GCP.

• Familiarity with VPC/VNet networking, private endpoints, cloud IAM/Entra ID integration, and cloud object storage options such as S3, ADLS Gen2, or GCS.

• Expertise in dimensional modeling, Data Vault, and Medallion design methodologies.

• Practical experience implementing Unity Catalog across multi-workspace environments.

• Advanced programming proficiency in Python, PySpark, and SQL.

• Hands-on experience with Terraform and orchestration tools like Databricks Workflows or Airflow.

• Demonstrated success in leading technical delivery teams, converting functional requirements into architectural designs and user stories, and addressing critical delivery challenges.

• Preferred: experience in integrating Databricks with Power BI, Tableau, reverse ETL, dbt, or data observability platforms.

• Preferred: familiarity with HIPAA, HITRUST, SOC2, or FedRAMP-compliant architectures.

• Having an active Public Trust or Secret clearance, or the eligibility to obtain one, is an advantage.


🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance plans.

• Flexible work hours and remote work opportunities.

• Professional development and training programs.

• Generous paid time off and holiday leave.

People also viewed

Ricoh UK8 hours ago

Senior Solutions Engineer

US flagUnited States OnlyFull-timeSolutions Engineer$80.3k – $85k/year
ApplyView job
Keenfinity Group8 hours ago

Technical Solutions Engineer

US flagNew York OnlyFull-timeSolutions Engineer$100k – $115k/year
ApplyView job
Code Metal8 hours ago

Solutions Architect, Financial Services

US flagUnited States OnlyFull-timeSolutions Engineer$214k – $290k/year
ApplyView job
Ramp8 hours ago

Solutions Consultant, Post Sales, Strategic

US flagUnited States OnlyFull-timeSolutions Engineer
ApplyView job
Temporal Technologies8 hours ago

Staff Solutions Architect, Digital Native

US flagUnited States OnlyFull-timeSolutions Engineer$168k – $220k/year
ApplyView job
Wavestone8 hours ago

Senior AI Solutions Consultant

RO flagRomania OnlyFull-timeSolutions Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers