
Solution Architect, Delivery, Databricks
Posted Nov 11

Posted Nov 11
This is a fully remote position, open to applicants in United States.
• Develop enterprise-level, production-ready Lakehouse solutions utilizing the Databricks Data Intelligence Platform, Medallion Architecture, Delta Lake, and Databricks SQL.
• Design and implement enterprise security and governance frameworks employing Unity Catalog, row/column-level filtering, data masking, ABAC, and Delta Sharing.
• Spearhead the strategy and technical execution of transitioning legacy data warehouses and Hadoop systems to Databricks.
• Identify and establish batch and low-latency streaming patterns using Structured Streaming, Delta Live Tables, Auto Loader, and Apache Spark.
• Guide engineering teams by setting up reference architectures, performing architectural reviews, evaluating pull requests, and standardizing CI/CD pipelines.
• Troubleshoot and resolve Spark and Delta performance issues by optimizing query plans, partitioning, Z-Ordering, caching, and Photon configurations.
• Create compute governance frameworks, cluster policies, auto-termination/autoscaling rules, serverless compute setups, and chargeback/showback tagging models.
• Collaborate with ML and AI engineers to incorporate MLflow, Feature Store, Model Serving, and Vector Search/RAG pipelines.
• Provide guidance to client Chief Architects, Directors of Engineering, and CDOs through technical workshops, design sessions, and POC evaluations.
• Work alongside Databricks Partner Solutions Architects and field engineering teams to align on platform capabilities and best practices.
• Develop reusable architectural templates, reference architectures, migration accelerators, and boilerplate configurations for Infinitive’s intellectual property library.
• Over 8 years of experience in data architecture, data engineering, or enterprise software development.
• A minimum of 3 years of experience designing enterprise solutions focused on Apache Spark and the Databricks Data Intelligence Platform.
• Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional certification is required.
• Strong architectural knowledge in at least one major cloud platform: AWS, Azure, or GCP.
• Familiarity with VPC/VNet networking, private endpoints, cloud IAM/Entra ID integration, and cloud object storage options such as S3, ADLS Gen2, or GCS.
• Expertise in dimensional modeling, Data Vault, and Medallion design methodologies.
• Practical experience implementing Unity Catalog across multi-workspace environments.
• Advanced programming proficiency in Python, PySpark, and SQL.
• Hands-on experience with Terraform and orchestration tools like Databricks Workflows or Airflow.
• Demonstrated success in leading technical delivery teams, converting functional requirements into architectural designs and user stories, and addressing critical delivery challenges.
• Preferred: experience in integrating Databricks with Power BI, Tableau, reverse ETL, dbt, or data observability platforms.
• Preferred: familiarity with HIPAA, HITRUST, SOC2, or FedRAMP-compliant architectures.
• Having an active Public Trust or Secret clearance, or the eligibility to obtain one, is an advantage.
• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance plans.
• Flexible work hours and remote work opportunities.
• Professional development and training programs.
• Generous paid time off and holiday leave.
Ricoh UK
Keenfinity Group
Code Metal
Ramp
Get handpicked remote jobs straight to your inbox weekly.