Resident Solution Architect – Databricks

This is a fully remote position, open to applicants in United States.

📋 Description

• Act as a reliable technical advisor and proactive leader for enterprise data and analytics projects.

• Oversee the design and execution of scalable data engineering and analytics solutions utilizing Databricks.

• Collaborate with client and delivery teams to establish architecture standards, best practices, and technical roadmaps.

• Offer practical guidance for the development, optimization, and deployment of data platforms in production.

• Enhance performance tuning, scalability, and cost efficiency within cloud and Databricks environments.

• Work alongside engineering teams to implement CI/CD, DevOps, and MLOps best practices.

• Guide technical teams in distributed computing, Spark architecture, and the design of modern data platforms.

• Assess new Databricks and cloud capabilities and propose adoption strategies that align with business objectives.

⛳️ Requirements

• Over 7 years of experience in data engineering, data platforms, and analytics.

• Successfully completed the Databricks Data Engineering Professional certification and necessary training curriculum.

• Demonstrated success in delivering 6–8+ projects with substantial hands-on Databricks development experience.

• Extensive experience in distributed computing using Apache Spark, including knowledge of Spark runtime internals and performance optimization methods.

• Experience in designing and deploying solutions across cloud platforms, with significant expertise in AWS, Azure, or GCP, and a working knowledge of at least one additional cloud ecosystem.

• Understanding of CI/CD pipelines, production deployment practices, and cloud-native development methodologies.

• Familiarity with MLOps frameworks, machine learning lifecycle management, and model deployment processes.

• Up-to-date knowledge of Databricks products, platform capabilities, and best practices for scalability, reliability, and governance.

🏝️ Benefits

• Paid time off: Vacation (12–25 days depending on grade), company-paid holidays, personal days, and sick leave.

• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).

• Retirement savings plans (401(k) in the U.S.; RRSP in Canada).

• Life and disability insurance.

• Employee assistance programs.

• Additional benefits as outlined by local policy and eligibility.

• Possible eligibility for variable incentives, bonuses, or commissions.