Resident Solution Architect, Databricks

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the design and execution of scalable data engineering and analytics solutions utilizing Databricks.

• Collaborate with clients and delivery teams to establish architecture standards, best practices, and technical roadmaps.

• Offer hands-on support for the development, optimization, and deployment of data platforms.

• Lead efforts in performance tuning, scalability enhancements, and cost optimization within cloud and Databricks settings.

• Work alongside engineering teams to implement CI/CD, DevOps, and MLOps best practices.

• Guide technical teams in distributed computing, Spark architecture, and contemporary data platform design.

• Assess new Databricks and cloud capabilities, recommending adoption strategies that align with business objectives.

• Act as a reliable technical advisor and engaged leader for enterprise data and analytics projects.

⛳️ Requirements

• Over 7 years of experience in data engineering, data platforms, and analytics.

• Completed the Databricks Data Engineering Professional certification along with the necessary training curriculum.

• Demonstrated success in delivering 6-8+ significant projects that involve substantial hands-on Databricks development expertise.

• Extensive experience with distributed computing using Apache Spark, including a solid understanding of Spark runtime internals and performance optimization techniques.

• Proficient in designing and deploying solutions across cloud platforms, with deep expertise in AWS, Azure, or GCP, and familiarity with at least one additional cloud ecosystem.

• Knowledge of CI/CD pipelines, production deployment practices, and cloud-native development methodologies.

• Working familiarity with MLOps frameworks, machine learning lifecycle management, and model deployment processes.

• Up-to-date knowledge of Databricks products, platform capabilities, and best practices for scalability, reliability, and governance.

🏝️ Benefits

• Vacation: 12-25 days, depending on grade.

• Company paid holidays.

• Personal Days.

• Sick Leave.

• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).

• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada).

• Life and disability insurance.

• Employee assistance programs.

• Additional benefits as specified by local policies and eligibility.

• Potential for additional compensation such as variable incentives, bonuses, or commissions.