This is a fully remote position, open to applicants in California.

• Oversee the design and execution of cutting-edge data platforms utilizing AWS and Databricks

• Design scalable, secure, and high-performance data pipelines

• Lead initiatives for cloud migration from Azure to AWS

• Work collaboratively with business stakeholders, architects, and engineering teams to establish data strategies

• Mentor and support data engineers while promoting adherence to best practices

• Enhance ETL/ELT processes, data models, and data lake architectures

• Ensure the integrity, governance, security, and performance of data across the platform

• Contribute to Agile delivery and engage in technical planning and solution design

• 8+ years of experience in Data Engineering, Data Architecture, or similar fields

• Bachelor's degree in Computer Science, Information Technology, Software Engineering, Data Science, or a related technical discipline

• Strong practical experience with AWS data services

• Extensive knowledge of Databricks, Apache Spark, and Delta Lake

• Experience in performance testing and optimization of data pipelines, Databricks workloads, Spark jobs, and data platforms

• Proven ability to establish performance benchmarks, SLAs, KPIs, and capacity planning for enterprise data platforms

• Proficient in SQL and Python

• Experience in designing and implementing enterprise-scale data pipelines

• Deep understanding of data warehousing, data lakes, and contemporary data architectures

• Exceptional leadership, communication, and stakeholder management abilities

• Familiarity with Microsoft Azure data services is highly advantageous

• Previous experience leading migrations from Azure to AWS

• Knowledge of CI/CD, Infrastructure as Code (IaC), and DevOps principles

• Experience with Apache Airflow or AWS Step Functions

• AWS and/or Databricks certifications are considered a plus

• Experience in large enterprise environments

• Understanding of data governance, data security, and compliance best practices

• Competitive salary and performance-based bonuses

• Comprehensive health, dental, and vision insurance

• Retirement savings plan with company matching

• Opportunities for professional development and continuous learning

• Flexible work hours and remote work options

• Supportive and inclusive workplace culture

Data Lead

People also viewed