Staff Data Engineer – Databricks

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Design and create highly scalable, dependable, and fault-tolerant data pipelines and platforms.

• Lead the architectural approach for data ingestion, transformation, and storage.

• Develop and enhance core data pipelines utilizing SQL, Python, Apache Spark, and cloud-native services.

• Mentor and guide data engineers.

• Offer technical direction and promote best practices, code quality, and professional development.

• Collaborate with data scientists, analysts, and product managers to convert business needs into data solutions.

• Implement monitoring, alerting, and logging for data systems.

• Detect and resolve performance bottlenecks and system failures.

• Spearhead the adoption of new data engineering tools and methodologies.

• Set and uphold data quality standards and governance practices.

⛳️ Requirements

• Over 7 years of practical experience in data engineering or a related field.

• Demonstrated success in designing and implementing large-scale data systems.

• Proficient in Python.

• Strong expertise in SQL.

• Extensive experience with at least one major cloud provider's data ecosystem.

• Experience with Azure and Databricks is mandatory.

• Solid understanding of data warehousing concepts, ETL/ELT principles, and modern data lake architectures.

• Proven capability to design and construct scalable and resilient data systems from the ground up.

• Exceptional communication, collaboration, and problem-solving abilities.

• Experience with Infrastructure as Code, such as Terraform, is preferred.

• Experience with CI/CD pipelines is preferred.

• Familiarity with streaming technologies like Kafka or Kinesis is preferred.

• Knowledge of healthcare data and healthcare insurance feeds is a plus.

• Bachelor’s degree in Computer Science or Engineering.

🏝️ Benefits

• Comprehensive benefits package.

• Medical coverage.

• Dental coverage.

• Vision coverage.

• Paid time off.

• Retirement savings options.

• Wellness programs.

• Additional resources supporting physical, emotional, and financial well-being.

• CVS Health bonus, commission, or short-term incentive program.

• Equity award program.