Data Engineer – Mid-Level

This is a fully remote position, open to applicants in United Kingdom, +1 more country.

📋 Description

• Design and manage ELT pipelines

• Oversee pipeline performance and ensure data freshness

• Create and maintain configuration-driven pipeline specifications

• Implement workflows on Databricks within a multi-tenant setting

• Enhance the modeling layer

• Aid in CI/CD and data ingestion initiatives

• Partner with data and product teams to provide reliable, thoroughly tested data

• Engage in code review processes

• Assist in the development of platform standards and documentation

⛳️ Requirements

• 3–5 years of experience in data engineering

• Proficient in Python and SQL

• Familiarity with Apache Spark / PySpark

• Capability to monitor, diagnose, and resolve pipeline issues

• Understanding of lakehouse principles

• Experience with Git, Databricks, streaming / CDC, AWS, and Great Expectations

• Knowledge of YAML

• Proven track record of building analytics data models in Spark

🏝️ Benefits

• Autonomy and ownership

• Collaborate with a passionate, knowledgeable, and innovative team

• An inclusive environment that embraces individuals from diverse backgrounds and experiences

• Support for candidates with disabilities and neurodiversity, including adjustments during the recruitment process