Senior Data Engineer

This is a fully remote position, open to applicants in United Kingdom, +2 more countries.

📋 Description

• Develop, maintain, and enhance comprehensive data pipelines using dbt, Python, PySpark, Polars, and SQL.

• Manage and improve AWS data infrastructure, including Glue, Athena, S3, IAM, and associated tools.

• Design and advance Apache Iceberg tables, focusing on schema evolution, partitioning, compaction, and storage optimization.

• Promote data quality, observability, lineage, and monitoring throughout the data platform.

• Convert business and analytical requirements into scalable, maintainable, and high-performance data solutions.

• Collaborate with data scientists, analysts, engineers, and product teams to provide reliable datasets and APIs.

• Contribute to the development of the data mesh by introducing new patterns, enhancements, and architectural improvements.

• Create AI/ML-ready data environments and datasets.

• Document systems, design choices, and processes.

⛳️ Requirements

• Practical experience in data engineering, data infrastructure, or platform roles.

• In-depth knowledge of dbt, Python, and SQL.

• Significant experience with AWS services, including Glue, Athena, S3, IAM, and related tools.

• Proven production experience with Apache Iceberg or comparable table formats/lakehouse technologies.

• Proficient in PySpark and/or Polars for handling large-scale datasets.

• Demonstrated ability to design scalable, modular data architectures.

• Excellent communication skills for conveying complex technical concepts.

• Ability to excel in fast-paced and dynamic environments.

• Confidence in mentoring or guiding junior engineers.

• Experience in building data systems for AI/ML applications.

• Familiarity with pipeline orchestration patterns and best practices.

• Practical exposure to infrastructure-as-code tools such as Terraform or CDK.

• Experience with data cataloging, lineage, or governance tools.

• Experience with real-time or streaming data pipelines.

🏝️ Benefits

• Remote-first approach, with flexibility to accommodate personal needs such as school runs and gym breaks in your schedule.

• Competitive leave package, including paid bonding leaves for new family additions.

• Two paid charitable days off.

• Annual bonus scheme or sales incentive plan.

• Opportunities for international collaboration and networking.

• Human-centered culture that recognizes contributions.

• Access to two learning platforms for ongoing growth.