Senior Data Engineer

This is a fully remote position, open to applicants in Germany, +1 more country.

📋 Description

• Create and justify diagnostic SQL queries utilizing extensive production datasets.

• Develop and sustain ingestion pipelines for bid, win, and impression logs into BigQuery.

• Standardize fields across independently crafted datasets while managing versioned field mappings.

• Construct point-in-time-correct feature tables alongside aggregation pipelines.

• Design and oversee conversion and labeling pipelines, incorporating delayed label handling.

• Take ownership of the data serving write path, schema contracts, publishing workflows, and freshness SLOs.

• Establish experimentation infrastructure, inclusive of traffic splitting and reporting pipelines.

• Execute extensive historical backfills and ensure safe reprocessing following mapping alterations.

• Enforce data isolation and secure aggregation controls to safeguard advertiser data.

• Create automated frameworks for data quality validation.

• Work collaboratively with Customer engineers and generate operational documentation.

• Engage in architecture discussions and contribute to enhancements in platform scalability.

⛳️ Requirements

• Over 5 years of experience in Data Engineering.

• Minimum of 2 years of experience with production ML or large-scale analytics pipelines.

• Proficient SQL skills, including expertise in window functions and incremental processing techniques.

• Strong Python programming skills for developing production-grade pipelines.

• Practical experience with Spark or PySpark.

• Background in designing ETL / ELT pipelines using tools such as Airflow, Cloud Composer, Dagster, or similar.

• Experience working with cloud data warehouses at scale, preferably BigQuery.

• Solid grasp of data modeling and ensuring point-in-time correctness.

• Experience handling event-driven or clickstream datasets on a very large scale.

• Proven experience in supporting mission-critical production pipelines.

• Upper-Intermediate level of English or higher.

🏝️ Benefits

• Opportunity for remote work.

• Chance to work on influential global products.

• Collaboration with seasoned engineers.

• Ability to participate in architectural decision-making.

• Opportunity to enhance expertise in large-scale distributed systems and contemporary data platforms.