Senior Data Engineer

This is a fully remote position, open to applicants in Germany, +1 more country.

📋 Description

• Create and justify diagnostic SQL queries for extensive production datasets.

• Develop and sustain ingestion pipelines for bid, win, and impression logs into BigQuery.

• Standardize fields across independently created datasets and manage versioned field mappings.

• Build point-in-time-correct feature tables and aggregation pipelines.

• Design and oversee conversion and labeling pipelines, including mechanisms for delayed label handling.

• Take ownership of the data serving write path, schema agreements, publishing workflows, and freshness service level objectives (SLOs).

• Construct experimentation infrastructure featuring traffic splitting and reporting pipelines.

• Execute large-scale historical backfills and ensure safe reprocessing following mapping alterations.

• Enforce data isolation and safe-aggregation controls for the protection of advertiser data.

• Create automated frameworks for data quality validation.

• Work closely with Customer engineers and draft operational documentation.

• Participate in architecture discussions and enhancements for platform scalability.

⛳️ Requirements

• A minimum of 5 years of experience in Data Engineering.

• At least 2 years of experience with production machine learning or large-scale analytics pipelines.

• Advanced SQL expertise, including window functions and incremental processing techniques.

• Proficient Python skills for the development of production-grade pipelines.

• Practical experience with Spark or PySpark.

• Experience in designing ETL/ELT pipelines using tools such as Airflow, Cloud Composer, Dagster, or similar.

• Experience with cloud data warehouses at scale, preferably BigQuery.

• Strong grasp of data modeling and point-in-time correctness.

• Experience with event-driven or clickstream datasets at a very large scale.

• Proven experience supporting business-critical production pipelines.

• Upper-intermediate level of English or higher.

🏝️ Benefits

• Employees have the flexibility to work remotely.

• Opportunity to engage with impactful global products.

• Collaborate alongside experienced engineers.

• Chance to influence architectural decisions.

• Opportunity to enhance expertise in large-scale distributed systems and modern data platforms.