Senior Data Engineer

Posted 6 days ago

This is a fully remote position, open to applicants in Poland.

📋 Description

• Formulate and defend diagnostic SQL queries against extensive production datasets.

• Construct and sustain ingestion pipelines for bid, win, and impression logs into BigQuery.

• Align fields across independently designed datasets and oversee versioned field mappings.

• Create point-in-time-correct feature tables and aggregation pipelines.

• Design and manage conversion and labeling pipelines with delayed label handling.

• Take ownership of the data serving write path, schema contracts, publishing flows, and freshness SLOs.

• Develop experimentation infrastructure that includes traffic splitting and reporting pipelines.

• Execute large-scale historical backfills and safe reprocessing following mapping changes.

• Enforce data isolation and safe-aggregation controls to protect advertiser data.

• Create automated data quality validation frameworks.

• Collaborate closely with Customer engineers and prepare operational documentation.

• Participate in architecture discussions and improvements for platform scalability.


⛳️ Requirements

• Minimum of 5 years of experience in Data Engineering.

• At least 2 years of experience with production ML or large-scale analytics pipelines.

• Advanced SQL proficiency, including window functions and incremental processing patterns.

• Strong Python capabilities for developing production-grade pipelines.

• Practical experience with Spark or PySpark.

• Experience in designing ETL / ELT pipelines with tools like Airflow, Cloud Composer, Dagster, or similar.

• Familiarity with large-scale cloud data warehouses, preferably BigQuery.

• Solid understanding of data modeling and point-in-time accuracy.

• Experience with event-driven or clickstream datasets at a very large scale.

• Proven ability to support business-critical production pipelines.

• Upper-Intermediate English proficiency or higher.

• Strong analytical and problem-solving abilities.

• Ownership-oriented mindset.

• Capacity to work independently in a client-facing setting.

• Excellent communication and documentation skills.

• Comfortable in a fast-paced engineering environment.

• Collaborative and proactive attitude.

• Experience with GCP services such as Dataflow, Pub/Sub, GCS, and Beam.

• Knowledge of building streaming or near-real-time ingestion systems.

• Understanding of feature stores, train/serve skew, and preventing label leakage.

• Background in AdTech or auction-based environments.

• Experience managing delayed or incomplete labels in ML systems.

• Familiarity with dbt or similar transformation frameworks.

• Experience delivering solutions into Customer-owned infrastructure.

• Knowledge of GDPR/CCPA-related privacy engineering practices.

• Experience with experimentation infrastructure and statistical validation pipelines.

• Background working in hybrid cloud/on-prem Linux environments.

• Proficient in Terraform and Kubernetes.

• Experience optimizing warehouse costs and performance.


🏝️ Benefits

• Opportunity to engage in impactful global products.

• Collaboration with skilled engineers.

• Chance to influence architectural decisions.

• Opportunity to enhance expertise in large-scale distributed systems and modern data platforms.

People also viewed

Highmark Health11 hours ago

Data Engineer

US flagUnited States OnlyFull-timeData Engineer$86.4k – $138.6k/year
ApplyView job
Prompt Therapy Solutions Inc11 hours ago

Clinical Technical Support, Data Migration Specialist – B2B SaaS

US flagUnited States OnlyFull-timeData Engineer$65k – $75k/year
ApplyView job
Jones Lang LaSalle Americas, Inc.11 hours ago

Principal Data Engineer

US flagIllinois OnlyFull-timeData Engineer$196k – $235k/year
ApplyView job
Allshore Talent12 hours ago

Data Architect – Adobe Analytics, Customer Journey Analytics

EuropeFreelanceData Engineer
ApplyView job
Airbnb12 hours ago

Senior Data Engineer, Tech Foundations

US flagUnited States OnlyFull-timeData Engineer$196k – $230k/year
ApplyView job
Alight Solutions12 hours ago

Senior Director, Data Engineering & Analytics

US flagUnited States OnlyFull-timeData Engineer$170k – $250k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers