
Senior Data Engineer
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in Poland.
• Formulate and defend diagnostic SQL queries against extensive production datasets.
• Construct and sustain ingestion pipelines for bid, win, and impression logs into BigQuery.
• Align fields across independently designed datasets and oversee versioned field mappings.
• Create point-in-time-correct feature tables and aggregation pipelines.
• Design and manage conversion and labeling pipelines with delayed label handling.
• Take ownership of the data serving write path, schema contracts, publishing flows, and freshness SLOs.
• Develop experimentation infrastructure that includes traffic splitting and reporting pipelines.
• Execute large-scale historical backfills and safe reprocessing following mapping changes.
• Enforce data isolation and safe-aggregation controls to protect advertiser data.
• Create automated data quality validation frameworks.
• Collaborate closely with Customer engineers and prepare operational documentation.
• Participate in architecture discussions and improvements for platform scalability.
• Minimum of 5 years of experience in Data Engineering.
• At least 2 years of experience with production ML or large-scale analytics pipelines.
• Advanced SQL proficiency, including window functions and incremental processing patterns.
• Strong Python capabilities for developing production-grade pipelines.
• Practical experience with Spark or PySpark.
• Experience in designing ETL / ELT pipelines with tools like Airflow, Cloud Composer, Dagster, or similar.
• Familiarity with large-scale cloud data warehouses, preferably BigQuery.
• Solid understanding of data modeling and point-in-time accuracy.
• Experience with event-driven or clickstream datasets at a very large scale.
• Proven ability to support business-critical production pipelines.
• Upper-Intermediate English proficiency or higher.
• Strong analytical and problem-solving abilities.
• Ownership-oriented mindset.
• Capacity to work independently in a client-facing setting.
• Excellent communication and documentation skills.
• Comfortable in a fast-paced engineering environment.
• Collaborative and proactive attitude.
• Experience with GCP services such as Dataflow, Pub/Sub, GCS, and Beam.
• Knowledge of building streaming or near-real-time ingestion systems.
• Understanding of feature stores, train/serve skew, and preventing label leakage.
• Background in AdTech or auction-based environments.
• Experience managing delayed or incomplete labels in ML systems.
• Familiarity with dbt or similar transformation frameworks.
• Experience delivering solutions into Customer-owned infrastructure.
• Knowledge of GDPR/CCPA-related privacy engineering practices.
• Experience with experimentation infrastructure and statistical validation pipelines.
• Background working in hybrid cloud/on-prem Linux environments.
• Proficient in Terraform and Kubernetes.
• Experience optimizing warehouse costs and performance.
• Opportunity to engage in impactful global products.
• Collaboration with skilled engineers.
• Chance to influence architectural decisions.
• Opportunity to enhance expertise in large-scale distributed systems and modern data platforms.
Highmark Health
Prompt Therapy Solutions Inc
Jones Lang LaSalle Americas, Inc.
Allshore Talent
Get handpicked remote jobs straight to your inbox weekly.