Senior Data Engineer

This is a fully remote position, open to applicants in Latvia.

📋 Description

• Develop and scale the data infrastructure that drives a business intelligence platform.

• Design, maintain, and optimize pipelines that handle billions of ad server, CRM, and related data events.

• Ingest and standardize data from SSPs, DSPs, ad servers like GAM, and third-party reporting APIs.

• Create ETL/ELT workflows to convert raw data into datasets ready for analytics.

• Construct data models aimed at enhancing campaign performance, analyzing supply, managing supply allocations, and maximizing profits.

• Build and maintain data warehouses and data lakes that are tailored for ad-tech query patterns.

• Implement data quality monitoring, validation, and anomaly detection across data streams.

• Provide clean, documented, and performant data infrastructure to support Executive, BI, and analytics teams.

• Ensure compliance with GDPR and CCPA in the processes of data collection, storage, and handling.

• Enable real-time analytics and dashboards for both internal and external clients to refine campaigns, oversee workflows, and promote efficiency and growth.

⛳️ Requirements

• Over 5 years of professional experience in data engineering.

• A minimum of 2 years of experience working with programmatic advertising and ad-tech data (GAM).

• Strong expertise in Python and SQL.

• Practical experience with data warehouses such as BigQuery, Snowflake, Redshift, and ClickHouse.

• Familiarity with batch processing frameworks like Spark, dbt, and Airflow.

• Understanding of ad-tech data structures including bid requests, impressions, OpenRTB schemas, and log-level data.

• Experience with cloud services such as AWS and GCP.

• Proficiency with infrastructure-as-code.

• Availability to work partial US hours, specifically until 2 PM ET.

• Knowledge of SSP reporting APIs and log-level data, covering platforms like Magnite, PubMatic, Index Exchange, and Xandr.

• Experience with Google Ad Manager reporting, Data Transfer files, and BigQuery exports.

• Understanding of ad-tech revenue metrics such as CPM, eCPM, RPM, fill rate, win rate, and bid density.

• Familiarity with auction analytics, including bid landscape, floor optimization, and timeout analysis.

• Knowledge of demand partner performance metrics: SSP/bidder scoring, latency analysis, viewability metrics, reach/frequency, and IVT.

• Understanding of supply chain data, including ads.txt validation, sellers.json mapping, and SPO analysis.

• Experience with the specified technical stack: Python, SQL, Apache Spark, dbt, Apache Flink, BigQuery, Snowflake, ClickHouse, Redshift, Airflow, Dagster, Prefect, S3, GCS, Delta Lake, Parquet, AWS, GCP, Terraform, and Kubernetes.

• Scala knowledge is a plus.

• Experience with ML feature engineering for bid optimization or yield prediction is a nice-to-have.

• Background in developing data products for publisher-side monetization is advantageous.

• Familiarity with privacy-preserving data techniques is beneficial.

• Experience with CTV/OTT advertising data and video ad metrics is a plus.

• Knowledge of identity resolution and cross-device data issues is an added advantage.

🏝️ Benefits

• Security through client vetting to reduce risks and ensure dependable, timely payments.

• Career support and guidance in locating new project opportunities.

• Legal assistance concerning independent contractor or sole proprietorship status, taxes, and related processes.

• Access to English language courses.

• Opportunities for professional growth.

• Team-building events.

• Flexible working hours.

• 29 days of paid time off (18 working days per year plus all national holidays).

• 10 paid recovery days.

• Comprehensive financial and legal support for independent contractors.

• Complimentary English classes with native speakers or Ukrainian instructors.

• Dedicated HR support.