Senior Data Engineer – Ingestion, Platform

This is a fully remote position, open to applicants in Europe.

📋 Description

• Create and develop ingestion pipelines utilizing REST APIs, database sources, and more, using Python.

• Take full responsibility for the end-to-end ETL and Reverse ETL processes, encompassing implementation, deployment, operations, and incident management.

• Gain an understanding of external systems (such as casino platforms, ESPs, and affiliate tools) to establish reliable integrations.

• Design DAG patterns focusing on dependency management, partial retries, and backfill procedures.

• Implement and uphold authentication flows, manage token refreshes, and oversee secrets management.

• Monitor, diagnose, and resolve integration challenges in production environments.

• Develop and maintain automated tests to ensure the reliability and stability of integration services.

• Work collaboratively with Engineering, Product, and Data teams to enhance platform scalability and operational effectiveness.

• Contribute to enhancements in infrastructure and Infrastructure-as-Code projects.

• Document significant design decisions through Architecture Decision Records (ADRs).

⛳️ Requirements

• Over 6 years of experience in data engineering.

• Proficient in advanced Python: including API clients, file processing, schema validation, and integration logic.

• Extensive experience with Airflow: including DAG design, dynamic generation, sensors, retry patterns, backfills, pools, and connection management.

• Proficient with dbt (mid+): including bronze/silver models, source freshness, tests, and materialization strategies.

• Mid-level experience with Snowflake: covering external stages, COPY INTO, storage integration, and basic optimization.

• Experience with API integrations: including authentication (OAuth, API keys), pagination, rate limiting, retries with backoff, and error classification.

• Proven track record in developing reusable pipeline frameworks/templates for daily use by others.

• Experience in Reverse ETL or outbound integrations: pushing data from the warehouse to external systems.

• Capable of writing clear documentation, including architecture decisions, pipeline templates, and onboarding guides for team members.

• Experience in designing CI/CD pipelines (GitHub Actions).

• Nice to have: Basic knowledge of Terraform.

• Experience in metadata-driven or config-driven pipelines.

• Familiarity with ESP platforms (e.g., DotDigital, SendGrid, Braze, or similar).

• Experience in gambling, marketing, or multi-tenant data platforms.

• Comfortable utilizing AI coding assistants.

🏝️ Benefits

• Competitive salary.

• Fully remote work opportunities across Europe.

• Flexible collaboration hours promoting a strong work-life balance.

• Chance to work on scalable, mission-critical systems and integrations.

• A collaborative culture that emphasizes ownership, innovation, and continuous improvement.