Data Engineer – Cloud, SaaS Integrations

This is a fully remote position, open to applicants in Netherlands, +5 more countries.

📋 Description

• Develop new integrations with external billing and usage APIs

• Update existing integrations as vendor APIs and pricing structures evolve

• Minimize the incremental cost associated with future integrations

• Leverage AI throughout the processes of codebase exploration, API research, prototyping, coding, code review, debugging, testing, and documentation

• Take ownership of data quality, addressing issues such as duplication, ingestion, race conditions in reprocessing, marketplace deduplication, and negotiated-rate support

• Create checks and reconciliation processes to ensure data accuracy

• Design and construct normalized models that encompass vendor bills, including metrics such as units, currencies, time granularity, taxonomies, and cost categories

• Manage orchestration, scheduling, and backfill processes for ingestion pipelines

• Ensure that backfills are safe, routine, and available as a self-service option

• Collaborate with product, support, and engineering teams to pinpoint data gaps and suggest enhancements

⛳️ Requirements

• Over 3 years of professional experience in data engineering or a data-intensive backend position, with responsibility for pipelines relied upon by others

• Proficient in SQL, including the ability to reason about performance for complex analytical queries

• Practical experience in building and managing data pipelines using an orchestration framework

• Experience with Dagster or Airflow is highly preferred; equivalent skills with Prefect, dbt, or similar tools are also relevant

• Strong proficiency in Python, or another programming language used effectively for data tasks

• Familiarity with cloud data warehouses or analytical stores such as BigQuery, ClickHouse, Snowflake, Redshift, or similar platforms

• Experience in integrating third-party REST APIs, with knowledge of pagination, rate limits, partial failures, late-arriving data, and data restatement

• Strong intuition for data integrity and reconciliation

• Experience with AI-enhanced workflows and the use of AI tools throughout the engineering process

• Background in developing solutions in the cloud and/or utilizing cloud services

• Exceptional written and verbal communication skills in English

• Highly organized, goal-driven, self-motivated, confident, detail-oriented, and persistent

• A BA/BS degree or equivalent practical experience is considered a bonus, but not mandatory

🏝️ Benefits

• Unlimited Vacation

• Flexible Working Options

• Health Insurance

• Parental Leave

• Employee Stock Option Plan

• Home Office Allowance

• Professional Development Stipend

• Peer Recognition Program

• Flexible schedule that accommodates both work and personal life

• Remote work