Data Engineer – Cloud & SaaS Integrations

This is a fully remote position, open to applicants in United Kingdom, +5 more countries.

📋 Description

• Develop new integrations with third-party billing and usage APIs.

• Manage existing integrations as vendors update their APIs and pricing structures.

• Lower the marginal cost associated with additional integrations.

• Leverage AI on a daily basis to investigate codebases and APIs, prototype, generate and review code, debug, write tests, and create documentation.

• Take ownership of data quality, addressing issues such as duplication, gaps, race conditions, deduplication, and negotiated-rate support.

• Create checks and reconciliation processes to ensure data accuracy.

• Design and implement normalization models across vendor invoices, units, currencies, time granularity, taxonomies, and cost categories.

• Manage orchestration, scheduling, and backfill mechanics for ingestion pipelines from start to finish.

• Ensure that backfills are safe, routine, and self-service.

• Collaborate with product, support, and engineering teams to utilize data for identifying and resolving gaps.

• Actively suggest improvements rather than simply waiting for specifications.

⛳️ Requirements

• Over 3 years of professional experience in data engineering or a data-intensive backend role, with production ownership of pipelines relied upon by others.

• Proficient in SQL, including the ability to write, read, and analyze the performance of complex analytical queries.

• Practical experience in building and managing data pipelines using an orchestration framework.

• Experience with Dagster or Airflow is highly preferred; relevant experience with Prefect, dbt, or a similar tool is acceptable if willing to work with Dagster/Airflow.

• Strong skills in Python or another language used fluently for data-related tasks.

• Familiarity with cloud data warehouses or analytical stores such as BigQuery, ClickHouse, Snowflake, Redshift, or similar platforms.

• Experience in integrating third-party REST APIs, including handling pagination, rate limits, partial failures, late-arriving and restated data, and inaccurate vendor documentation.

• A strong intuition for data accuracy, including reconciling totals and creating assertions.

• An AI-augmented approach to work, utilizing AI tools throughout the engineering workflow.

• Experience in developing solutions in the cloud and/or utilizing cloud services.

• Exceptional communication skills in English, both written and verbal.

• Self-organized, goal-oriented, self-motivated, confident, diligent, and persistent.

🏝️ Benefits

• Unlimited Vacation.

• Flexible Working Options.

• Health Insurance.

• Parental Leave.

• Employee Stock Option Plan.

• Home Office Allowance.

• Professional Development Stipend.

• Peer Recognition Program.

• Flexible schedule that balances work and personal life.

• Opportunities to enhance skills both professionally and personally.