Data Engineer – Cloud & SaaS Integrations

This is a fully remote position, open to applicants in United Kingdom, +5 more countries.

📋 Description

• Develop new integrations with third-party billing and usage APIs to broaden vendor coverage.

• Maintain current integrations as vendors modify their APIs and pricing structures.

• Lower the marginal costs associated with future integrations.

• Leverage AI throughout the codebase and during API exploration, prototyping, code generation, code review, debugging, testing, and documentation processes.

• Take ownership of integration data quality, addressing duplication, gaps, race conditions, deduplication, negotiated rates, checks, and reconciliation.

• Create and establish normalized models for vendor bills, encompassing units, currencies, time granularity, taxonomies, and cost categories.

• Manage orchestration, scheduling, and backfill processes for ingestion pipelines from start to finish.

• Ensure backfills are routine, secure, and self-serviceable.

• Work collaboratively with product teams, support, and engineers to utilize data for identifying and resolving gaps.

• Proactively propose necessary tasks without waiting for a formal specification.

⛳️ Requirements

• A minimum of 3 years of professional experience in data engineering or a data-intensive backend role, with direct production ownership of pipelines relied upon by others.

• Proficient in SQL, with the ability to reason about performance for complex analytical queries.

• Practical experience in constructing and managing data pipelines using an orchestration framework.

• Experience with Dagster or Airflow is highly preferred; equivalent experience with Prefect, dbt, or a similar tool is relevant if willing to work with Dagster/Airflow.

• Strong proficiency in Python or another language used fluently for data-related tasks.

• Familiarity with cloud data warehouses or analytical stores such as BigQuery, ClickHouse, Snowflake, Redshift, or similar platforms.

• Experience in integrating third-party REST APIs, including handling pagination, rate limits, partial failures, late-arriving data, restated data, and discrepancies in vendor documentation.

• A keen instinct for data accuracy, including reconciling totals and formulating assertions.

• An AI-augmented approach to work, utilizing AI tools throughout the engineering workflow.

• Experience in developing solutions in the cloud or utilizing cloud services.

• Exceptional written and verbal communication skills in English.

• Self-organized, goal-oriented, self-motivated, confident, thorough, and persistent.

• A BA/BS degree or equivalent practical experience is considered a bonus.

🏝️ Benefits

• Unlimited Vacation

• Flexible Working Options

• Health Insurance

• Parental Leave

• Employee Stock Option Plan

• Home Office Allowance

• Professional Development Stipend

• Peer Recognition Program

• Flexible schedule balancing work and home life

• Remote work