Data Engineer – Cloud & SaaS Integrations

This is a fully remote position, open to applicants in Ireland, +5 more countries.

📋 Description

• Develop new integrations with third-party billing and usage APIs.

• Maintain current integrations as vendor APIs and pricing structures evolve.

• Minimize the marginal cost associated with future integrations.

• Leverage AI throughout the codebase and in API exploration, prototyping, code generation and review, debugging, testing, and documentation.

• Ensure data quality, addressing issues such as duplication, gaps, race conditions, deduplication, and negotiated-rate support.

• Create checks and reconciliation procedures to confirm data accuracy.

• Design and implement normalization models across vendor invoices, units, currencies, time granularity, taxonomies, and cost categories.

• Manage orchestration, scheduling, and backfill processes for ingestion pipelines.

• Work collaboratively with product, support, and engineering teams to identify and resolve data-related gaps.

• Independently propose and lead necessary initiatives.

⛳️ Requirements

• Over 3 years of professional experience in data engineering or a backend role with a significant data focus, including production ownership of pipelines utilized by others.

• Proficient in SQL, with a strong understanding of performance considerations for complex analytical queries.

• Practical experience in constructing and managing data pipelines using an orchestration framework.

• Familiarity with Dagster or Airflow is highly desired; equivalent experience with Prefect, dbt, or a similar tool is also applicable.

• Strong proficiency in Python or another programming language relevant for data tasks.

• Experience with cloud data warehouses or analytical platforms such as BigQuery, ClickHouse, Snowflake, Redshift, or similar.

• Background in integrating third-party REST APIs, including handling pagination, rate limits, partial failures, and late-arriving or restated data.

• A keen instinct for data integrity, reconciliation, and validation.

• Experience with AI-enhanced workflows and utilizing AI tools within an engineering context.

• Proven experience in developing solutions in the cloud and/or utilizing cloud services.

• Excellent communication skills in both written and spoken English.

• Self-organized, goal-focused, self-driven, confident, meticulous, and persistent.

🏝️ Benefits

• Unlimited Vacation.

• Flexible Working Options.

• Health Insurance.

• Parental Leave.

• Employee Stock Option Plan.

• Home Office Allowance.

• Professional Development Stipend.

• Peer Recognition Program.

• Flexible schedule that accommodates work and personal life.

• Support for professional and personal skills development.