Data Integration Engineer

This is a fully remote position, open to applicants in Peru.

📋 Description

• Construct and sustain ETL pipelines that connect Zuora REST APIs with a GCP data warehouse.

• Design and uphold integration components utilizing TypeScript/Node.js and Python.

• Oversee transformation logic for billing events, subscription lifecycles, invoices, payments, and revenue data.

• Operate within the established architecture, development patterns, conventions, and CI/CD workflows.

• Create data pipelines employing BigQuery, Cloud Storage, Dataflow, and Pub/Sub.

• Execute pipeline monitoring, alerting, error handling, retry logic, and data-quality controls.

• Compose intricate SQL validation queries to confirm data parity between source data and warehouse tables.

• Partner with the Business Architect to implement data-validation requirements.

• Investigate pipeline failures, data discrepancies, and integration challenges.

• Ensure accurate and reliable data movement across source systems and warehouse environments.

• Provide clear written updates and collaborate efficiently within a distributed, async-first team.

• Engage in the established Agile/Kanban workflow.

⛳️ Requirements

• Over 5 years of professional experience in data engineering, integration development, or related fields.

• Hands-on experience in building ETL or data-integration pipelines using TypeScript and Node.js.

• Strong proficiency in Python, particularly in the context of data-pipeline development.

• Practical experience with GCP services, such as BigQuery, Cloud Storage, Dataflow, and Pub/Sub.

• Experience in integrating REST APIs utilizing OAuth 2.0, pagination, error handling, and retry mechanisms.

• Advanced SQL expertise and familiarity with complex data warehouse schemas.

• Background in developing data-transformation logic and data-quality validations.

• Understanding of pipeline monitoring, alerting, failure recovery, and operational support.

• Experience working within established architectures, coding standards, and CI/CD workflows.

• Ability to independently onboard and become productive within an existing codebase.

• Strong written communication skills and an async-first collaboration approach.

• Proficiency in English for daily collaboration with an international team.

• Availability to overlap with Pacific Time, primarily between 10:00 a.m. and 2:00 p.m. PT.

• Familiarity with Zuora REST APIs and ZOQL is advantageous.

• Knowledge of the Zuora billing object model, including subscriptions, invoices, and payments, is a plus.

• Experience with dbt or similar data-transformation frameworks is beneficial.

• GCP Professional Data Engineer certification is a plus.

🏝️ Benefits

• Option for remote work.

• Collaborative environment that emphasizes distributed, async-first teamwork.

• Opportunity to engage with modern AI-native technologies and scalable products.

• Opportunities for learning and growth.

• Agile/Kanban workflow.