Data Engineer

This is a fully remote position, open to applicants in Venezuela.

📋 Description

• Take responsibility for the health, performance, and scalability of Cloud Composer/Airflow environments in both staging and production settings.

• Design and enhance dbt transformations on BigQuery across the bronze, silver, and gold layers.

• Manage Datastream CDC pipelines from PostgreSQL to BigQuery, including schema management, backfills, and replication tasks.

• Develop and optimize DataOps CI/CD processes for DAGs and dbt using GitHub Actions and Workload Identity Federation.

• Implement automated testing, deployment smoke tests, and ensure safe promotion across environments.

• Promote data quality, observability, freshness checks, lineage tracking, dbt-artifact capture, and alerting mechanisms.

• Establish and advocate for standards in model design, incrementality, idempotency, and safe modification practices.

• Guide engineers through code reviews, collaborative work, and documentation efforts.

• Collaborate with platform, product, and analytics teams to create a self-serve data platform.

• Utilize OpenTofu and Terragrunt for Infrastructure-as-Code practices.

⛳️ Requirements

• Bachelor’s degree in Computer Science or a related discipline, or equivalent practical experience.

• Over 5 years of experience in data engineering or a related position.

• Extensive hands-on experience with Apache Airflow, preferably Cloud Composer.

• Strong practical knowledge of dbt, including incremental models, testing capabilities, macros, and extensive model graphs.

• Proficient in BigQuery, with solid experience in data modeling, partitioning, clustering, query optimization, and cost management.

• Substantial experience operating data services on Google Cloud Platform (GCP).

• Proficiency in Python and advanced SQL skills.

• Familiarity with Git-based workflows and CI/CD processes, including GitHub Actions or similar tools.

• Excellent communication skills and the ability to engage stakeholders, along with mentoring capabilities.

• Strong problem-solving and analytical thinking skills.

• Experience with Datastream or similar CDC tools, including backfill and replication troubleshooting.

• Understanding of Infrastructure-as-Code, such as Terraform or OpenTofu, ideally with experience in Terragrunt.

• Experience with Dataplex or similar tools for data quality, governance, and lineage tracking.

• Familiarity with handling PII in a regulated environment.

• Knowledge of astronomer-cosmos for executing dbt within Airflow.

• Understanding of GCP data and messaging services like Pub/Sub and Cloud Storage.

• Proven track record in cost and performance optimization within a data warehouse, including FinOps practices.

• Experience in the fintech, payments, or credit sectors.

• Proficiency in both Spanish and English.

🏝️ Benefits

• A work culture grounded in trust and purpose.

• Valuing creativity and curiosity.

• An environment that encourages ideas and feedback.

• An inclusive culture where everyone feels they belong.

• A transparency-focused workplace.

• The chance to contribute to meaningful financial inclusion initiatives.