Ingeniero de Datos – Cloud Native

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Migration and CMZ

• Recreate and validate table structures in CMZ

• Migrate historical data per table with integrity validation (volumes, frequencies, business rules)

• Reconfigure scheduled queries that generate derived tables from EDW PROD / Data Lake

• Identify and document upstream/downstream dependencies by domain

• Pipelines and Ingestion

• Develop ingestion pipelines in Airflow to Raw - Catalog - Cmp layers

• Configure and validate loading processes in the new governed environment

• Reconnect system integrations and reports (Looker, Power BI, Tableau) to new tables

• Quality and Governance

• Complete metadata for migrated tables (owner, description, lineage)

• Execute validation and reconciliation tests of data against the original source

• Raise JIRA tickets for requests of new datasets with business justification

⛳️ Requirements

• 3-5 years of experience in data engineering

• Proficiency in BigQuery: CREATE TABLE/VIEW, External Tables, Scheduled Queries, query optimization

• Experience with Airflow and/or Concord for pipeline orchestration

• Ability to map data dependencies and coordinate with business owners

• Attention to detail in post-migration data integrity validation

• Python for scripting and automation of migration tasks

• Experience in retail or data consolidation projects (preferred)

• Technical Stack Cloud & Storage: GCP BigQuery, Cloud Storage, Dataflow, Data Lake (Raw/Catalog/Cmp)

• Orchestration: Apache Airflow, Concord

• Source Control: GitHub / GitHub Enterprise

• Languages: Advanced SQL (BigQuery), Python (pandas, PySpark, SQLAlchemy)

• Visualization: Looker, Power BI, Tableau, Dataiku (reconnection, not development)

• Management: Jira

🏝️ Benefits

• Socially Responsible Company (ESR)