Senior Data Engineer – Data Platform

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Design and manage data ingestion using managed connectors and custom solutions (Airbyte, APIs, CDC) for clinical, commercial, and operational sources.

• Build incremental, idempotent loads with historical data management.

• Take ownership of orchestration through workflows in Dagster with Python, including dependencies, retries, backfills, SLAs, and assets.

• Create batch and near real-time production pipelines, oriented towards events when appropriate.

• Replace manual processes and scale pipelines without rewrites.

• Ensure quality and observability with data checks, alerts, lineage, and monitoring.

• Evolve architecture in AWS utilizing PostgreSQL/RDS, Lambda, S3, and serverless services, considering performance, cost, and security.

• Apply Git, PRs, testing, CI/CD, templates, and reusable components.

• Enable Analytics Engineering, Data Science, and ML with reliable raw data, training datasets, and pipelines to return predictions to the product.

• Conduct code reviews, pairing, and technical mentoring; establish engineering standards.

⛳️ Requirements

• Over 5 years of experience in data engineering, with at least 2 years functioning as a Sr. Data Engineer or technical platform leader.

• Proficiency in Python for production pipelines.

• Experience with ETL/ELT, automations, and data services.

• Familiarity with Git, PRs/code reviews, testing, and CI/CD.

• Practical experience with Dagster or Airflow, ideally having deployed or migrated an orchestrator from scratch.

• Experience with managed ingestion tools (Airbyte, Fivetran, or equivalent) and custom connectors against APIs.

• Knowledge of incremental loads, idempotency, and historical data management.

• Advanced SQL skills and experience with PostgreSQL and/or an analytical warehouse (Redshift, Snowflake, BigQuery), optimizing performance and cost.

• Transformations using dbt or equivalent tools.

• Cloud experience, preferably with AWS: RDS, Redshift, Lambda, S3, and serverless architectures (SAM or similar).

• Understanding of data quality checks, monitoring, and alerts (Datadog, Grafana, or equivalent).

• Experience modernizing legacy or manual processes to scalable cloud-native infrastructure.

• Ability to translate ambiguous needs into data solutions and explain their trade-offs.

• Experience mentoring other engineers and establishing sustainable standards.

• Native Spanish speaker with professional English proficiency (documentation and tools in English).

🏝️ Benefits

• Access to tools and benefits for your professional growth, such as courses, workshops, books, etc.

• Unlimited private medical assistance via video call (general practitioner, nutritionist, and psychologist) for you and 3 family members.

• Access to tools for your physical well-being (TotalPass).

• 9 additional personal leave days per year as per law.

• Major Medical Expenses Insurance.

• Necessary equipment to perform your job.

• Monthly support of $700 pesos in addition to your salary.

• One-time support of $2,500 after the probation period.