Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Design, construct, and sustain reliable end-to-end ELT and ETL pipelines within cloud environments.

• Create scalable datasets that facilitate cloud cost visibility, attribution, usage analysis, and performance insights.

• Develop and implement data models and ingestion frameworks for extensive telemetry and usage data.

• Create automation and tools to enable cost-aware decision-making across Product, Engineering, and Finance teams.

• Enhance data pipelines and systems for improved performance, reliability, and cost-effectiveness.

• Conduct query tuning and refine storage and compute strategies.

• Establish and maintain integrations with REST APIs and various data sources.

• Implement and support CI/CD workflows and Infrastructure as Code.

• Ensure data quality, validation, auditability, and consistency throughout end-to-end data workflows.

• Monitor, diagnose, and resolve production pipeline failures, data inconsistencies, and performance challenges.

• Collaborate with Engineering and Finance stakeholders to optimize cloud costs and derive usage-based insights.

⛳️ Requirements

• Demonstrated expertise in developing and maintaining end-to-end ELT or ETL pipelines in cloud environments.

• Proficient in SQL and Python.

• Familiarity with dbt, Airflow, or Dagster.

• Practical experience with the AWS data ecosystem, including AWS Glue, Amazon Athena, and Amazon Aurora.

• Experience with Snowflake.

• Strong background in data modeling.

• Proven ability to process data at scale.

• Experience with CI/CD and version control systems.

• Hands-on experience with Infrastructure as Code utilizing Terraform.

• Experience in creating or maintaining REST API integrations.

• Capability to optimize data pipelines for efficiency and cost-effectiveness.

• Strong analytical and problem-solving abilities.

• Knowledge of data validation, auditing, and production pipeline support.

• Enterprise-level experience is highly preferred.

• Scala experience is a plus.

• FinOps Certified Practitioner or FinOps Certified Engineer certification is advantageous.

• Familiarity with cloud cost optimization, tagging strategies, or cost-monitoring systems is a bonus.

• Experience working across AWS and GCP is desirable.

• Knowledge of Datadog is a plus.

• Background in data platform engineering or shared infrastructure engineering is beneficial.

• Must reside in LATAM.

• Must be available to work on a U.S.-based EST or CST schedule.

🏝️ Benefits

• Competitive salary and compensation package.

• Opportunities for professional development and growth.

• Flexible work schedule and remote work options.

• Collaborative and inclusive work environment.