
Data Engineer
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Colombia.
• Stabilize replication by transferring malfunctioning Zero-ETL tables directly from PostgreSQL to Redshift using AWS DMS and removing unused replicated tables.
• Merge warehouses into Amazon Redshift and phase out Athena while migrating dependent consumers.
• Transition legacy cron-based orchestration within microservices to Airflow.
• Create precalculated fact tables for reporting and customer-facing products, ensuring appropriate data freshness.
• Establish per-table freshness and quality monitoring and alerting, utilizing tools like Grafana.
• Manage DMS and ETL infrastructure as code with Terraform in collaboration with the DevOps team.
• Differentiate workloads and regulate access in Redshift, including staging/production isolation, data sharing, and permission creation.
• Develop and sustain a data catalog in coordination with domain owners, incorporating sensitivity classification and synchronization frequency.
• Comprehend the data needs of consumers across finance and ledger, compliance, BI, and AI/automation, and convert them into actionable data.
• Engage in mid-term POCs involving Aurora native Zero-ETL, Debezium-to-Kinesis streaming CDC, and dbt.
• Collaborate closely with the Data team and Head of AI, partnering with Engineering, DevOps, Finance, Compliance, and BI.
• Over 3 years of practical data engineering experience as an individual contributor in building and managing production data pipelines.
• Proficient in Python and SQL.
• Fully remote position available for candidates located in LATAM (excluding Argentina).
• Experience with the AWS data stack, including Redshift, Athena, RDS/PostgreSQL, DMS, and Zero-ETL replication.
• Familiar with orchestrating pipelines using Airflow.
• Experienced in infrastructure as code practices (Terraform).
• Knowledgeable in data monitoring and observability tools (e.g., Grafana).
• Understanding of data modeling for reporting (fact tables) as well as data governance and access control.
• Familiarity with CDC and streaming technologies (Debezium, Kinesis) and experience with dbt are advantageous.
• Strong business acumen with the ability to collaborate with non-technical data consumers.
• Native Spanish speaker with proficiency in technical English.
• Must be based in LATAM (this position is not open to candidates residing in Argentina).
• Competitive compensation package.
• Opportunities for professional growth.
• Remote-first work environment.
• Engaging challenges within the fintech sector.
• Become part of a high-impact company expanding across global markets.
Highmark Health
Prompt Therapy Solutions Inc
Jones Lang LaSalle Americas, Inc.
Allshore Talent
Get handpicked remote jobs straight to your inbox weekly.