Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Develop a scalable data platform that integrates various sources for seamless access.

• Design and enhance data tools for orchestration, governance, Data-Lakehouse, business intelligence, and related functions.

• Ensure the smooth operation of data systems for analysts, scientists, and engineers.

• Optimize data pipelines for ingestion, processing, and output within a microservices environment.

• Build, maintain, and monitor ETL/ELT processes, orchestrating workflows using Temporal.

• Troubleshoot and enhance the performance, scalability, and reliability of data infrastructure, including S3, Apache Iceberg, and ClickHouse.

• Collaborate with data scientists, analysts, and backend engineers to comprehend data requirements and deliver effective solutions.

• Implement and advocate for data quality, governance, and security best practices throughout the platform.

⛳️ Requirements

• Over 3 years of experience as a Data Engineer or in a similar data infrastructure capacity.

• Strong command of SQL and practical experience with data modeling.

• Familiarity with data lake/lakehouse architectures (e.g., Apache Iceberg, S3, or similar).

• Experience with analytical/columnar databases (e.g., ClickHouse or similar).

• Proven experience in building and orchestrating ETL/ELT pipelines (e.g., Temporal, Airflow, or similar).

• Strong programming capabilities in Python and/or Scala/Java.

• Experience working within a microservices architecture and cloud environments (AWS preferred).

• Self-motivated with strong multitasking abilities and a proven team player.

• Excellent communication skills, with the ability to work both independently and collaboratively.

• Hands-on experience with Apache Spark (or similar technologies) for large-scale data processing.

• Professional proficiency in written and spoken English.

• This role focuses on batch data processing rather than real-time streaming.

• Nice to have: experience with open-source data platforms and tools.

• Nice to have: familiarity with BI and visualization tools such as Superset, Looker, Tableau, or Metabase.

• Nice to have: experience with Docker and Kubernetes.

• Nice to have: experience with infrastructure-as-code and CI/CD practices.

• Nice to have: experience with AWS EMR and cloud-based Apache Spark workloads.

• Nice to have: experience with AI-assisted development tools such as GitHub Copilot or Cursor.

🏝️ Benefits

• Remote work.

• Full-time employment.