Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Collect data from various sources, including databases, CSV files, and APIs, utilizing ETL tools for data cleaning and preprocessing.

• Remove duplicates, normalize formats, validate, fill or discard null values, map fields, and enrich data.

• Design and build efficient data pipelines using Matillion and SQLMesh.

• Automate the collection, transformation, and loading of data through ETL processes.

• Integrate and consume data from external APIs to enrich datasets and enhance information quality.

• Contribute to the design of efficient architectures to manage large volumes of data using BigQuery, Python, and SQL.

⛳️ Requirements

• Degree in Engineering, Actuarial Science, Applied Mathematics, Industrial Engineering, or a related field.

• Strong programming experience, particularly in Python.

• Development of efficient code and solving complex problems.

• In-depth knowledge of NumPy, Pandas, and Polars.

• Advanced SQL usage.

• Experience in large-scale data manipulation and query optimization in SQL databases and BigQuery.

• Proven experience with Matillion and SQLMesh for building and managing ETL flows.

• Demonstrable experience in database management and SQL query optimization.

• Familiarity with both relational and non-relational databases.

• Understanding of data warehouse, data lake, data vault, and BigQuery concepts.

• Experience in observability.

• Knowledge of Airflow and Git.

• Ability to communicate effectively with interdisciplinary teams.

• Capability to prioritize tasks based on impact and urgency in dynamic environments.

• Judgment to distinguish between urgent and important tasks.

• Skill in managing multiple priorities and meeting tight deadlines.

🏝️ Benefits

• Competitive salary, negotiable based on experience, skills, and outcomes from the hiring process.

• 100% remote work.

• Flexible scheduling during new releases.

• Opportunities for professional growth and development.