Senior Programador – Data Engineering

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Develop scalable solutions for data processing, storage, and consumption.

• Design efficient and optimized data models for large volumes of information.

• Create, build, and maintain robust and scalable ETL/ELT pipelines.

• Implement high-performance distributed solutions using Apache Spark.

• Manipulate, transform, and automate data processes utilizing Python and Scala.

• Utilize massive storage systems such as Data Lake and optimized formats like Parquet and Delta Lake.

• Work with AWS cloud services including S3, Glue, EMR, Redshift, and Lambda.

• Collaborate with Data Scientists, Data Architects, and DevOps in agile environments.

• Document processes and communicate information to both technical and business audiences.

• Suggest improvements for existing data architectures and processes.

⛳️ Requirements

• Professionals in Systems Engineering, Electronics, or related fields.

• Over 4 years of experience in data engineering projects and the development of scalable solutions for data processing, storage, and consumption.

• Strong experience with both relational and non-relational databases.

• Advanced proficiency in SQL.

• Ability to design efficient and optimized data models for large volumes of information.

• Advanced knowledge in Python and Scala.

• Extensive experience with ETL/ELT tools and processes.

• Practical experience with Apache Spark.

• Advanced knowledge of Data Lake and formats such as Parquet and Delta Lake.

• Proficiency in cloud services, particularly AWS, including S3, Glue, EMR, Redshift, and Lambda.

• Experience with GCP or Azure is a plus.

• Knowledge of Java, especially for batch processes or data system integration, is valued.

• Analytical skills to interpret and transform large volumes of data.

• Focus on data quality, integrity, and governance.

• Ability to collaborate with multidisciplinary teams in agile environments.

• Skill in documenting processes and clearly communicating to both technical and business audiences.

• Proactive in proposing enhancements to existing data architectures and processes.

🏝️ Benefits

• Indefinite contract.

• Hybrid working model.

• Office hours.