Senior Programador - Data Engineering

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Design and develop scalable solutions for data processing, storage, and consumption.

• Create, build, and maintain robust and scalable ETL/ELT pipelines.

• Implement high-performance distributed solutions using Apache Spark.

• Design efficient and optimized data models for large volumes of information.

• Manipulate, transform, and automate data processes using Python and Scala.

• Work with mass storage systems such as Data Lakes and optimized formats like Parquet and Delta Lake.

• Utilize AWS cloud services such as S3, Glue, EMR, Redshift, and Lambda.

• Collaborate with Data Scientists, Data Architects, and DevOps in agile environments.

• Document processes and effectively communicate information to technical and business audiences.

• Propose improvements to existing data architectures and processes.

⛳️ Requirements

• Professionals in Systems Engineering, Electronics, or related fields.

• Over 4 years of experience in data engineering projects and developing scalable solutions for data processing, storage, and consumption.

• Strong experience in both relational and non-relational databases.

• Advanced proficiency in SQL.

• Ability to design efficient and optimized data models for large volumes of information.

• Advanced knowledge of Python and Scala.

• Extensive experience with ETL/ELT tools and processes.

• Hands-on experience with Apache Spark.

• Advanced understanding of mass storage systems like Data Lakes and formats such as Parquet and Delta Lake.

• Proficient in cloud services, especially AWS, including S3, Glue, EMR, Redshift, and Lambda.

• Experience with GCP or Azure will be considered a plus.

• Knowledge of Java applied to batch process development or data system integration is valued.

• Analytical capability to interpret and transform large volumes of data.

• Focus on data quality, integrity, and governance.

• Ability to collaborate with multidisciplinary teams in agile settings.

• Skill in documenting processes and clearly communicating to technical and business audiences.

• Proactive approach in suggesting enhancements to existing data architectures and processes.

🏝️ Benefits

• Remote work opportunity.

• Full-time position.