Lead Data Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Manage the intermediate layer of the data pipeline by integrating Quantum interaction data with account, device, and various operational data sources.

• Create and oversee ETL workflows on a daily, weekly, and monthly basis.

• Develop and maintain AWS processing resources effectively.

• Validate outputs and produce dependable datasets for Tableau.

• Design and sustain application data structures that reduce compute requirements and enhance dashboard performance.

• Investigate data inconsistencies and resolve pipeline issues.

• Adjust workflows as application features and reporting demands change.

• Collaborate with the engineering lead, data engineers, application developers, and data product owners.

⛳️ Requirements

• Over 5 years of experience in Data Engineering, Data Architecture, or a related field.

• Extensive hands-on AWS experience, including the management of resources for data processing.

• Strong proficiency in SQL.

• Familiarity with Spark.

• Demonstrated experience in building ETL pipelines.

• Experience in integrating various data sources.

• Skilled in organizing data for analytics purposes.

• An investigative mindset with the ability to independently navigate ambiguous technical challenges.

• A collaborative approach, capable of taking ownership of assigned tasks within a cohesive team.

• Advanced English proficiency (B2+).

🏝️ Benefits

• Certifications in AWS, Databricks, and Snowflake.

• Access to AI learning paths.

• Tailored study plans, courses, and additional certifications specific to the role.

• Access to Udemy Business courses.

• English language lessons.

• Opportunities for travel to attend industry conferences and meet clients.

• Career development plans and mentorship programs.

• Special rewards for birthdays, work anniversaries, and other personal milestones.

• Company-provided equipment.

• Flexible working options.

• Additional benefits may vary based on location in LATAM.