Data Engineer – Lead

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Design and develop scalable, cloud-native data platforms tailored for contemporary data engineering methodologies.

• Mentor and support fellow engineers, sharing insights, reviewing code, and promoting a culture of continuous improvement.

• Construct robust and maintainable ETL/ELT pipelines that integrate various systems for mission-critical applications.

• Produce high-quality, testable code and engage in architectural and design discussions.

• Break down intricate problems into modular, efficient, and scalable components that align with platform and product objectives.

• Assist in data governance and quality initiatives, which include data lineage, cataloging, and access management.

• Take part in architectural conversations, iteration planning, and feature sizing meetings.

⛳️ Requirements

• Extensive hands-on experience in data engineering, specifically in building production-grade pipelines on big data platforms (Hadoop ecosystem and cloud data platforms like Databricks).

• High level of proficiency in Python, Spark, Hadoop platforms and tools (Hive, Impala, Airflow, NiFi), along with SQL.

• Practical experience with cloud data platforms, particularly Databricks and Snowflake (with a preference for Databricks).

• Familiarity with orchestration and integration tools such as Apache Airflow, Apache NiFi, or Talend.

• Solid understanding of DevOps/CI-CD practices, including version control (Git), automated testing, release pipelines, and observability.

• Strong problem-solving capabilities and the ability to troubleshoot complex data issues while effectively communicating with both technical and non-technical stakeholders.

• Experience in developing Java-based applications is a plus.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance plans.

• Flexible working hours and remote work opportunities.

• Professional development and continuous learning opportunities.

• Collaborative and inclusive company culture.