Lead Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Spearhead the design and execution of data ingestion frameworks within Snowflake, ensuring both scalability and dependability.

• Oversee the creation of comprehensive ELT pipelines that integrate various data sources.

• Develop and uphold data quality frameworks, inclusive of validation rules, testing methodologies, and monitoring systems.

• Implement and advocate for best practices in Medallion Architecture (Bronze, Silver, Gold) across data pipelines.

• Construct and refine data pipelines and architectures utilizing AWS tools such as S3, Glue, Lambda, and EMR.

• Enhance data validation and ingestion frameworks, incorporating UI components (Streamlit-based) as necessary.

• Serve as a technical leader, promoting best practices in data engineering, governance, and pipeline reliability.

• Proactively identify potential risks, bottlenecks, and data quality challenges, executing mitigation strategies before they affect delivery.

• Contribute to data governance efforts, focusing on data definitions, lineage, and stewardship practices.

• Champion the documentation and continual enhancement of data platform processes.

⛳️ Requirements

• Minimum of 4 years of experience in Data Engineering (a strong senior-level or lead mindset is expected).

• Proven hands-on experience with Snowflake (Essential).

• Extensive experience in developing ELT pipelines and data ingestion solutions.

• Robust expertise in SQL and large-scale data processing.

• Strong comprehension and practical experience with Medallion Architecture (Essential).

• Experience in building and maintaining data pipelines on AWS (Preferred).

• Knowledge of data quality, validation frameworks, and governance practices.

• Familiarity with Snowflake Cortex (Preferred).

• Experience with CI/CD pipelines for managing data workflows (Preferred).

• Experience with Iceberg tables and Snowflake data sharing (Preferred).

• Proficiency with tools like dbt, Glue, Athena, EMR, Lambda, Terraform, or CloudFormation (Preferred).

🏝️ Benefits

• Learning Opportunities: Certifications available in AWS (as we are AWS Partners), Databricks, and Snowflake.

• Access to AI learning pathways to keep current with the latest technologies.

• Customized study plans, courses, and additional certifications aligned with your role.

• Access to Udemy Business, providing thousands of courses to enhance both technical and soft skills.

• English language lessons to aid your professional communication.

• Opportunities for travel to industry conferences and client meetings.

• Mentoring and Development: Career advancement plans and mentorship programs designed to guide your career path.

• Celebrations & Support: Special rewards for personal milestones such as birthdays and work anniversaries.

• Equipment provided by the company.

• Flexible working arrangements to help you achieve a balanced lifestyle.