Lead Data Engineer – Microsoft Fabric

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Perform thorough gap analysis and data mapping across more than 80 ERP systems to uncover integration issues, data inconsistencies, and transformation needs.

• Create and implement standardized ETL pipelines and data transformation processes for migrating enterprise data into Microsoft Fabric.

• Establish robust data quality frameworks and validation rules to ensure data is prepared for AI and analytics workloads.

• Oversee the practical implementation of ETL standards and best practices, creating repeatable patterns and automation scripts for multi-source integrations.

• Design and enhance data models that facilitate seamless transformation from disparate ERP sources into a cohesive, AI-ready data architecture.

• Lead the pilot implementation stage, testing and refining standards against actual ERP data prior to full-scale deployment.

• Coach and mentor team members on ETL development, data transformation methods, and Fabric-specific engineering practices.

• Work collaboratively with stakeholders to document data lineage, transformation logic, and integration patterns for knowledge transfer and governance.

• Address data inconsistencies and implement corrective actions to uphold data integrity throughout the pipeline.

⛳️ Requirements

• Advanced SQL skills for intricate data transformations, query optimization, and performance enhancement.

• Strong expertise in Python for automation scripting, data pipeline creation, and ETL orchestration.

• Proven hands-on experience in designing and executing ETL solutions in complex, multi-source environments.

• Demonstrated experience with enterprise ERP systems and large-scale data integration projects.

• Solid understanding of the Azure ecosystem and practical experience with Microsoft Fabric for data engineering.

• Comprehensive knowledge of data modeling principles and the ability to design schemas that cater to AI and analytics applications.

• Experience in data quality evaluation, validation frameworks, and data profiling techniques.

• Exceptional problem-solving abilities with an emphasis on scalability, maintainability, and performance optimization.

• Strong communication skills and the capability to collaborate with both technical and business stakeholders.

• Proficient in English (required for effective communication with global teams).

🏝️ Benefits

• 📚 Learning Opportunities: Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.

• Access to AI learning paths to keep up with the latest technologies.

• Customized study plans, courses, and additional certifications tailored to your role.

• Access to Udemy Business, which provides thousands of courses to enhance your technical and soft skills.

• English lessons to aid in your professional communication.

• 👨🏽‍💻 Travel opportunities to attend industry conferences and meet clients.

• 👩‍🏫 Mentoring and Development: Career development plans and mentorship programs to guide your path.

• 🎁 Celebrations & Support: Special rewards for celebrating birthdays, work anniversaries, and other personal milestones.

• Company-provided equipment.

• ⚖️ Flexible working options to help you achieve a healthy work-life balance.

• 🏥 Statutory Benefits: Social security coverage (IMSS).

• Christmas bonus (Aguinaldo) as per Mexican law.

• Vacation premium (Prima Vacacional).

• Remote work bonus.

• Paid leave as per Federal Labor Law (LFT).