Data Engineer Lead

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Oversee the design, development, and advancement of enterprise-grade data platforms and pipelines that support credit risk products, decision-making capabilities, and analytics solutions.

• Architect and execute scalable ETL/ELT frameworks utilizing Databricks, Spark, Delta Lake, and cloud-native technologies.

• Establish data quality, lineage, governance, observability, and monitoring functionalities.

• Transition and modernize legacy data assets into cloud-based architectures and Data Lakehouse platforms.

• Collaborate with Risk, Product, Architecture, and Engineering teams to convert business needs into scalable technical solutions.

• Define and advocate for engineering standards, coding practices, testing frameworks, data quality frameworks, deployment automation, and operational excellence.

• Lead technical design reviews and influence the architectural direction for data-intensive applications and services.

• Enhance large-scale data processing workloads for performance, reliability, scalability, and cost-effectiveness.

• Facilitate AI and advanced analytics initiatives through high-quality, reusable, governed data products.

• Mentor and coach engineers while promoting ownership, continuous learning, accountability, and engineering excellence.

• Shape the strategic roadmap, technology assessment, and delivery priorities across the ECR portfolio.

• Support regulatory, compliance, security, and audit requirements with engineering controls and documentation.

• Manage complex cross-service challenges and foster cross-functional collaboration.

• Conduct technical interviews and evaluate engineering talent.

⛳️ Requirements

• Extensive expertise in designing and implementing large-scale data engineering solutions and distributed data processing systems.

• Advanced proficiency in Databricks, Apache Spark, Delta Lake, SQL, Hadoop, and Python.

• Experience in building and managing cloud-based data platforms on Azure, AWS, or GCP.

• Proficiency in developing enterprise-grade ETL/ELT pipelines, streaming architectures, and data integration frameworks.

• Strong understanding of data modeling techniques applicable to analytical and operational workloads.

• Experience in implementing data quality frameworks, lineage, metadata management, and governance practices.

• Familiarity with Parquet, Avro, and ORC data formats.

• Working knowledge of CI/CD pipelines, infrastructure-as-code, automated testing, and DevOps methodologies.

• Experience with workflow orchestration tools like Airflow.

• Strong comprehension of security, privacy, and compliance requirements related to sensitive financial and customer data.

• Proven capability to lead technical initiatives across multiple teams and influence engineering direction without direct authority.

• Excellent communication skills that span both technical and business functions.

• Demonstrated leadership in uniting engineering teams around common goals and driving delivery amid ambiguity.

• Ability to influence senior technical and business stakeholders and make well-considered trade-off decisions.

• Knowledge of Java-based application development is advantageous.

• A Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline, or a minimum of 10 years of experience in a comparable field.

• Advanced English proficiency is required.

🏝️ Benefits

• No specific benefits or compensation extras are explicitly mentioned.