Big Data Lead

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Develop and maintain data integration, ELT, and data engineering solutions.

• Manage substantial data volumes within distributed or cloud environments.

• Create robust data pipelines that incorporate logging, monitoring, retry mechanisms, idempotency, and recovery from failures.

• Work with cloud storage systems, data lakes, data warehouses, and distributed computing platforms.

• Leverage streaming systems, APIs, orchestration tools, version control, automated testing, and observability platforms.

• Apply containerization, deployment technologies, CI/CD pipelines, and Infrastructure as Code (IaC) practices.

• Lead efforts in data modeling, metadata management, data governance, and master data management methodologies.

• Collaborate with a global network of expertise across international delivery centers.

⛳️ Requirements

• A Bachelor's degree in Computer Science, Engineering, Information Systems, or a related discipline (equivalent practical experience will be considered).

• A minimum of 5 years' experience in developing and supporting data integration, ELT, or data engineering solutions.

• Strong command of SQL.

• Proficiency in at least one programming language, such as Python, Java, Scala, or Spark SQL.

• Familiarity with orchestration and workflow tools, including Apache Airflow, Azure Data Factory, or AWS Step Functions.

• Knowledge of both relational and non-relational databases, as well as data warehouses and data lake architectures.

• Experience with the AWS cloud data platform, including AWS Lambda and KAFKA.

• Excellent analytical and troubleshooting capabilities.

• Advanced proficiency in oral English.

• Advanced proficiency in Spanish.

• Experience in regulated sectors such as financial services, healthcare, or other highly controlled environments is preferred.

• Familiarity with cloud-native foundations or AI coding assistants is a plus.

• Demonstrated resilience, emotional intelligence, a focus on agile delivery, and a thorough understanding of the distinction between coding and engineering.

🏝️ Benefits

• Fully remote work opportunity.

• Continuous learning and development opportunities.

• Exposure to complex engineering challenges and high-impact projects.

• Accelerated career growth through participation in world-class projects.

• A dynamic, innovative workplace culture.

• An agile delivery environment.