Senior Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Create, develop, test, and sustain scalable data pipelines and data products that support Enterprise Credit Risk initiatives.

• Construct and enhance batch and real-time data processing solutions utilizing cloud and lakehouse technologies.

• Convert business requirements from Risk, Product, Data Science, and Engineering teams into technical solutions.

• Develop reusable frameworks, components, and engineering patterns.

• Establish data quality controls, monitoring, alerting, and observability features.

• Assist in the migration and modernization of data assets and workloads to Databricks and cloud-native platforms.

• Create and maintain curated datasets for lending decision-making, portfolio risk management, and advanced analytics.

• Engage in architecture discussions and offer technical recommendations.

• Resolve production issues and conduct root cause analysis.

• Apply engineering best practices for code quality, testing, deployment automation, security, and operational excellence.

• Guide junior engineers through code reviews, technical advice, and knowledge sharing.

• Enhance scalability, performance, cost efficiency, and maintainability of data platforms.

⛳️ Requirements

• Extensive experience in developing and maintaining enterprise-scale data engineering solutions.

• Practical knowledge of Databricks, Apache Spark, PySpark, Hadoop, SQL, and Python.

• Proven experience in building ETL/ELT pipelines and large-scale data processing applications.

• Familiarity with cloud-based data platforms and storage technologies.

• Strong grasp of data modeling concepts and analytical data structures.

• Experience in implementing automated testing, monitoring, and data quality practices.

• Knowledge of data formats such as Parquet, Avro, and ORC.

• Understanding of CI/CD pipelines, Git-based development workflows, and DevOps principles.

• Experience with workflow orchestration tools like Airflow.

• Strong analytical and problem-solving capabilities.

• Effective communication skills and the ability to collaborate across technical and business teams.

• Experience in mentoring or assisting less experienced engineers.

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline, or alternatively a minimum of 5 years of experience in a relevant field.

• Proficiency in English.

• Familiarity with Java-based application development is a plus.

🏝️ Benefits

• No explicit benefits, perks, or compensation extras stated.