Data Engineer

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Design, construct, and maintain scalable data pipelines and ingestion frameworks that support batch processing, streaming, and change data capture (CDC) methodologies.

• Develop and enhance data processing workflows utilizing Apache Spark and PySpark across extensive datasets.

• Implement and oversee data lake architectures on AWS, employing S3 and Apache Iceberg.

• Utilize AWS Glue for ETL orchestration, Athena for serverless querying, and Lambda for event-driven data processing.

• Manage data access controls and security settings using AWS IAM.

• Collaborate with data analysts, data scientists, and platform engineers to comprehend data requirements and deliver production-ready solutions.

• Monitor the health of pipelines and address data quality issues.

• Implement enhancements to ensure data reliability and timeliness.

• Document data flows, architectural decisions, and engineering standards.

⛳️ Requirements

• Extensive hands-on experience with AWS services, such as AWS Glue, Amazon S3, Amazon Athena, and AWS IAM.

• Proficiency in Apache Spark / PySpark for data processing.

• Knowledge of data lake architectures, preferably with Apache Iceberg.

• Experience with data ingestion methodologies, including batch processing, streaming, and CDC patterns.

• Proficient in SQL for data querying, validation, and exploratory analysis.

• Strong understanding of data modeling and large-scale data processing.

• Ability to work effectively in cross-functional teams and convey technical concepts clearly to non-technical stakeholders.

• Familiarity with infrastructure-as-code or pipeline orchestration tools such as Airflow, Step Functions, or dbt is advantageous.

• Awareness of AI-assisted development workflows and engineering productivity tools.

• Proficient in English (required for effective communication with global teams).

• Minimum of 2 years of experience in Data Engineering or related fields.

• Practical experience in building and maintaining cloud-based data pipelines and lake architectures on AWS.

🏝️ Benefits

• Christmas Bonus

• Saving Fund

• Food/grocery vouchers

• Home Office allowance

• MetLife Life Insurance with funeral coverage

• MetLife Medical Insurance including dental discounts and vision plan

• Dependents optional with additional cost

• Vacation days with annual increases based on tenure

• Vacation premium

• Official holidays by law

• Holy week

• Day of the Dead

• Christmas Eve

• Flexible working options

• Study plans, courses, and professional development opportunities

• English lessons to support your professional communication