Data Engineer

This is a fully remote position, open to applicants in Uruguay.

📋 Description

• Design, create, and sustain scalable data pipelines along with ingestion frameworks.

• Facilitate batch processing, streaming, and change data capture (CDC) methodologies.

• Develop and refine data processing workflows utilizing Apache Spark and PySpark.

• Implement and oversee AWS data lake architectures using Amazon S3 and Apache Iceberg.

• Employ AWS Glue for ETL orchestration, Athena for serverless querying, and Lambda for event-driven processing.

• Manage data access controls and security settings through AWS IAM.

• Collaborate with data analysts, data scientists, and platform engineers to comprehend requirements and deliver production-ready solutions.

• Monitor pipeline integrity and resolve data quality challenges.

• Implement enhancements to guarantee data reliability and freshness.

• Document data flows, architectural decisions, and engineering standards.

⛳️ Requirements

• Extensive hands-on experience with AWS services, including AWS Glue, Amazon S3, Amazon Athena, and AWS IAM.

• Proficient in Apache Spark and PySpark for data processing tasks.

• Familiarity with data lake architectures, preferably with Apache Iceberg.

• Experience in batch processing, streaming, and change data capture (CDC) ingestion methodologies.

• Proficient in SQL for data querying, validation, and exploratory analysis.

• Strong understanding of data modeling and large-scale data processing techniques.

• Capability to work collaboratively within cross-functional teams.

• Skill to convey technical concepts clearly to non-technical stakeholders.

• Experience with infrastructure-as-code or pipeline orchestration tools such as Airflow, Step Functions, or dbt is advantageous.

• Familiarity with AI-assisted development workflows and engineering productivity tools.

• Advanced English proficiency required for effective communication with global teams.

• Minimum of 2 years of experience in Data Engineering or related fields.

• Hands-on experience in constructing and maintaining cloud-based data pipelines and lake architectures on AWS.

🏝️ Benefits

• Daily lunches at headquarters, featuring vegetarian, vegan, gluten-free, and sugar-free options.

• Gourmet meals every Friday prepared by an on-site chef at headquarters.

• Flexible working arrangements available.

• Provision of MacBook and accessories.

• Daily snacks and beverages provided at headquarters.

• After-hours events, including football, tennis, and game nights at headquarters.

• Participation in a football league every Wednesday and Friday.

• Opportunities for pool games and office trophy competitions.

• Tennis courts accessible for friendly matches.

• Chess championships, along with game and music nights.

• Support for AWS certifications, study plans, courses, and other certification opportunities.

• English language lessons offered.

• Tech Tuesdays for peer learning.

• Mentoring and development opportunities provided.

• Gifts for anniversaries and birthdays.

• Great location and supportive teammates.