Staff Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Ensure a dependable data platform for efficient and scalable data ingestion, transformation, exploration, and governance throughout the OLX Group

• Uphold a platform that allows for data storage, transformation, and accessibility for end users

• Supply relevant data to various teams and/or end users

• Collaborate with highly scalable, distributed, highly available, and fault-tolerant systems

• Emphasize rapid, high-volume processing

• Utilize contemporary and open-source technologies

• Sustain and enhance a modern data platform

⛳️ Requirements

• Profound understanding of software engineering principles and best practices

• Expertise in Python and PySpark

• Advanced SQL skills and experience with distributed query engines (Athena, Trino, Spark)

• Practical experience with real-time data processing architectures (streaming)

• Hands-on knowledge of Spark, Apache Iceberg, and Trino

• Familiarity with Linux environments

• Extensive experience with AWS, particularly in supporting and advancing data platforms

• Proficiency in AWS IAM and AWS Lake Formation

• Understanding of Terraform and automation via GitHub Actions (CI/CD)

• Knowledge of Airflow / MWAA (Amazon Managed Workflows for Apache Airflow)

• Familiarity with AWS Glue (Jobs, Metastore, and Data Quality) and EMR

🏝️ Benefits

• Market-competitive compensation

• Health insurance

• Dental insurance

• Private pension plan

• Flexible benefits tailored to your needs

• Meal allowance

• Financial counseling

• Benefits club

• Home office allowance

• Mobility allowance

• Childcare allowance

• Life insurance

• Extended leave policies

• Support for sports, quality of life, and well-being

• Payroll-deducted loan with reduced interest rates