Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, construct, and maintain scalable, robust, and high-performance data pipelines.

• Handle large quantities of both structured and unstructured data.

• Ensure data quality, consistency, and governance throughout the information lifecycle.

• Create processes for data ingestion, transformation, and delivery.

• Collaborate with software engineering, data analytics, data science, and business teams.

• Engage in defining data architectures and assessing new technologies and tools.

• Monitor and enhance data processing workflows in distributed environments.

• Support initiatives aimed at modernizing and evolving the data platform.

⛳️ Requirements

• Significant experience in Data Engineering within distributed environments.

• Extensive experience with Apache Spark.

• Advanced proficiency in Scala.

• Familiarity with AWS services, including Glue, S3, EMR, Athena, and Redshift.

• Comprehensive experience with data modeling.

• Proficiency in ETL and ELT processes.

• Experience in constructing data pipelines.

• Knowledge of relational databases.

• Understanding of NoSQL databases and familiarity with SQL Server.

• Experience with both batch and streaming data processing.

• Awareness of data quality, security, and governance best practices.

• Experience with Git-based version control.

• Knowledge of observability and monitoring for data pipelines.

• Preferred qualifications: experience with Apache Kafka or Amazon MSK; knowledge of legacy system modernization; familiarity with Delta Lake, Apache Hudi, or Apache Iceberg; knowledge of dbt, Airflow, and Terraform; experience with Lakehouse architectures; experience in high-volume data environments.

🏝️ Benefits

• Flexible benefits card – choose how and where to utilize it.

• Tuition assistance for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance review accompanied by a structured career development plan.

• Opportunities for international careers.

• Access to Wellhub and TotalPass.

• Private pension plan.

• Childcare assistance.

• Health insurance.

• Dental insurance.

• Life insurance.