Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and improve scalable data platforms that support analytical and strategic efforts.

• Create, build, and sustain scalable, resilient, and high-performance data pipelines.

• Manage large sets of both structured and unstructured data.

• Ensure the quality, consistency, and governance of data throughout its entire lifecycle.

• Establish processes for data ingestion, transformation, and delivery.

• Work collaboratively with software engineers, data analysts, data scientists, and business stakeholders.

• Engage in defining data architectures and assessing new technologies and tools.

• Oversee and optimize data processing workflows in distributed settings.

• Support initiatives for data platform modernization and advancement.

⛳️ Requirements

• Extensive experience in Data Engineering within distributed environments.

• Advanced proficiency in Apache Spark and Scala.

• Familiarity with AWS services including Glue, S3, EMR, Athena, and Redshift.

• Understanding of data modeling, ETL/ELT processes, and data pipeline development.

• Knowledge of both relational and NoSQL databases.

• Experience in batch and streaming data processing.

• Awareness of best practices for data quality, security, and governance.

• Proficient in code version control using Git.

• Preferred: experience with Apache Kafka or Amazon MSK.

• Preferred: knowledge of modernizing legacy systems.

• Preferred: hands-on experience with Delta Lake, Apache Hudi, or Apache Iceberg.

• Preferred: familiarity with DataOps and CI/CD tools for data, such as dbt, Airflow, and Terraform.

• Preferred: experience with Lakehouse architectures.

• Preferred: working experience in high-volume data environments.

• Preferred: understanding of observability and monitoring for data pipelines.

• Enjoy being part of a team and exhibit a collaborative mindset.

• Strong analytical and problem-solving abilities.

• Capability to work independently and manage your own schedule.

• Keen interest in tackling challenging and innovative scenarios in the technological landscape.

🏝️ Benefits

• Multi-benefit card – select how and where to utilize it.

• Educational scholarships for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance evaluations accompanied by a structured career development plan.

• Opportunities for international career advancement.

• Wellhub and TotalPass access.

• Private pension plan.

• Childcare support.

• Medical insurance.

• Dental insurance.

• Life insurance.