Data Engineer, Senior

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and oversee dependable data pipelines that include ingestion/collection, processing, integration, storage, and ensuring data accessibility throughout the organization.

• Operate within a distributed systems framework for massively parallel (MPP) data processing, integrating various heterogeneous data sources while partnering with analytics and data science teams to create solutions and provide data-driven insights.

⛳️ Requirements

• Practical experience with the ingestion, integration, processing, and storage of large data volumes;

• Background in Big Data projects;

• Proficiency in Behavior Driven Development (BDD);

• Data extraction using Python and data processing with PySpark;

• Familiarity with ETL tools;

• Understanding of relational and dimensional data modeling (Data Warehouse);

• Experience with SQL databases;

• Proficient with AWS Big Data tools including EMR, Kinesis, Redshift, S3, Glue, and Elasticsearch;

• Knowledge of Kafka;

• Familiarity with Data Lake and DataOps;

• Experience in Data Science;

• Preferred but not required: AWS certifications;

• Experience with infrastructure-as-code tools for cloud provisioning such as Terraform and CloudFormation.

🏝️ Benefits

• Swile flexible card for personal use (meal and food allowance)

• Totalpass or Gympass

• Mental health support through Psicologia Viva

• Bradesco health plan

• Bradesco dental plan

• Profit-sharing opportunities

• Childcare support for our mothers

• Incentives for certifications

• Access to special talks and webinars

• RAF referral bonus program

• Life insurance coverage

• Subsidy for English or Italian lessons

• Discounts at Open English

• Birthday gifts

• Opportunities for relocation to another country

• Partnerships with universities