Data Engineer – Mid-Level

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and oversee dependable data pipelines that encompass data ingestion/collection, processing, integration, storage, and delivery throughout the organization.

• Operate within a distributed systems architecture designed for massively parallel processing (MPP) of extensive datasets.

• Integrate various heterogeneous data sources.

• Partner with analytics and data science teams to create data-driven solutions that deliver value.

⛳️ Requirements

• Practical experience in ingesting, integrating, processing, and storing substantial volumes of data.

• Background in working on Big Data initiatives.

• Familiarity with Behavior-Driven Development (BDD).

• Proficiency in data extraction using Python and data processing with PySpark.

• Experience with ETL tools.

• Understanding of relational and dimensional data modeling (Data Warehouse).

• Competence in SQL databases.

• Familiarity with AWS Big Data services and tools, including EMR, Kinesis, Redshift, S3, Glue, and Elasticsearch.

• Knowledge of Kafka.

• Acquainted with Data Lakes and DataOps.

• AWS certifications are preferred and considered an advantage.

• Understanding of Terraform or CloudFormation is preferred and considered a plus.

🏝️ Benefits

• Innovative environment / Innovation is part of our DNA – Engaging projects alongside specialized professionals.

• Ongoing education – Discounts and partnerships with top universities and tech learning platforms in Brazil.

• Language learning made easy – Special rates on language-learning platforms.

• Flexible Swile card for your personal use (meal and food allowances).

• Access to TotalPass or Gympass.

• Mental health support through Psicologia Viva.

• Bradesco Health Insurance.

• Bradesco Dental Insurance.

• Profit-sharing plan.

• Childcare support for mothers.

• Incentives for certifications.

• Special talks and webinars.

• RAF referral bonus program.

• Life insurance coverage.

• Allowance for English or Italian language learning.

• Discount on Open English.

• Birthday gift.

• Opportunity for relocation to another country.

• Partnerships with universities.