Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and oversee dependable data pipelines that encompass data ingestion/collection, processing, integration, storage, and delivery.

• Engage in distributed systems architecture for the parallel processing of substantial data volumes (MPP).

• Integrate various disparate data sources.

• Partner with analytics and data science teams to develop data-driven solutions and create value.

⛳️ Requirements

• Practical experience with the ingestion, integration, processing, and storage of large data sets.

• Background in Big Data projects.

• Familiarity with Behavior-Driven Development (BDD).

• Proficient in data extraction using Python and data processing with PySpark.

• Experience with ETL tools.

• Understanding of relational and dimensional data modeling (Data Warehousing).

• Proficient in SQL databases.

• Experience with AWS services such as EMR, Kinesis, Redshift, S3, Glue, and Elasticsearch.

• Knowledge of Kafka.

• Familiarity with Data Lakes and DataOps.

• Preferred: knowledge of Terraform or CloudFormation.

🏝️ Benefits

• Cutting-edge environment / Innovation at our core – Engage in challenging projects alongside highly qualified specialists.

• Continuous learning – Access to discounts and partnerships with top universities and technology platforms in Brazil.

• Language learning without barriers – Benefit from special rates on language-learning platforms.

• Opportunities to work on projects involving AI, Cloud, Machine Learning, and Industry 4.0.

• Strategic partnerships with Microsoft, Oracle, AWS, and SAP.