Engenheiro de Dados

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Responsible for creating integrations

• Building ingestion pipelines

• Developing transformation processes that move data from the source to the consumption layers

• Extracting raw data from Gobrax's current platforms: HubSpot, Odoo, Omie, CHS, and the V3 platform database

• Developing standardization logic, quality validation, deduplication, and entity relationship in the Silver layer

⛳️ Requirements

• Proficiency in developing pipelines using Apache Spark

• Knowledge in batch processing and real-time streaming

• Practical experience with Apache Kafka and Amazon Kinesis

• Mastery of Python, Scala, and advanced SQL

• Familiarity with CSV, JSON, and TXT formats

• Technical capability to extract data from HubSpot, Odoo, Omie, CHS, and the V3 platform database

• Ability to develop standardization, quality validation, deduplication, and entity relationship

• Experience with AWS data services and storage

🏝️ Benefits

• Competitive salary

• Health and dental insurance

• Opportunities for professional development

• Flexible working hours

• Remote work options