Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Collaborate with interdisciplinary teams to gather requirements for data ingestion and integration.

• Design, develop, and sustain scalable ingestion pipelines using PySpark and SQL.

• Construct and enhance ETL/ELT workflows that adhere to Medallion Architecture principles.

• Integrate data from various sources into enterprise data lake environments.

• Ensure the quality, integrity, reliability, and performance of data across ingestion processes.

• Align local ingestion workflows with the global platform’s standards and governance.

• Monitor, troubleshoot, and enhance ingestion pipelines and data workflows.

• Document the processes and technical implementations related to data ingestion.

• Provide support to stakeholders and offer technical advice when necessary.

• Keep abreast of contemporary data engineering methodologies and technologies such as Delta Sharing, Lakeflow Connect, and REST APIs.

⛳️ Requirements

• Demonstrated experience as a Data Engineer or in a similar position with a focus on data ingestion and transformation.

• Practical experience with Databricks and Medallion Architecture.

• Strong expertise in PySpark and SQL.

• Experience with Data Lakes and concepts of modern data platforms.

• Excellent analytical and problem-solving abilities.

• Capability to operate both independently and collaboratively in global settings.

• Proficient English communication skills, both written and spoken.

• Familiarity with cloud platforms (Azure is an advantage).

🏝️ Benefits

• Health and dental insurance.

• Meal and food allowance.

• Childcare assistance.

• Extended paternity leave.

• Partnership with gyms and health and wellness professionals through Wellhub (Gympass) TotalPass.

• Profit Sharing and Results Participation (PLR).

• Life insurance.

• Continuous learning platform (CI&T University).

• Discount club.

• Free online platform dedicated to physical, mental, and overall well-being.

• Pregnancy and responsible parenting course.

• Partnerships with online learning platforms.

• Language learning platform.

• And many more!