Mid Level Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and maintain data pipelines utilizing Databricks and PySpark.

• Collaborate with Data Lake environments and apply modern data engineering principles.

• Create workflows for data ingestion, transformation, and processing.

• Integrate data from various sources and databases.

• Ensure that data pipelines are dependable, scalable, and easy to maintain.

• Use Python, Azure, and Kafka in your workflows.

• Engage with both relational and NoSQL databases, including MySQL, SQL Server, and Couchbase.

• Diagnose and resolve data pipeline issues, contributing to ongoing improvements.

• Work with international teams and stakeholders in an English-speaking setting.

⛳️ Requirements

• Proven experience in Data Engineering.

• Practical experience with Databricks and PySpark.

• Background in developing and maintaining data pipelines.

• Strong understanding of Data Lake concepts and data processing methodologies.

• Proficiency in Python.

• Familiarity with Azure.

• Knowledge of Kafka and concepts related to data streaming and integration.

• Experience with databases such as MySQL, SQL Server, or Couchbase.

• Advanced English proficiency (B2+), with effective communication skills for meetings and collaboration with international teams.

• Experience with cloud-based data platforms and contemporary data architecture (preferred).

• Background in large-scale data processing (preferred).

• Insight into data integration, streaming, and distributed processing (preferred).

• Experience working in Agile and international settings (preferred).

🏝️ Benefits

• Health and dental insurance.

• Meal and food allowance.

• Childcare support.

• Extended paternity leave.

• Access to gym partnerships and health and wellness professionals via Wellhub (Gympass) TotalPass.

• Profit sharing and results participation (PLR).

• Life insurance coverage.

• Continuous learning opportunities through CI&T University.

• Discount club access.

• Free online platform dedicated to physical, mental, and overall wellness.

• Courses on pregnancy and responsible parenting.

• Partnerships with online learning platforms.

• Language learning resources.

• Inclusion support and reasonable accommodations during the selection process.

• A dedicated Health and Well-being team, inclusion specialists, and affinity groups.