Senior Data Engineer – Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and uphold data pipelines.

• Integrate and manipulate data from APIs, relational databases, files, and various other sources.

• Spearhead the design and creation of robust data pipelines.

• Work collaboratively with business and analytics teams to comprehend data requirements.

• Partner with data scientists, analysts, and platform engineers.

• Guarantee the quality, reliability, security, and governance of ingested data.

• Adhere to contemporary DataOps practices such as code versioning, data testing, and CI/CD.

• Document data engineering workflows and best practices.

• Offer technical guidance and mentorship to peers.

• Deliver high-quality data solutions that align with the strategic objectives of the organization.

⛳️ Requirements

• Demonstrated experience in constructing and overseeing large-scale data pipelines using Databricks (PySpark, Delta Lake, SQL).

• Strong programming capabilities in Python and SQL for data processing and transformation tasks.

• Profound knowledge of ETL/ELT frameworks, data warehousing, and distributed data processing.

• Practical experience with modern DataOps practices, including version control (Git), CI/CD pipelines, automated testing, and infrastructure-as-code.

• Familiarity with cloud platforms (AWS, Azure, or GCP) and their associated data services.

• Strong analytical abilities to resolve performance, scalability, and reliability challenges.

• Proficiency in Git.

• Advanced English language skills are essential.

🏝️ Benefits

• Health and dental insurance.

• Meal and food allowance.

• Childcare assistance.

• Extended paternity leave.

• Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass.

• Profit Sharing and Results Participation (PLR).

• Life insurance.

• Continuous learning platform (CI&T University).

• Discount club.

• Free online platform dedicated to physical, mental, and overall well-being.

• Pregnancy and responsible parenting course.

• Partnerships with online learning platforms.

• Language learning platform.

• Health and well-being team, inclusion specialists, and affinity groups.

• Support and accommodations for individuals with disabilities during the selection process.