Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and sustain data engineering pipelines utilizing Azure and Databricks platforms

• Collect and evaluate business requirements across various departments within the organization

• Recommend technical data solutions that align with both operational and strategic objectives

• Conduct testing and validation of pipelines and data systems with medium to high complexity

• Oversee the performance of cloud big data systems and pinpoint areas for optimization

• Uphold practices related to data quality, security, privacy, and governance

• Engage in migration projects and the implementation of enterprise-level data solutions

• Develop and maintain technical documentation for pipelines, processes, and data solutions

• Diagnose and assist in resolving technical issues

• Guide less experienced professionals and provide support to other teams on data engineering topics

• Attend meetings with internal stakeholders to present solutions, clarify requirements, and monitor project progress

⛳️ Requirements

• Proficiency in programming languages: SQL, Python, and PySpark

• Familiarity with Microsoft Azure platforms (Data Factory, Databricks, Data Lake)

• Experience in the development and maintenance of data pipelines (ETL/ELT)

• Knowledge of relational and NoSQL databases

• Understanding of big data fundamentals and distributed processing

• Experience with Agile methodologies (Scrum, Kanban)

• Proficient in version control systems (Git)

• Awareness of data governance concepts and LGPD (Brazilian General Data Protection Law)

• Skills in eliciting and analyzing business requirements

• Ability to produce technical documentation

• Strong communication skills, clear and concise

• Commitment to teamwork and collaboration

• Focused on results and quality

• Adaptable with a mindset for continuous learning

• Strong organizational and time management skills

🏝️ Benefits

• Meal voucher and/or food allowance (iFood Benefícios)

• Medical insurance (Amil)

• Life insurance

• Dental insurance (Amil)

• Fuel allowance

• Gympass/Wellhub: Access to gyms offering various training modalities

• Pet health plan

• Childcare assistance

• Lincard: Partnership program providing discounts of up to 60% at over 4,000 establishments in Brazil