Data Engineer – Mid-level

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and oversee data pipelines on cloud-based big data platforms for various company sectors.

• Collect business requirements and execute technical solutions utilizing Azure and Databricks.

• Facilitate data governance and ensure data quality standards are met.

• Create and maintain data engineering pipelines on Azure and Databricks environments.

• Analyze and capture business requirements across different organizational areas, proposing effective technical data solutions.

• Conduct tests and validations on pipelines and data systems for projects of medium to high complexity.

• Monitor cloud big data systems' performance and identify areas for optimization.

• Assist in the establishment of practices for data quality, security, privacy, and governance.

• Engage in migration initiatives and the deployment of corporate data solutions.

• Develop and keep up-to-date technical documentation for pipelines, processes, and data solutions.

• Diagnose and aid in resolving technical issues within data systems.

• Guide and support junior professionals and other teams on data engineering subjects.

• Participate in meetings with internal stakeholders to present solutions, clarify technical requirements, and monitor data project progress.

⛳️ Requirements

• 2–5 years of relevant experience in the field.

• Hands-on experience with ETL/ELT tools and the creation of data pipelines.

• Familiarity with cloud platforms, particularly Azure.

• Proficient in SQL and Python programming languages.

• Expertise in SQL, Python, and PySpark.

• Knowledge of Microsoft Azure platforms including Data Factory, Databricks, and Data Lake.

• Experience in the development and upkeep of data pipelines.

• Understanding of relational and NoSQL databases.

• Basic knowledge of big data and distributed processing principles.

• Experience with Agile methodologies such as Scrum and Kanban.

• Proficiency in version control systems (Git).

• Comprehension of data governance principles and LGPD (Brazilian General Data Protection Law).

• Ability to gather and analyze business requirements effectively.

• Experience in technical documentation.

• Strong communication skills, both clear and concise.

• Collaborative and team-oriented mindset.

• Focus on results and quality outcomes.

• Adaptability and a commitment to continuous learning.

• Strong organizational and time management skills.

🏝️ Benefits

• Meal allowance (Flash - R$ 900.00 monthly).

• Bradesco Health and Dental Plan.

• Support for professional development (up to 30% reimbursement of postgraduate tuition for the first 12 months; eligible after 12 months of employment).

• Language assistance services.

• Clude Saúde (medical consultation platform).

• Day off and gift for birthdays.

• TotalPass for fitness options.

• Access to Udemy platform for continuous learning.

• Paid referral bonus (R$1,000 for each referred candidate hired).

• Merits platform (an exclusive DOMVS platform for giving and receiving merits; accumulated merits can be exchanged for vouchers like iFood, Outback, etc.).