Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and sustain scalable, high-performance data pipelines.

• Manage data ingestion, transformation, and delivery for analytical use.

• Collaborate with data architecture within a cloud-based environment.

• Create data engineering solutions utilizing Databricks.

• Employ Azure Data Factory to orchestrate data pipelines.

• Ensure the quality, governance, and performance of data.

• Design and oversee ETL/ELT processes.

• Monitor activities related to data integration and processing.

• Identify opportunities for performance and efficiency enhancements.

• Partner with Engineering, Analytics, and Business teams to gather requirements.

• Convert business needs into effective data solutions.

• Participate in the development, enhancement, and support of data solutions for the Tax Reform project.

• Assist in integrating and delivering data for analysis and utilization by relevant teams.

⛳️ Requirements

• Proven experience in Data Engineering.

• Familiarity with Databricks for data processing and engineering tasks.

• Proficient in using Azure Data Factory for orchestrating data pipelines.

• Strong knowledge of SQL and data modeling techniques.

• Experience with Python or Spark (PySpark).

• Background in cloud environments, preferably Azure.

• Understanding of ETL/ELT methodologies.

• Knowledge of data integration processes.

• Capability to develop and maintain scalable data pipelines.

• Familiarity with data quality, governance, and performance standards.

• Experience with contemporary data architectures, including Data Lake and Lakehouse.

• Knowledge of data governance and quality assurance.

• Experience handling large datasets.

• Relevant Databricks certifications, such as Databricks Certified Data Engineer Associate/Professional, Databricks Certified Data Analyst Associate, and Databricks Certified Machine Learning Associate/Professional.

• Experience in sectors such as finance, banking, insurance, or accounting.

• Understanding of Data Management principles.

• Familiarity with Data Analysis techniques.

• Analytical and problem-solving oriented.

• Proactive in identifying areas for improvement.

• Well-organized with a keen focus on data quality.

• Excellent communication skills.

• Ability to collaborate effectively with multidisciplinary teams.

• Capability to comprehend both technical and business requirements.

• Strong commitment to quality and timely delivery.

• Ability to thrive in complex environments with large volumes of data.

🏝️ Benefits

• Multi-benefit card – choose how and where to utilize it.

• Educational grants available for undergraduate, postgraduate, MBA, and language courses.

• Incentive programs for certifications.

• Flexible working hours.

• Competitive salary packages.

• Annual performance reviews with a structured career development plan.

• Opportunities for an international career.

• Access to Wellhub and TotalPass.

• Private pension scheme.

• Childcare support.

• Comprehensive medical insurance.

• Dental coverage.

• Life insurance protection.