Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, implement, and maintain cloud-based data solutions and environments utilizing Azure.

• Construct, monitor, and enhance data pipelines to guarantee efficiency, scalability, and dependability.

• Leverage Azure Databricks and PySpark for processing and transforming large datasets.

• Collaborate with distributed processing and integrate multiple data sources.

• Ensure data quality, integrity, security, and governance in compliance with relevant policies and regulations.

• Discover opportunities to enhance performance, automation, and data architecture.

• Assess new technologies, trends, and best practices in the field of Data Engineering.

⛳️ Requirements

• Extensive experience in development with Python, SQL, and PySpark.

• Understanding of Big Data and distributed processing technologies such as Hadoop and Hive.

• Proficiency with Microsoft Azure and Azure Databricks.

• Experience in building, maintaining, and enhancing data pipelines within Azure environments.

• Knowledge of data governance, security, and quality standards.

• Familiarity with Azure DevOps, version control, and continuous integration methodologies.

• Proven experience working within Agile teams.

• Microsoft Azure Data Engineer Associate certification (DP-203) — preferred.

• Experience in optimizing performance and cost-efficiency in Big Data contexts — preferred.

• Awareness of best practices in architecture, automation, and pipeline observability — preferred.

• Background in projects related to modernizing and evolving cloud data platforms — preferred.

🏝️ Benefits

• Employment under Brazil’s CLT labor regime.

• Meal voucher (VR).

• Food allowance (VA).

• Health insurance.

• Dental insurance.

• Life insurance.

• 100% remote work.