Engenheiro de Dados Sênior

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop, maintain, and optimize scalable data pipelines;

• Work with distributed processing using Apache Spark;

• Orchestrate workflows and data routines with Apache Airflow;

• Create solutions in Python while adhering to engineering best practices;

• Operate in cloud environments, particularly Microsoft Azure;

• Create and maintain deployment pipelines using CI/CD practices;

• Handle configuration files and automation in YAML/YML;

• Utilize Docker for containerizing applications and services;

• Develop, test, and document data transformation models with dbt;

• Collaborate with engineering, analytics, and business teams to ensure the quality, reliability, and performance of solutions;

• Support technical decisions regarding architecture, performance, observability, and data governance.

⛳️ Requirements

• Advanced English is a mandatory requirement, as participation in meetings, reading technical documentation, communicating with stakeholders, and recording decisions in English are necessary;

• Experience with Azure and related data services;

• Strong knowledge of Python;

• Experience with Apache Spark;

• Experience with Apache Airflow;

• Background in CI/CD practices;

• Experience in development and configuration using YAML/YML;

• Knowledge of Docker;

• Experience with dbt for data transformation and modeling;

• Familiarity with code versioning, testing, documentation, and best development practices;

• Experience in consulting projects;

• Knowledge of lakehouse architecture, data lakes, or data warehouses;

• Experience with Databricks, Azure Data Factory, Synapse, or Fabric;

• Understanding of observability, monitoring, and data quality;

• Experience with critical production environments and high-volume pipelines.

🏝️ Benefits

• Competitive salary and performance-based bonuses;

• Opportunities for professional development and training;

• Flexible working hours and remote work options;

• Health and wellness benefits;

• Collaborative and innovative work environment.