Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, construct, and implement high-quality, high-performance data pipelines in Azure utilizing ADF, Synapse, and Databricks, as well as on-premises platforms when necessary.

• Maintain and support existing data pipelines through proactive monitoring, incident management, problem ticket resolution, troubleshooting, bug fixing, and enhancements to architecture and code.

• Engage in the Data Validation process.

• Ensure that systems comply with business and non-functional requirements, including performance, security, privacy, and GDPR/LGPD regulations.

• Incorporate new data management and software engineering technologies into existing data architectures.

• Analyze and structure raw data; ingest, transform, and make data accessible in data lakes and data marts.

• Collaborate with BI, Data Science, and Software Engineering teams to document and provide consistent data solutions.

⛳️ Requirements

• Strong experience in the Azure Cloud data ecosystem, emphasizing ADF, Synapse, Databricks/Spark, and ADLS.

• Development of reports with Reporting Services and dashboards utilizing Power BI.

• Experience in designing, building, and testing ETL/ELT data pipelines, ensuring both performance and reliability.

• Willingness to learn and integrate new frameworks and cloud-native technologies.

• Capability to share knowledge with junior team members.

• Familiarity with the Microsoft SQL Server technology stack.

• Extensive experience in Dimensional Modeling and strong SQL expertise for constructing Data Marts and Data Warehouses.

• Contribution to technical references, assistance in defining data standards, and involvement in code reviews.

• Practical understanding of Software Engineering principles, including advanced Git usage with branches and pull requests.

• Experience in implementing and maintaining CI/CD for data solutions.

• Knowledge of unit, integration, and end-to-end testing.

• Azure or AWS cloud certification is a plus.

• Familiarity with Data Catalog and Lineage processes and tools, such as Azure Purview, is a plus.

• Experience with Python or Scala for scripting and automating data processes is a plus.

• Familiarity with orchestration tools like Airflow is a plus.

🏝️ Benefits

• Health and dental insurance.

• Meal and food allowance.

• Childcare assistance.

• Extended paternity leave.

• Partnerships with gyms and health and wellness professionals through Wellhub (Gympass) TotalPass.

• Profit Sharing and Results Participation (PLR).

• Life insurance.

• Access to a continuous learning platform (CI&T University).

• Discount club.

• Free online platform focused on physical, mental, and overall well-being.

• Courses on pregnancy and responsible parenting.

• Collaborations with online learning platforms.

• Language learning platform.

• A dedicated health and well-being team, inclusion specialists, and affinity groups.

• Support and accommodations for individuals with disabilities during the selection process.