Data Engineer – Azure, Python, Intelligent Automation

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Construct the data engines that empower agents, encompassing incident provision calculations, hour reconciliations, and the aggregation of tracking metrics.

• Create Python and SQL ingestion and transformation pipelines utilizing corporate APIs (ITSM, backlog management, ERP, and job schedulers) along with files.

• Design and facilitate data availability for agent consumption and reporting, ensuring quality, version control, and source traceability.

• Organize document repositories for RAG by extracting job workflows, API contracts, and technical documentation, publishing them in Confluence, and indexing them in Azure AI Search.

• Maintain the quality, observability, and performance of production pipelines through data testing and alert systems.

• Assist in the development of Python parsers and validators, including the analysis of SQL query syntax for secure approvals.

• Engage in the squad’s technical decisions and code reviews, contributing to the enhancement of CI/CD standards in Azure DevOps.

• Collaborate on the creation of data engineering solutions and AI agents within a global corporate setting.

• Facilitate the automation of operational services utilizing agent frameworks and Azure technologies.

⛳️ Requirements

• 4 to 5 years of experience in data engineering.

• Proficient in Python and advanced SQL for pipelines, reconciliations, and business calculations.

• Hands-on experience with Azure data services: Azure Data Lake Storage Gen2, Azure Data Factory, Azure Functions, or Databricks.

• Experience in integrating data through REST APIs, including aspects of authentication, pagination, and idempotency.

• Understanding of data modeling and reconciliation across various sources, including handling discrepancies.

• Practical knowledge of CI/CD, version control, and pipeline observability.

• Familiarity with data governance including quality, cataloging, and source traceability.

• Azure certifications (DP-203 Azure Data Engineer Associate or DP-900 Azure Data Fundamentals) — a plus.

• Experience with financial or controlling data, such as provisions and month-end closing — a plus.

• Knowledge of generative AI applied to data, including preparing repositories for RAG, embeddings, and semantic search in Azure AI Search — a plus.

• Experience with enterprise job schedulers (Control-M) and the extraction of job workflow documentation — a plus.

• Utilization of AI agents in engineering workflows (GitHub Copilot, Claude Code, Cursor) — a plus.

• Experience in regulated financial-sector environments (LGPD, BACEN) — a plus.

🏝️ Benefits

• Flexible benefits card – choose how and where to use it.

• Scholarships for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance reviews with a structured career development plan.

• International career opportunities.

• Wellhub and TotalPass.

• Private pension plan.

• Childcare assistance.

• Health insurance.

• Dental insurance.

• Life insurance.

• A safe workplace committed to diversity, equality, and inclusion.

• A development and growth culture based on Continuous Scaled Learning.