Senior Data Engineer – Data & Analytics

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and manage data pipelines (ETL/ELT) utilizing Databricks, Azure Data Factory, and various components of the Azure ecosystem.

• Organize and model data within Data Lakes (ADLS), ensuring data quality, traceability, and governance.

• Acquire and process data from diverse sources (APIs, monthly files, corporate systems).

• Develop data solutions for:

• The PETROS Database (extraction and organization of pension data).

• Structuring RAG for the analysis of debt contracts.

• Processing quotation/price data (integration with external APIs such as CXL).

• Collateral projects (judicial deposits, financial and real guarantees).

• Reconcile purchases and sales through the analysis of structured and unstructured data.

• Assist architects in defining solutions and designing data architecture.

• Engage in gathering and detailing technical and functional requirements.

• Develop and publish APIs to expose data.

• Ensure adherence to best practices for versioning, CI/CD, and DevOps.

• Collaborate with relational databases (SQL Server, Oracle, among others).

⛳️ Requirements

• A Bachelor’s degree in IT or a postgraduate qualification in the field (minimum 360 hours).

• Extensive experience with:

• Python.

• SQL.

• Data Engineering (ETL/ELT).

• Databricks.

• Azure Data Factory.

• Azure Data Lake Storage (ADLS).

• Proficiency in data modeling.

• Understanding of DevOps and best practices for version control.

• Experience in creating and publishing APIs.

• Familiarity with cloud environments (preferably Azure).

• Additional advantages:

• Experience with SAP Datasphere or TIBCO Datasphere.

• Knowledge of ETL tools such as Knime and Informatica PowerCenter.

• Experience with SAP PowerDesigner.

• Understanding of AI solutions applied to data (e.g., RAG, analysis with LLMs).

• Background in financial data or contracts (experience in a Petrobras context is an asset).

🏝️ Benefits

• Opportunities for professional development and continuous learning.

• Collaborative work environment with a focus on innovation.

• Competitive compensation and performance-based incentives.

• Comprehensive health and wellness benefits.

• Flexible work arrangements to support work-life balance.