Senior Data Engineer – Databricks, ADF, AI

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Execute data modeling utilizing technologies such as Databricks, SAP Datasphere, Azure Data Factory, Azure Data Lake Storage (ADLS), Python, and various databases (SQL Server, Oracle);

• Extract data from monthly received files, constructing a data lake and associated tables;

• Organize RAG for the client's debt contracts and other relevant documents concerning loan agreements;

• Conduct ETL processes from CXL APIs and transform them for integration into Databricks databases to support CXL quotes;

• Arrange data tables in Databricks for Judicial Deposits, Financial Guarantees, and Collateral;

• Develop ETL workflows for the analysis of both structured and unstructured data, leveraging the client's chat API to review files and validate information;

• Create the Position Manager data product and generate reports to replace CXL's Crystal Reports;

⛳️ Requirements

• Familiarity with Databricks, SAP Datasphere, Azure Data Factory, Azure Data Lake Storage (ADLS), and databases (SQL Server, Oracle);

• Capability to assess requirements to aid Architects in organizing and detailing requests;

• Understanding of ETL tools and data modeling techniques;

• Proficiency in assisting with requirement definition;

• Demonstrated experience in Python;

• Experience in API development and deployment;

• Knowledge of DevOps practices;

• A minimum of 4 years of documented professional experience (formal employment records), along with an academic degree in IT or a postgraduate IT program of at least 360 accredited hours;

🏝️ Benefits

• Competitive salary and performance-based bonuses;

• Opportunities for professional development and training;

• Flexible work hours and the possibility of remote work;

• Comprehensive health and wellness benefits;

• Inclusive company culture and team-building activities;