Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create and manage data pipelines utilizing Databricks, PySpark, and SQL.

• Design and establish data architectures within a Lakehouse framework.

• Prepare, transform, and provide data for projects involving Conversational AI, Virtual Assistants, and Intelligent Agents.

• Integrate data from SAP, APIs, databases, and various enterprise systems.

• Ensure the quality, security, governance, and traceability of data.

• Assist AI, Analytics, and Development teams in creating data-driven solutions.

• Define and advocate for best practices in data engineering and DataOps.

• Enhance the performance, scalability, and cost-effectiveness of data solutions.

⛳️ Requirements

• Strong experience in Data Engineering.

• Practical experience with Databricks.

• Familiarity with ETL/ELT processes.

• Understanding of Data Lake and Lakehouse architectures.

• Experience in analytical data modeling.

• Knowledge of the Azure Data Platform.

• Experience in data integration through APIs and enterprise systems.

• Understanding of data governance, security, and quality standards.

• Preferred: experience in developing data ecosystems for Virtual Assistants, enterprise Copilots, Intelligent Agents, and Conversational AI solutions.

• Preferred: experience with Generative AI projects.

• Preferred: familiarity with Retrieval-Augmented Generation (RAG) architecture.

• Preferred: experience in preparing data for use by LLMs and AI agents.

• Preferred: experience with Databricks Genie Room (Genie Spaces), AI/BI Genie, or similar tools.

• Preferred: knowledge of Microsoft Fabric.

• Preferred: experience with Power BI.

🏝️ Benefits

• Flash Card with a daily meal or food allowance of BRL 32.00.

• Home office allowance of BRL 100.00 per month.

• Flexible working hours.

• SulAmérica health insurance.

• Bradesco dental insurance, with the option to include dependents.

• Wellhub, TotalPass, and UniCamente, providing access to physical activities and healthcare professionals.

• Onhappy, offering discounts on accommodations, tickets, and experiences.

• Guapeco pet health insurance.

• Discount and Rewards Club.

• Extended maternity and paternity leave.

• Life insurance.

• Partnership with SESC.

• Profit-sharing bonus in accordance with the relevant union agreement.

• Birthday day off.

• No dress code.

• Continuing Education and Training Incentive Program.

• Talent Referral Program.