Data Engineer, Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Oversee data environments and processes in both Azure and on-premises settings, ensuring consistent and dependable operation;

• Provide advanced administration and support for Databricks (Azure), including troubleshooting and optimizing operations;

• Monitor and manage pipelines, jobs, integrations, and data routines with a focus on preventive and corrective measures;

• Implement solutions and enhancements to current processes, concentrating on root cause analysis and minimizing recurrence;

• Lead incident management and resolution efforts (SLA adherence, prioritization, communication, and follow-up until stabilization);

• Assist BI and development teams, ensuring environments are adequately prepared for new releases and requirements;

• Continuously advance and refine DataOps/CI-CD pipelines for data (governance, quality, and reliability);

• Collaborate with infrastructure and architecture teams as necessary (capacity, access, security, network, performance);

• Ensure compliance with best practices for security, governance, and compliance within the data context;

• Suggest and implement enhancements to observability, monitoring, and alert systems (metrics, logs, traceability).

⛳️ Requirements

• Extensive experience in Data Engineering with an emphasis on support and operations (not solely on greenfield projects);

• Strong proficiency with Databricks, including troubleshooting and maintaining jobs and pipelines;

• Experience with cloud environments, preferably Microsoft Azure;

• Proven experience supporting pipelines, integrations, and data processes in a production environment;

• Familiarity with monitoring, incident management, and problem management (SLA, prioritization, response, and post-incident processes).

🏝️ Benefits

• Competitive salary and performance-based bonuses;

• Opportunities for professional growth and development;

• Flexible work environment and remote options;

• Comprehensive health and wellness benefits;

• Collaborative and innovative team culture.