Mid-Level Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Oversee data environments and processes in both Azure and on-premises settings, ensuring consistent and dependable operations.

• Offer administration and advanced assistance for Databricks on Azure, including troubleshooting and operational modifications.

• Monitor and manage pipelines, jobs, integrations, and data routines with a focus on preventive and corrective measures.

• Execute fixes and enhancements to current processes, identifying root causes to minimize recurrence.

• Spearhead incident management and resolution, including SLA oversight, prioritization, communication, and follow-up until stabilization.

• Assist BI and development teams by ensuring environments are prepared for new releases and requirements.

• Continuously refine and advance DataOps and CI/CD pipelines for data, emphasizing governance, quality, and reliability.

• Collaborate with infrastructure and architecture teams as needed regarding capacity, access, security, networking, and performance.

• Ensure adherence to security, governance, and compliance best practices within the data environment.

• Suggest and implement enhancements to observability, monitoring, and alerting, including metrics, logs, and traceability.

⛳️ Requirements

• Mid-level experience in Data Engineering, emphasizing production support and operations rather than solely greenfield projects.

• Strong proficiency in Databricks, including troubleshooting and supporting jobs and pipelines.

• Experience in cloud environments, preferably Microsoft Azure.

• Familiarity with supporting pipelines, integrations, and data processes in a production environment.

• Knowledge of monitoring, incident management, and problem management, including SLA management, prioritization, response, and post-incident activities.

• Extensive experience in data projects, pipeline development and support, data integration, data modeling, and working in analytics environments.

• A degree in Information Technology and/or Data Engineering.

🏝️ Benefits

• Comprehensive health benefits package.

• Opportunities for professional development and career advancement.

• Flexible working arrangements, including remote work options.

• Collaborative and inclusive work environment.