Senior Data Engineer – Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, direct, and manage large-scale data architectures utilizing Databricks and its fundamental features.

• Act as a Databricks Subject Matter Expert (SME), providing guidance to clients and teams on architecture, data engineering, governance, and scalable analytics.

• Formulate architectural strategies leveraging Delta Lake, Delta Live Tables, Unity Catalog, and Apache Iceberg.

• Spearhead migration and modernization projects transitioning from legacy Data Warehouse systems to Databricks Lakehouse platforms.

• Establish technical standards, best practices, and strategies for data governance, security, quality, and performance.

• Manage teams of architects and data engineers, promoting technical and strategic alignment with project goals.

• Assist in pre-sales and business development efforts by contributing to technical proposals, estimates, Statements of Work (SOWs), and architectural solutions.

• Provide technical direction for data platform implementation, modernization, and transformation initiatives.

• Oversee risks, planning, budgets, deliverables, and ensure alignment with executive stakeholders.

• Serve as a strategic consultant to clients, pinpointing opportunities for innovation and technological progress.

• Mentor professionals and disseminate knowledge about emerging technologies, data architecture, and AI/ML solutions.

⛳️ Requirements

• Significant experience in Data Engineering and Data Architecture, with a proven history of handling complex projects.

• Advanced skills and hands-on experience with the Databricks platform.

• Demonstrated experience with Delta Lake, Delta Live Tables (DLT), Unity Catalog, Lakehouse Architecture, Apache Iceberg, and table format interoperability.

• Background in designing Big Data Platforms and Cloud Data Warehouses.

• In-depth knowledge of NoSQL databases.

• Strong grasp of Object-Oriented Programming (OOP) principles.

• Familiarity with container management platforms.

• Knowledge of Artificial Intelligence and Machine Learning (AI/ML) tools and technologies.

• Proven record of defining data and AI architectures that align with business requirements and strategies.

• Consistent history of leading data platform implementation, migration, and modernization projects.

• Experience in transitioning traditional Data Warehouses to modern Databricks Lakehouse-based architectures.

• Databricks Certified Data Engineer Professional certification is a plus.

• Experience leading multiple complex Databricks implementation projects is a plus.

• Background in technical pre-sales, proposal development, and architectural solution design is a plus.

• Experience as a Lead Architect, Delivery Solution Lead, or Sales Solution Lead is a plus.

• Experience working on international projects and in technology consulting environments is a plus.

• Ability to effectively communicate with executives, clients, and multidisciplinary technical teams is a plus.

• Advanced English proficiency is a significant advantage for working in a global setting.

🏝️ Benefits

• 100% Remote

• Contract position

• Advanced English proficiency is an important advantage for working in a global environment