Senior Data Engineer, Databricks

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design and develop scalable cloud-based data architectures, focusing on performance, security, reliability, and cost optimization.

• Lead the implementation of best practices in data engineering using Databricks, Apache Spark, and modern data platform technologies.

• Create reusable ingestion frameworks and reference patterns for integrating enterprise applications, APIs, streaming platforms, and external sources.

• Build, maintain, and optimize data pipelines, platform services, and reference implementations.

• Provide technical guidance and mentor teams in ETL/ELT processes, data engineering standards, and platform capabilities.

• Implement data governance, cataloging, and quality monitoring to ensure reliable and well-documented datasets.

• Collaborate with Data Architects, Data Scientists, Analysts, and business areas to transform requirements into scalable technical solutions.

• Contribute to the continuous improvement of the data platform, development standards, and operational excellence.

⛳️ Requirements

• Over 5 years of hands-on experience in Data Engineering and Big Data environments.

• Extensive experience with Databricks and Apache Spark (PySpark).

• Experience in designing and implementing data solutions on Microsoft Azure.

• Strong knowledge of SQL and Python, applying clean code principles and object-oriented programming.

• Experience with Azure Event Hubs and Kafka.

• Solid understanding of dimensional modeling and Data Warehouse design principles.

• Experience in building scalable, reliable, and maintainable cloud-native data platforms.

• Excellent communication skills and stakeholder management abilities.

• Ability to influence and guide teams without direct responsibility for project delivery.

• Proactive profile, solution-oriented, and committed to continuous improvement.

• Advanced English proficiency.

• Experience with Databricks Lakehouse architecture, Delta Lake, Unity Catalog, Databricks Workflows, Data Governance, and DataOps is a plus.

• Databricks certifications, such as Databricks Certified Data Engineer Associate or Professional, will be valued.

🏝️ Benefits

• Permanent contract.

• Remote work.

• Internal training and access to certifications.

• Flexible compensation plan: health insurance, transportation, childcare tickets, and meal tickets.

• Referral program with financial compensation for recommendations.

• Events, meetups, tech days, and talks.

• 26 days of leave: 22 vacation days, 2 personal days, and public holidays on December 24 and 31 by default.

• Flexible hours: 8:30 AM to 6:00 PM from Monday to Thursday and 8:00 AM to 3:00 PM on Fridays.

• Intensive summer schedule in July and August, from 8:00 AM to 3:00 PM.