Senior Data Engineer – Databricks

This is a fully remote position, open to applicants in Spain.

📋 Description

• Execute intricate data engineering projects across various industries, either independently or by leading small project teams.

• Engage in dynamic projects that typically span 2 to 4 months.

• Utilize Apache Spark and Databricks on AWS or Azure platforms.

• Manage customer relationships directly, either alone or in collaboration with a Project Manager.

• Assist in the pre-sales process.

• Provide mentorship to junior engineers.

• Contribute to the recruitment of top-tier data talent.

• Address data engineering, machine learning, MLOps, and cloud migration challenges for clients in EMEA and the US.

• Design data architectures and assist clients in the adoption of new technologies.

⛳️ Requirements

• Ideally, possess over 5 years of experience in Data Engineering, with a focus on cloud platforms such as AWS, Azure, or GCP.

• Demonstrated experience with Databricks, including skills in PySpark, SQL, Delta Lake, and Unity Catalog.

• Significant expertise in developing ETL/ELT processes and orchestrating data pipelines using tools like Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.

• Proficient in SQL and Python.

• Familiarity with CI/CD pipelines and Infrastructure as Code using Terraform, CloudFormation, or Bicep.

• Practical experience in integrating Databricks with BI tools such as Power BI, Tableau, or Looker.

• A proven consulting background in scoping, requirements gathering, solution design, and stakeholder communication; experience in product companies is acceptable if complemented by a consulting mindset and customer-facing interest.

• Successful execution of Data Lakehouse implementations and cloud data migrations.

• Capability to articulate technical concepts to non-technical audiences and facilitate decision-making.

• Willingness to immediately contribute to ongoing client projects.

• Adaptability, problem-solving skills, resilience, and the capacity to excel in a fast-paced consulting environment.

• Excellent written, verbal, and stakeholder communication abilities.

• Currently unable to provide transfer or full sponsorship for Skilled Worker visas in Spain.

🏝️ Benefits

• Fully remote work setup in Spain, including one month at the Budapest hub during onboarding and office visits every quarter for one week.

• Access to both public and internal Databricks courses.

• Coverage for various data and cloud certifications.

• Designated learning time during work hours.

• Access to an internal library.

• Flexible paid time off (PTO) days.

• Fully paid medical leave for up to 15 days each year.

• Comprehensive private health insurance provided by Allianz.

• Employee Assistance Program offering psychological, financial, and legal consulting services.

• MacBook Pro provided.

• €500 gross sign-up bonus for home-office equipment setup.

• High-transparency culture fostering open feedback and minimal office politics.

• Opportunity to make a significant impact and help shape the future of a rapidly growing technology company.