Data Engineer, English

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and optimize batch and streaming data pipelines.

• Modernize and enhance existing ETL processes by implementing incremental loads and scalable workflows.

• Model data according to the Medallion Architecture (Bronze/Silver/Gold).

• Manage data within the Databricks Lakehouse ecosystem: Unity Catalog, Delta Lake, and environment standards.

• Ensure quality, governance, and consistency of data within the assigned domains.

• Document processes and facilitate a smooth transition to the client's internal team.

• Collaborate with the Product Owner and other stakeholders to translate functional requirements into technical solutions.

• Participate in code reviews and adhere to best practices in development, CI/CD, and version control.

⛳️ Requirements

• Proven experience with Databricks: Lakehouse Architecture, Delta Lake, Unity Catalog.

• Strong knowledge of Python (PySpark).

• Proficiency in Spark SQL.

• Experience in batch and streaming pipelines.

• Design of incremental loads and robust ETL processes.

• Modeling in the Medallion architecture.

• Proficiency in Git and CI/CD pipelines.

• Ability to work independently and results-oriented.

• High level of English proficiency (C1).

🏝️ Benefits

• Permanent employment contract.

• Innovative projects and significant opportunities for ongoing training and professional growth (Udemy courses and certifications).

• 100% remote work in Spain with the option for a hybrid model at our offices located in the 22@ district (Barcelona).

• Complimentary beverages including coffee, water, teas, and juices, along with a weekly fruit service from Casa Ametller and a variety of snacks available in the office.

• Good work-life balance with flexible hours.

• Option for private health insurance.

• Referral bonus.

• Employee benefits in collaboration with Banco Sabadell.

• Access to the corporate benefits program with discounts at multiple recognized brands, establishments, and leisure activities.