Data Engineer, English

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and optimize batch and streaming data pipelines.

• Modernize and enhance existing ETL processes by implementing incremental loads and scalable workflows.

• Model data following the Medallion Architecture (Bronze/Silver/Gold).

• Manage data within the Databricks Lakehouse ecosystem: Unity Catalog, Delta Lake, and environmental standards.

• Ensure data quality, governance, and consistency within the assigned domains.

• Document processes and prepare for a smooth handover to the client's internal team.

• Collaborate with the Product Owner and other stakeholders to translate functional requirements into technical solutions.

• Participate in code reviews and adhere to best practices in development, CI/CD, and versioning.

⛳️ Requirements

• Proven experience with Databricks: Lakehouse Architecture, Delta Lake, Unity Catalog.

• Strong knowledge of Python (PySpark).

• Proficiency in Spark SQL.

• Experience with batch and streaming pipelines.

• Design of incremental loads and robust ETL processes.

• Modeling within the Medallion architecture.

• Proficient in Git and CI/CD pipelines.

• Ability to work independently and results-oriented.

• High proficiency in English (C1).

🏝️ Benefits

• Permanent employment contract.

• Innovative projects and significant opportunities for continuous training and professional growth (Udemy courses and certifications).

• 100% remote work in Spain with an option for a hybrid model at our offices located in the 22@ district (Barcelona).

• Free beverages such as coffee, water, teas, and juices, along with a weekly fruit service from Casa Ametller and a variety of snacks available in the office.

• Good work-life balance with flexible hours.

• Option for private health insurance.

• Referral bonus.

• Employee benefits in partnership with Banco Sabadell.

• Access to the corporate benefits program offering discounts at multiple recognized brands, establishments, and leisure activities.