Senior Data Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and enhance large-scale data pipelines utilizing Apache Spark and Python/PySpark.

• Construct dependable, reusable, and well-organized datasets for both business and analytical use.

• Build and sustain cloud-based data solutions on Microsoft Azure.

• Efficiently process, transform, store, and expose data across various platforms and applications.

• Establish data quality controls, validation procedures, monitoring, and documentation standards throughout data pipelines.

• Collaborate with teams in Data Engineering, Data Science, Architecture, and business to grasp requirements and deliver effective data solutions.

• Contribute to engineering best practices concerning code quality, testing, version control, CI/CD, and automation.

• Implement data governance, cataloging, and quality monitoring practices.

• Engage in designing scalable cloud-based data architectures.

⛳️ Requirements

• Over 5 years of experience in Data Engineering.

• More than 5 years of practical experience with Apache Spark using Python/PySpark in production settings.

• Demonstrated experience in building and maintaining production-grade data pipelines within large-scale or complex data ecosystems.

• Strong understanding of dimensional data modeling and data warehouse design principles.

• Experience in designing scalable cloud-based data architectures.

• Ability to provide technical guidance and support regarding ETL/ELT best practices and data engineering standards.

• Nice to have: experience with Databricks, Delta Lake, Unity Catalog, and Databricks Workflows.

• Nice to have: hands-on experience in delivering data engineering solutions using Azure Databricks.

• Nice to have: familiarity with data governance and data cataloging frameworks.

🏝️ Benefits

• Permanent contract.

• Remote work model; office attendance is always optional and at the employee's discretion.

• Flexible working hours and intensive Fridays.

• Intensive working hours during July and August.

• 22 vacation days plus 2 personal days.

• December 24th and 31st off.

• Option for 12 or 14 payments.

• Flexible compensation options including restaurant card, childcare voucher, health insurance, training, and other tax-advantaged benefits.

• Discounts on technology, leisure activities, and training.

• Access to Udemy Business, language courses, official certifications, and technical training.

• Career planning and support for professional growth, specialization, or new challenges.

• Nutrition programs, physical activity initiatives, and emotional balance support.

• 24/7 personal and family support.

• A diverse and multicultural environment.

• Social events and team-building activities.