Senior Data Engineer – Data Platform Team

This is a fully remote position, open to applicants in Spain, +1 more state.

📋 Description

• Design, develop, and manage scalable data ingestion and processing pipelines across various source systems.

• Take the lead on architectural decisions and create proposals for platform adoption.

• Enhance platform reliability, observability, and cost-effectiveness.

• Build infrastructure in close collaboration with Platform engineers.

• Work alongside analytics engineers, analysts, developers, platform engineers, and product managers to transform ambiguous data challenges into delivered solutions.

• Refine data contracts, tools, and self-service options for data consumers.

• Guide data engineers through code reviews, pairing, and design feedback.

• Promote automation and AI-assisted operations.

• Oversee architectural decisions from proposal to production.

• Deliver and manage platform systems while influencing the platform roadmap.

⛳️ Requirements

• Several years of experience in building and operating production data platforms, including data warehousing, data lakes, orchestration, ingestion, and event streaming.

• Proficient in Python and SQL.

• Strong software engineering practices, including testing, CI/CD, and code review.

• Extensive experience with Airflow, including running, scaling, and debugging the orchestrator.

• Significant experience with AWS and cloud data warehouses.

• Familiarity with Docker and Kubernetes, including deployment, inspection, and debugging of workloads.

• Experience in designing for failure, including idempotency, backfills, data quality checks, and monitoring.

• Excellent English communication skills, both spoken and written.

• Experience with streaming and message-driven architectures.

• Proactive and pragmatic approach to addressing technical challenges.

• Experience leaning towards platform operations with Kubernetes, Terraform, Docker optimization, and CI/CD, or enablement-focused experience with ingestion, dbt modeling, and data serving.

• Experience with RabbitMQ is a distinct advantage; experience with Kafka or similar technologies is also relevant.

• Experience with Spark or operationalizing ML models is a plus.

• Must be based in Spain.

• Must have the right to work in the relevant European location without visa sponsorship, as indicated in the screening questions.

🏝️ Benefits

• Flexible remuneration and benefits system through Flexoh, including restaurant card, transportation card, kindergarten, and training tax savings.

• Remote or hybrid work model with a hub located in Barcelona.

• Flexible working hours.

• Summer intensive schedule during July and August.

• 23 paid holidays, with the option to exchange local bank holidays.

• An additional paid holiday on your birthday or work anniversary.

• Private healthcare plan with Adeslas for you and subsidized for your family, covering both medical and dental care.

• Access to hundreds of gyms through Andjoy for you and your family.

• Access to iFeel online psychological support and counseling.

• Complimentary English and Spanish classes.