Big Data Developer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and maintain data lake pipelines utilizing Apache Spark, Scala, and SQL.

• Create and uphold scalable data processing solutions for handling large data volumes.

• Manage batch workflows and dependencies through Control-M and Airflow.

• Execute data ingestion, transformation, validation, and publication processes tailored for Market Risk use cases.

• Evaluate and enhance Spark workload performance, reliability, and scalability.

• Analyze technical and functional requirements, identify gaps, and suggest solutions.

• Participate in delivery planning and collaborate with various teams.

• Assist with production incidents and conduct root-cause analysis.

• Contribute to the continuous improvement of operational processes.

• Work alongside Agile squads, functional teams, and production support teams.

• Implement software engineering and data development best practices.

⛳️ Requirements

• Over 2 years of professional experience in Big Data, Data Lakes, or cloud-based data platforms.

• Strong hands-on expertise with Apache Spark, Scala, and SQL for large-scale data processing.

• Solid understanding of Data Lake architecture, data quality controls, data lineage, and production-grade data pipelines.

• Excellent analytical and problem-solving capabilities.

• Outstanding communication and teamwork skills.

• Ability to collaborate effectively with technical and functional stakeholders.

• Adaptability and a proactive approach to addressing technical challenges.

• Proficient in English at a C1 level or equivalent professional fluency.

• Experience with Control-M and Airflow is highly valued.

• Familiarity with Databricks, Azure, and AWS is highly valued.

• Experience with YARN and cloud-based computing environments is highly valued.

• Knowledge of CI/CD and software engineering practices, including GitHub, Jenkins, and SonarQube, is highly valued.

• Experience with banking production environments, operational monitoring, and incident management tools such as ServiceNow is highly valued.

• Understanding of Market Risk processes, including P&L, valuations, risk metrics, and regulatory reporting data flows, is highly valued.

• Proficiency in Spanish is considered a plus.

🏝️ Benefits

• Full-time, permanent employment contract.

• Opportunities for professional growth and career development.

• Access to continuous learning resources.

• A multicultural and international work environment.

• Private medical insurance.

• Life insurance.

• Lunch and transport cards through a flexible remuneration program.

• Online language classes.

• Smart Office Pack to enhance the remote working experience.

• 100% remote work with the flexibility to work from any location.