Big Data Developer

This is a fully remote position, open to applicants in Argentina.

📋 Description

• Design, develop, and maintain data lake pipelines utilizing Apache Spark, Scala, and SQL.

• Construct and uphold scalable data processing solutions to handle large volumes of data.

• Manage batch workflows and dependencies using tools like Control-M and Airflow.

• Execute data ingestion, transformation, validation, and publication processes for Market Risk scenarios.

• Evaluate and enhance the performance, reliability, and scalability of Spark-based workloads.

• Assess technical and functional requirements, identify gaps, and propose effective solutions.

• Contribute to delivery planning and collaborate with various teams to guarantee successful implementation.

• Assist in production incidents, conduct root-cause analysis, and contribute to the continuous improvement of operational processes.

• Collaborate closely with Agile squads, functional teams, and production support teams to deliver high-quality solutions and business value.

• Adhere to software engineering and data development best practices to ensure robust, maintainable, and production-ready solutions.

⛳️ Requirements

• A minimum of 2 years of professional experience in Big Data, Data Lakes, or cloud-based data platforms.

• Strong hands-on experience with Apache Spark, Scala, and SQL for extensive data processing.

• Solid understanding of Data Lake architecture, data quality controls, data lineage, and production-grade data pipelines.

• Excellent analytical and problem-solving capabilities.

• Outstanding communication and teamwork skills, with the ability to effectively collaborate with both technical and functional stakeholders.

• Flexibility and a proactive attitude towards addressing technical challenges.

• Proficiency in English at a C1 level or equivalent professional fluency.

• Spanish language skills are considered an advantage.

• Experience with workflow orchestration and scheduling tools, particularly Control-M and Airflow, is highly valued.

• Familiarity with Databricks and cloud technologies such as Azure and AWS is highly valued.

• Experience with YARN and cloud-based computing environments is highly valued.

• Familiarity with CI/CD and software engineering practices, including GitHub, Jenkins, and SonarQube, is highly valued.

• Experience in banking production environments, operational monitoring, and incident management tools such as ServiceNow is highly valued.

• Knowledge of Market Risk processes, including P&L, valuations, risk metrics, and regulatory reporting data flows, is highly valued.

🏝️ Benefits

• Fully remote work setup.

• Opportunities for training and career development.

• Chance to be part of a multicultural team and engage in international projects.