Data Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Analyze and comprehend current data models, data flows, and transformation processes.

• Gain insights into existing datasets, mappings, and dependencies within the DataLake.

• Develop, maintain, and enhance Python processes, ETLs, and data pipelines.

• Construct and sustain Control-M jobs and batch processing workflows.

• Implement data ingestion, transformation, and processing logic.

• Design and adjust data models and datasets necessary for the Limits solution.

• Conduct SQL-based data analysis, validation, and reconciliation across various data sources.

• Establish data quality controls and investigate as well as resolve data discrepancies.

• Assist in testing, certification, deployment, and production releases.

• Generate and maintain technical documentation encompassing data models, processes, mappings, and transformations.

• Collaborate with technical and functional teams to ensure data solutions align with business and technical requirements.

⛳️ Requirements

• Over 2 years of professional experience in Data Engineering, Big Data, or related fields.

• Extensive experience with Big Data/DataLake architectures.

• Proficient SQL skills for querying, analysis, and data validation.

• Practical experience with Python programming.

• Experience in developing ETL processes.

• Understanding of data ingestion and transformation methodologies.

• Experience in crafting and maintaining data pipelines.

• Solid grasp of data modeling principles.

• Familiarity with Control-M and/or batch processing.

• Strong capabilities in data analysis, validation, and reconciliation.

• Proficient in English at B2 level or higher.

• Experience with Atoti/ActiveViam, Databricks, REST APIs, Microservices, Jira/Confluence, financial services or banking environments, as well as Counterparty Risk/Limits concepts is advantageous.

🏝️ Benefits

• Choice between B2B or employment contract.

• Remote work within the CET Time Zone.

• Opportunity to be part of a multicultural team.

• Engage in international projects.