Data Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Analyze and comprehend current data models, data flows, and transformation procedures.

• Gain insight into existing datasets, mappings, and dependencies within the DataLake.

• Develop, sustain, and enhance Python processes, ETLs, and data pipelines.

• Construct and oversee Control-M jobs and batch processing workflows.

• Implement data ingestion, transformation, and processing logic.

• Create and modify data models and datasets needed for the Limits solution.

• Conduct SQL-based data analysis, validation, and reconciliation across various data sources.

• Establish data quality controls and investigate as well as resolve data discrepancies.

• Assist in testing, certification, deployment, and production releases.

• Generate and update technical documentation that includes data models, processes, mappings, and transformations.

• Collaborate with both technical and functional teams to ensure that data solutions fulfill business and technical requirements.

⛳️ Requirements

• A minimum of 2 years of professional experience in Data Engineering, Big Data, or related fields.

• Robust experience with Big Data/DataLake architectures.

• Proficient SQL skills for querying, analysis, and data validation.

• Practical experience with Python.

• Background in developing ETL processes.

• Familiarity with data ingestion and transformation procedures.

• Experience in developing and maintaining data pipelines.

• Solid understanding of data modeling concepts.

• Experience with Control-M and/or batch processing.

• Strong capabilities in data analysis, validation, and reconciliation.

• Proficiency in English at level B2 or higher.

🏝️ Benefits

• Work remotely within the CET Time zone.

• Opportunity to be part of a multicultural team.

• Engage in international projects.

• Option of B2B or employment contract.