Senior Cloud Data Engineer – Azure

This is a fully remote position, open to applicants in Poland.

📋 Description

• Joining a project for a client from the DACH region in the tourism industry

• Designing, developing, and maintaining scalable data solutions within the Azure Data Platform ecosystem

• Implementing and optimizing ETL/ELT processes for acquiring, transforming, and sharing data from operational, financial, and reporting systems

• Creating and maintaining data processing solutions using Python, SQL, and Apache Spark

• Supporting the migration and modernization of data environments, including the implementation of Unity Catalog, platform updates, and data platform transformations

• Building and maintaining workflows in Databricks, Delta Live Tables (DLT) solutions, metadata-driven frameworks, and orchestration processes

• Collaborating with architects, analysts, and business stakeholders to translate business requirements into technical solutions

• Co-developing and enhancing CI/CD processes, infrastructure automation, monitoring, logging, and operational practices

⛳️ Requirements

• A minimum of 5 years of experience in IT

• At least 3.5 years of experience working with data in the Azure cloud, confirmed by commercially implemented projects in production

• Experience with Terraform

• Experience with Databricks

• Commercial experience in processing large datasets using JSON

• Commercial experience with PySpark

• Advanced knowledge of SQL and its application in Microsoft and other technological solutions

• Proficient in Git and CI/CD

• Ability to create and optimize data processing solutions (ETL, ELT), preceded by technical project design and solution alternatives analysis

• Programming skills in Python and utilization of Pandas and/or NumPy libraries

• Familiarity with Azure Data Explorer, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure DevOps, and Azure Synapse Analytics

• Experience with agile practices and software development process tools, including Azure DevOps

• Knowledge of secure data storage and processing in the cloud

• Conscious use of Generative AI in software development and architectural and technological decision-making

• Intermediate English proficiency, minimum B2 level

• Fluent communication in Polish

🏝️ Benefits

• Significant autonomy and real impact on project direction

• Projects for clients in Europe and the USA – in the tourism, insurance, energy, pharmaceutical, and financial sectors

• Cloud certifications and training: AWS, Microsoft, Databricks Academy – training and exam costs covered

• AI tools available to every team member from day one

• Community of experts: thematic groups, access to system architects, business analysts, and UX teams

• Opportunity to work 100% remotely

• Substantive feedback after the recruitment process, regardless of the outcome