Data Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• You will be responsible for designing, constructing, and maintaining scalable and reliable data pipelines and platforms that support analytical and reporting solutions.

• You will engage in comprehensive data engineering solutions, covering everything from data ingestion and transformation to storage and serving curated datasets for analytics and reporting.

• You will create and enhance ETL/ELT pipelines utilizing Databricks (Apache Spark, SQL, Python) and Delta Lake technologies.

• Your role will include data modeling, structuring, and performance optimization within analytical data stores, such as lakehouses and data warehouses.

• You will establish and uphold data quality, validation, and monitoring mechanisms to ensure the accuracy, consistency, and reliability of processed data.

• Collaboration with data analysts, BI developers, and business stakeholders will be essential for translating business and regulatory requirements into robust technical solutions.

• You will play a key role in architectural decisions regarding data platforms, processing patterns, and technology selections.

• You will provide support and mentorship to junior data engineers, aiding in their technical and consulting development.

• Participation in client-facing projects will involve discussing requirements, presenting solutions, and elucidating technical concepts in an understandable manner.

• Alongside project responsibilities, you will stay updated on the latest trends in data engineering, cloud technologies, and Anti Financial Crime, contributing to internal initiatives and accelerators.

⛳️ Requirements

• A Master’s degree, preferably in Computer Science, Data Engineering, Mathematics, Statistics, or a related field.

• Relevant commercial experience in data engineering, database development, or data platform roles.

• A solid understanding of data engineering fundamentals, including ETL/ELT, data warehousing, and lakehouse architectures.

• Practical experience with Databricks, which includes building and maintaining Spark-based batch and/or streaming data pipelines, working with Delta Lake (ACID tables, schema evolution, incremental processing, merges), optimizing performance (partitioning, file compaction, query optimization), and developing pipelines using Databricks notebooks, jobs, and workflows.

• Proficient knowledge of SQL, including designing, writing, and optimizing complex queries.

• Experience with Python for data processing and transformations (e.g., pandas, PySpark).

• Strong understanding of data modeling, data quality, and data governance concepts.

• Experience with cloud-based data platforms, preferably Azure.

• Ability to gather and convert business requirements into technical solutions.

• Excellent communication skills, capable of engaging with both technical and non-technical stakeholders.

• Ability to perform effectively under pressure while ensuring a high level of accuracy.

• Fluent in written and spoken English.

• Willingness to collaborate within international project teams.

• Nice to have: Experience in streaming data processing (e.g., Spark Structured Streaming), knowledge of data governance or metadata tools (e.g., Collibra), experience in financial services, AML/AFC, or regulatory-driven environments, and proficiency in additional languages such as German, Dutch, or French.

🏝️ Benefits

• Work flexibility, including a hybrid working model, flexible start times, and sabbatical leave.

• Development and upskilling opportunities, with full support during onboarding, mentorship from experienced colleagues, training sessions, workshops, and certification co-financed by PwC, as well as conversations with native speakers.

• Comprehensive medical and well-being programs, including a medical care package (which includes physiotherapy and dental care discounts), coaching, mindfulness sessions, psychological support, education through dedicated webinars and workshops, and financial and legal advice.

• The option to create a personalized benefits package (including lunch passes, insurance packages, concierge services, veterinary packages for pets, and massages) and access to a cafeteria, along with vouchers and discounts on IT equipment and vehicle purchases.

• Three paid hours for volunteering each month.

• An additional paid day off for your birthday.