Senior Data Developer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design, create, and sustain ETL/ELT processes utilizing SQL, PySpark, and Python, which includes integrating data from various source systems.

• Develop data layers within Databricks, Data Lake, and Delta Lake, encompassing tables, views, and data models for analytics, reporting, and automation solutions.

• Automate and orchestrate the processes of data loading and transformation.

• Ensure the quality, consistency, and reliability of data through validation rules, monitoring, alerts, and incident diagnosis.

• Optimize SQL queries, Spark processes, and data storage structures for enhanced performance, stability, scalability, and cost efficiency.

• Deliver reliable, ready-to-use data to analysts, Product Owners, and other stakeholders.

• Create and maintain technical documentation in Confluence that details data processes, models, KPI logic, dependencies, data lineage, and incident handling procedures.

• Leverage AI tools as a productivity enhancer while ensuring the accuracy of generated code, configurations, and documentation prior to implementation.

⛳️ Requirements

• Minimum of 2 years of experience in Data Engineering, Analytics Engineering, or data analysis.

• Proficient in designing ETL/ELT processes and constructing data models or layers for analytical applications.

• Experience in maintaining production data processes, which includes monitoring, diagnosing issues, and ensuring data quality.

• Familiarity with cloud solutions, particularly Microsoft Azure.

• Solid understanding of SQL, Python, PySpark, and Databricks.

• Knowledge of Data Lake / Delta Lake architecture and principles of data modeling.

• Hands-on experience with Git and Azure DevOps, including managing changes across development, testing, and production environments.

• Capability to translate business requirements into technical solutions.

• Advanced proficiency in English for effective communication in an international setting.

• Strong analytical and logical thinking skills, attention to detail, proactivity, and the ability to prioritize tasks under pressure.

• Preferred: experience in a complex operational environment.

• Preferred: understanding of dimensional modeling, including star schema, fact and dimension tables, data grain, and normalization or denormalization techniques.

• Preferred: knowledge of advanced Databricks and Delta Lake functionalities.

• Preferred: experience with Kafka, Structured Streaming, or Event Hubs.

• Preferred: familiarity with monitoring and alerting tools.

• Preferred: knowledge of data security, access control, metadata management, and data lineage principles.

• Preferred: experience using Jira and Confluence.

• Preferred: certifications such as Microsoft Certified: Fabric Analytics Engineer DP-600 or Databricks Data Engineer / Analyst Associate.

🏝️ Benefits

• Genuine ownership — your data products will have a direct impact on strategic decisions.

• Opportunity to collaborate in a diverse, international, and cross-functional environment alongside leading experts.

• Freedom to experiment with new technologies — including AI tools — and implement innovations into production.

• Tangible immediate impact.

• B2B type of collaboration.

• Remote work options available.