Senior Data Developer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design, develop, and sustain ETL/ELT processes utilizing SQL, PySpark, and Python, which includes the integration of data from various source systems.

• Create data layers within Databricks, Data Lake, and Delta Lake, encompassing tables, views, and data models for analytical, reporting, and automation solutions.

• Automate and orchestrate the processes for data loading and transformation.

• Guarantee data quality, consistency, and reliability by implementing validation rules, monitoring, alerting, and diagnosing incidents.

• Optimize SQL queries, Spark processes, and data storage structures to enhance performance, stability, scalability, and cost-effectiveness.

• Deliver dependable, ready-to-use data to analysts, Product Owners, and other stakeholders.

• Develop and maintain technical documentation in Confluence detailing data processes, models, KPI logic, dependencies, data lineage, and incident-handling procedures.

• Leverage AI tools to accelerate work while ensuring that generated code, configurations, and documentation are verified before implementation.

⛳️ Requirements

• A minimum of 2 years of experience in Data Engineering, Analytics Engineering, or data analysis.

• Proven experience in designing ETL/ELT processes and constructing data models or data layers for analytical purposes.

• Experience in maintaining production data processes, which includes monitoring, diagnosing issues, and ensuring data quality.

• Familiarity with cloud solutions, particularly Microsoft Azure.

• Practical expertise in SQL, Python, PySpark, and Databricks.

• Understanding of Data Lake / Delta Lake architecture and principles of data modeling.

• Hands-on experience with Git and Azure DevOps, including managing changes across Development, Testing, and Production environments.

• Capability to convert business requirements into technical solutions.

• Proficient English language skills for effective communication in an international setting.

• Strong analytical and logical thinking abilities, attention to detail, a proactive approach, and the capability to prioritize tasks under time constraints.

• Experience in a complex operational environment.

• Knowledgeable in dimensional modeling, including star schema, fact and dimension tables, data grain, and normalization or denormalization techniques for reporting and analytics.

• Familiarity with advanced mechanisms in Databricks and Delta Lake.

• Experience with streaming technologies such as Kafka, Structured Streaming, or Event Hubs.

• Awareness of monitoring and alerting tools.

• Understanding of data security, access control, metadata management, and principles of data lineage.

• Proficient in using Jira and Confluence.

• Certifications such as Microsoft Certified: Fabric Analytics Engineer DP-600 or Databricks Data Engineer / Analyst Associate are preferred.

🏝️ Benefits

• Genuine ownership — your data products will have a direct impact on strategic decisions.

• Opportunity to collaborate in a diverse, international, and cross-functional environment alongside leading experts.

• Freedom to experiment with new technologies — including AI tools — and implement innovations into production.

• Immediate visibility of your impact.

• B2B type of cooperation.