Data Engineer

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Develop and sustain data pipelines and notebooks in Microsoft Fabric, sourcing information via SFTP, APIs, and gateway database connections.

• Ingest source data into the Fabric Lakehouse and transfer it into the persistent staging layer of the Fabric Data Warehouse.

• Create and enhance SQL stored procedures to convert staged data into refined dimensional models.

• Design Fabric semantic models, DAX measures, Power BI reports, and paginated reports.

• Adhere to established architecture, naming conventions, and re-runnability standards.

• Conduct end-to-end testing of pipelines in isolated feature workspaces, validating row counts, key values, logging, and downstream effects.

• Perform peer reviews of pull requests in Azure DevOps.

• Assist with daily ETL operations by monitoring overnight runs, investigating failures, and implementing recovery measures.

• Comply with feature-branching, feature-workspace, and regulatory change-control approval processes.

• Document transformation logic, data mappings, and known edge cases for each pipeline.

• Collaborate with colleagues in finance, operations, risk, and platform business to address data needs and interpretations.

• Engage in Agile planning, backlog refinement, and retrospectives.

⛳️ Requirements

• Proficient SQL skills, including the ability to write and optimize stored procedures for SQL Server, Azure SQL, or Fabric.

• Hands-on experience in building, troubleshooting, and maintaining ETL processes and data pipelines utilizing Microsoft Fabric, Azure Data Factory, Synapse, or Databricks.

• Strong understanding of data warehousing principles, including star schemas, fact grain, surrogate keys, and slowly changing dimensions.

• Experience in constructing semantic models, writing DAX measures, and creating Power BI reports or dashboards.

• Practical knowledge of Python for file parsing and automation, preferably within notebooks.

• Familiarity with Git branching, pull requests, and code review processes, ideally within Azure DevOps.

• Systematic approach to validating work, ensuring reconciliation with source data, and assessing downstream impacts.

• Capability to trace data issues through various data layers to their origin.

• Ability to convey technical details to non-technical colleagues and clarify ambiguous requirements.

• Direct experience with Microsoft Fabric is preferred; DP-700 certification is a plus but not mandatory.

• Experience in formal change control and regulated environments is advantageous.

• Familiarity with financial services data, such as holdings, transactions, flows, and charges, is desirable.

• Background in designing or managing source-to-warehouse reconciliation and validation controls is preferred.

🏝️ Benefits

• Non-contributory pension.

• Bonus opportunities.

• Enhanced parental leave.

• Paid time off for emergencies.

• Health and wellbeing initiatives.

• Flexible working arrangements.

• Recognition for efforts.

• A workplace culture focused on social responsibility and inclusion.