Data Engineering Lead

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Design, develop, and maintain enterprise ETL/ELT pipelines that integrate case management, finance, CRM, and third-party systems into a centralized data platform.

• Lead the development and ongoing enhancement of the cloud-based Azure data platform.

• Ensure that data pipelines are scalable, reliable, cost-effective, and resilient.

• Construct and maintain datasets that support business reporting, analytics, dashboards, and data-driven products.

• Establish and advocate for best practices in CI/CD, automated testing, version control, monitoring, and alerting.

• Collaborate with Data Architects to implement target-state data models and modern data engineering principles.

• Partner with data scientists and analysts to operationalize advanced analytics and predictive models.

• Manage integrations with insurer portals and external data providers, ensuring high-quality, timely, and secure data flows.

• Support the organization's goal of becoming increasingly data-driven and AI-enabled.

• Deliver reliable data products and facilitate analytics, reporting, and AI initiatives through scalable pipelines and architecture.

⛳️ Requirements

• Demonstrated experience in a senior Data Engineering or Lead Data Engineer position.

• Strong practical experience with Microsoft Azure data technologies, such as Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, and Azure Data Lake.

• Advanced skills in SQL development.

• Proficiency in Python and modern data pipeline orchestration tools, including monitoring and automation.

• Proven track record of building reliable, monitored production-grade data pipelines.

• Experience in integrating data from various business-critical applications and legacy systems.

• Solid understanding of data security, data protection, and access control principles within cloud-based data platforms.

• Comfortable working in regulated data environments that handle sensitive personal and litigation data.

• Excellent stakeholder management and communication skills.

• Familiarity with predictive analytics, machine learning operationalization, or AI platforms.

• Experience with Dynamics CRM, VisualFiles, or Elite 3E is desirable.

• Understanding of best practices in data modeling and data architecture.

• Experience in leading or mentoring data engineering teams.

• Experience in the insurance, legal services, claims management, or financial services sectors is desirable but not essential.

🏝️ Benefits

• High levels of flexibility and an excellent work-life balance.

• A comprehensive remuneration package that includes private medical insurance, income protection insurance, and discounted gym membership.

• Opportunities for growth and advancement, including professional funding.

• Both in-person and remote social events.

• Opportunity to engage in various Environmental, Social, and Governance (ESG) activities.

• A diverse, inclusive, and authentic workplace.

• Opportunity to work with cutting-edge Azure and AI technologies.

• Chance to influence strategic data decisions across the organization.

• Opportunity to deliver solutions that enhance operational performance and customer outcomes.

• A collaborative and forward-thinking Data & Analytics function.