Data Engineering Lead

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Design, develop, and maintain enterprise ETL/ELT pipelines that integrate case management, finance, CRM, and third-party systems into a centralized data platform.

• Lead the continuous improvement and development of the cloud-based Azure data platform.

• Ensure that data pipelines are scalable, reliable, cost-effective, and resilient.

• Build and maintain datasets that support business reporting, analytics, dashboards, and data-enabled products.

• Establish and advocate for best practices in CI/CD, automated testing, version control, monitoring, and alerting.

• Collaborate with Data Architects to implement target-state data models and modern data engineering principles.

• Work in partnership with data scientists and analysts to operationalize advanced analytics and predictive models.

• Manage integrations with insurer portals and external data providers.

• Ensure the delivery of high-quality, timely, and secure data flows.

• Support the organization's ambitions for data-driven and AI-enabled initiatives.

⛳️ Requirements

• Demonstrated experience in a senior Data Engineering or Lead Data Engineer position.

• Strong hands-on experience with Microsoft Azure data technologies, including Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, and Azure Data Lake.

• Advanced SQL development capabilities.

• Proficiency in Python and modern data pipeline orchestration tools, including monitoring and automation.

• Proven track record of building reliable, monitored production-grade data pipelines.

• Experience in integrating data from multiple business-critical applications and legacy systems.

• Solid understanding of data security, data protection, and access control principles within cloud-based data platforms.

• Comfortable working in regulated data environments with sensitive personal and litigation data.

• Excellent stakeholder management and communication skills.

• Exposure to predictive analytics, machine learning operationalization, or AI platforms.

• Experience with Dynamics CRM, VisualFiles, and Elite 3E is preferred.

• Understanding of data modeling and data architecture best practices.

• Experience in leading or mentoring data engineering teams.

• Experience in insurance, legal services, claims management, or financial services is desirable but not essential.

🏝️ Benefits

• High levels of flexibility and an excellent work-life balance.

• A comprehensive remuneration package, including private medical insurance, income protection insurance, and discounted gym membership.

• Opportunities for growth and career progression, including professional funding.

• In-person and remote social events.

• Opportunities to participate in various Environmental, Social, and Governance (ESG) activities.

• A diverse, inclusive, and authentic workplace.

• Opportunities to work with cutting-edge Azure and AI technologies.

• Chance to influence strategic data decisions across the organization.

• Opportunity to deliver solutions that enhance operational performance and customer outcomes.

• A collaborative and forward-thinking Data & Analytics function.