Lead Data Engineer

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Design and create software components for data processing and persistence tailored for high-scale solutions.

• Lead the development of entire components or subsystems, which includes design, coding, testing, and resolving defects.

• Engage in hands-on design and development utilizing both open-source and commercial platforms.

• Establish and uphold development best practices while mentoring team members.

• Collaborate with project architects to enhance the robustness and performance of ETL/ELT data-processing pipelines.

• Take ownership of unit and integration testing standards and their implementation.

• Oversee software product due diligence and integration efforts.

• Spearhead troubleshooting and optimization activities.

• Partner with Operations teams to guarantee that application software is ready for operational use.

• Work alongside Security Architects and compliance officers to ensure adherence to legal and security standards.

• Provide guidance to customers, managers, and team members regarding estimated efforts and technical implications.

• Contribute to technical proposals throughout the sales process.

• Manage, mentor, and cultivate a small team of staff, focusing on performance management and career development.

• Offer direction to the team while collaboratively addressing problems.

⛳️ Requirements

• Proven experience in leading a team of engineers in the implementation of data-intensive system components.

• Familiarity with established standards for design patterns, development style guides, automation, deployment, and operational readiness.

• Strong software development skills in Java, Scala, or Python.

• Experience in software development using Informatica, Azure Databricks, or other relevant ETL tools.

• Expertise in SQL or SQL extensions tailored for analytical use cases.

• Deep understanding of distributed data stores and data processing frameworks.

• Ability to effectively communicate technical designs both in writing and verbally.

• Skilled in designing both analytical and operational data models.

• Strong interest in AI technologies.

• Desirable: Familiarity with data warehouse methodologies and techniques.

• Desirable: Actively shares insights and perspectives on data practices.

• Desirable: AWS, Azure, or GCP certification in Data Services.

• Desirable: Expertise in continuous improvement and data best practices.

• Desirable: Involvement in development and/or technology communities.

• Desirable: Practical experience with AI technologies, tools, processes, and delivery methods.

🏝️ Benefits

• People-first culture that supports growth.

• Commitment to diversity, equity, and inclusion.

• Recruitment accommodations and adjustments available.

• Customized support throughout the recruitment process.