Data Engineering Consultant

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Provide innovative analytical solutions for clients globally

• Develop robust data platforms that facilitate AI functionalities

• Gather requirements and offer consulting services to clients

• Design and execute data engineering solutions utilizing Azure, Spark, Python, SQL, orchestration, data lake, governance, and infrastructure-as-code technologies

• Implement ETL methodologies with a focus on data quality, resilience, and observability

• Operate within agile projects adhering to CI/CD methodologies and SDLC practices

• Share expertise internally and with the broader data community

• Work collaboratively in a small, diverse, cross-functional team

• Occasionally visit clients and team members

• Participate in community events through organizing, speaking, mentoring, blogging, or sponsorship

⛳️ Requirements

• Strong working knowledge of Microsoft Azure and cloud computing principles

• Experience with Apache Spark, including Databricks, Microsoft Fabric, or other Spark engines

• Expertise in Python programming

• Capability to write complex, high-performance SQL queries and comprehend query execution across various compute technologies

• Experience with Azure Data Factory or similar cloud orchestration tools

• Familiarity with Azure Data Lake Storage and Delta Lake

• Knowledge of Unity Catalog, Purview, or other data governance tools

• Experience with infrastructure-as-code tools such as Terraform and Azure DevOps

• Proficient in requirements gathering and client consulting

• Understanding of agile project management methodologies

• Knowledge of object-oriented development practices

• Familiarity with ETL methodologies emphasizing data quality, resilience, and observability

• Understanding of CI/CD methodologies and the software development life cycle (SDLC)

• Ability to thrive in an agile environment while balancing technical skills with practical project requirements

• A passion for technology, along with honesty, empathy, and a commitment to knowledge sharing

• Must reside within the UK

• Occasional travel to visit clients and team members

🏝️ Benefits

• Access to the latest technology and training opportunities

• Commitment to long-term employee goals

• Support for community engagement, including blogs, meetups, conferences, speaking, mentoring, and sponsorship

• Industry-leading Maternity & Paternity policy

• Private Medical & Dental Care along with Eye care schemes

• Health & Well-being fund

• 25 Days Annual Leave, Birthday Leave & Charity Leave

• Regular away days with the team

• Annual Bonus Scheme

• Flexible Working Hours

• Electric Car Scheme