Data Engineer – UK-Based

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Create and document data pipelines suitable for production use.

• Collaborate on ETL and ELT processes.

• Analyze requirements for data movement, transformation, and processing.

• Generate technical documentation based on realistic data platform scenarios.

• Develop or evaluate SQL and Python transformations and processing logic.

• Assess data processing methods for accuracy and scalability.

• Design or evaluate orchestration, dependency management, and scheduled data workflows.

• Examine pipeline sequencing and operational reliability factors.

• Utilize streaming and large-scale distributed processing expertise with technologies like Kafka and Spark.

• Evaluate distributed architecture and implementation options.

• Collaborate with data warehouse and analytics architectures on platforms such as Snowflake, BigQuery, or Databricks.

• Develop or assess transformation workflows using tools like dbt.

• Evaluate decisions related to data modeling and warehouse design.

• Review cloud architecture and platform choices across AWS, GCP, or Azure.

• Analyze approaches for data storage, processing, and integration.

• Produce comprehensive technical documentation and structured outputs.

• Clearly articulate architectural and implementation decisions.

• Document production practices, constraints, assumptions, and engineering considerations.

• Work collaboratively with experts from related technical fields.

⛳️ Requirements

• Must possess hands-on professional experience as a Data Engineer, Senior Data Engineer, Staff Data Engineer, Analytics Engineer, Data Platform Engineer, Data Architect, or a closely related role.

• Extensive experience in building and managing data pipelines in a production environment.

• Strong skills in SQL and Python.

• Practical experience with ETL/ELT, orchestration, streaming, and data warehousing.

• Familiarity with Spark, Kafka, Airflow, dbt, Snowflake, BigQuery, or Databricks.

• Experience with cloud platforms such as AWS, GCP, or Azure.

• Comfortable producing hands-on technical work and well-structured professional documentation.

• Ability to work independently while collaborating with specialists from related technical domains.

• Must reside in the United Kingdom.

• Must have the legal right to work in the United Kingdom.

• Expected to commit to 40 hours per week.

• Candidates should not have other commitments requiring significant hours during this engagement.

• Resume and work history review, along with a brief domain expertise assessment.

• Work must be executed without using confidential or proprietary information from any employer, client, institution, or third party.

• H1-B and STEM OPT support is not available for this position.

🏝️ Benefits

• Fully remote position within the United Kingdom.

• Full-time engagement as an independent contractor.

• Opportunities for project extensions.

• Flexibility to engage in smaller side projects.

• Remote consulting opportunity.

• Work hours aligned with UK business times.