Senior Data Engineer

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Take responsibility for the design, reliability, resilience, and recovery strategies for end-to-end ingestion pipelines and systems, including TSDS.

• Develop and sustain ETL/ELT pipelines for both new and existing data sources.

• Select between batch and streaming methodologies for pipelines, focusing on high-scale, low-latency time-series data.

• Establish and enforce data quality checks that align with SLA commitments.

• Enhance and maintain the data platform while addressing any technical debt.

• Create monitoring, alerting, and observability features to ensure issues are identified before they escalate into incidents.

• Uphold code quality and standards, which includes CI checks, linting, testing, and coverage.

• Optimize pipelines for performance and cost efficiency as data volumes increase.

• Manage late arrivals, reprocessing, and backfills specifically for energy data.

• Investigate and resolve domain-specific issues while escalating cross-system challenges.

• Assist in scaling data products with defined SLAs from 2 to 10.

• Prepare the platform for new data sources to facilitate international expansion.

• Identify architectural limitations as project scope expands.

• Collaborate with the AI team as the platform's data requirements grow.

• Engage with stakeholders and cross-functional leaders regarding SLAs, technical trade-offs, and delivery timelines.

⛳️ Requirements

• Strong proficiency in Python, with demonstrated experience in building and maintaining production data pipelines.

• Proven track record in owning the design, reliability, and resilience of a data pipeline or system from start to finish.

• Experience with AWS or GCP.

• Excellent communication skills and the ability to interact directly with stakeholders to define and agree upon SLAs.

• Capable of articulating technical trade-offs to non-technical audiences.

• Comfortable working autonomously with a backlog and making prioritization decisions.

• Experience with Terraform.

• Fluent in English: able to speak, read, and write proficiently.

• Bonus: experience with large-scale time-series data.

• Bonus: familiarity with modern data stack tools such as Airflow, Snowflake, BigQuery, Redshift, or ClickHouse.

• Bonus: background in the energy or climate tech sectors.

• Bonus: experience in high-growth startups or scale-ups.

• Bonus: interest in AI tooling and workflows that intersect with data engineering.

🏝️ Benefits

• Stock options to ensure everyone has a stake in our mission.

• 25 days of holiday in addition to public holidays.

• Option to exchange public holidays for preferred days off.

• Day off on your birthday.

• Remote-first and flexible working arrangements.

• Defined core working hours.

• No internal meetings on Friday afternoons.

• Up to GBP1,200 or EUR1,200 annually for remote setup expenses.

• Up to GBP150 or EUR150 monthly for wellbeing initiatives.

• Salary reviews conducted biannually.