Data Platform Lead

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Take ownership of trading data as a product, which includes power market data, weather forecasts, grid and system data, fuel prices, and fundamentals, ensuring its reliability and utility for traders and quants.

• Rapidly deploy datasets and pipelines into production while identifying and resolving performance bottlenecks related to ingestion, storage, and delivery.

• Create canonical schemas that support point-in-time accuracy, revisions, and backtesting without lookahead bias.

• Assess, onboard, and manage data vendors, taking into account coverage, latency, licensing, and cost in relation to trading value.

• Establish and maintain monitoring systems for data freshness, completeness, and anomalies, with a clear protocol for addressing feed disruptions.

• Lead and develop a team of engineers, mapping data flows across the organization to facilitate quick integration of new sources and prevent downstream decision-making issues.

⛳️ Requirements

• Proven experience in owning and delivering data products to actual users or clients, which includes managing pipelines, ensuring data quality, and taking responsibility for outcomes beyond mere implementation.

• Demonstrated ability to lead teams and coordinate across departments with a solid understanding of data flow within a business.

• Strong technical skills: capable of deep analysis, system profiling, and resolving performance bottlenecks.

• Expertise in schema design for time series and event data, including managing revisions, late-arriving data, and mapping entities across vendors.

• Proficient in Python and SQL with experience operating production pipelines at scale.

• Experience in evaluating and negotiating with data vendors, focusing on cost versus value.

• Nice to have: experience in building or managing a data vendor business or overseeing a comparable data product end to end.

• Nice to have: background in a trading firm, hedge fund, or other market-facing environments.

🏝️ Benefits

• Competitive salary and eligibility for equity.

• Biannual bonus scheme.

• Fully expensed technology to suit your needs.

• Private health insurance.

• Breakfast and dinner allowance for office-based employees.

• Benefits may vary by location.