Senior Data Specialist

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Create mappings of BM units from Elexon to their respective power plants, substations, and fuel types by integrating API data, public registers, and manual research.

• Associate substations with ETYS zones and grid supply points.

• Develop and maintain reference/master datasets that connect identifiers from various sources (Elexon, National Grid ESO, TEC register, etc.).

• Clearly document mappings, assumptions, and known limitations for the benefit of downstream users.

• Reconcile legacy data formats with current formats, including historical operational data that may be stored in different schemas or granularities.

• Ensure consistency across various Elexon message types; possess a deep understanding of the market data structure to recognize misalignments between BOALF, BOD, and DISBSAD and how to address them.

• Investigate discrepancies among data sources and identify authoritative values.

• Clean time-series data by detecting outliers (such as price spikes or meter errors), appropriately filling gaps, and resolving overlapping or duplicate timestamps.

• Create reusable Python-based data cleaning routines applicable across multiple datasets.

• Write and maintain Python scripts for extracting data from energy market APIs.

• Build dbt models to convert raw data into clean, analysis-ready datasets.

• Coordinate workflows using GitHub Actions.

• Design PostgreSQL schemas that demonstrate your understanding of the domain.

⛳️ Requirements

• **Proficient in Python for data tasks** — you are skilled with pandas, adept at writing clean, testable code, and capable of creating reusable data processing logic. This position does not involve Excel.

• **Strong SQL capabilities** — experience with complex queries, window functions, and CTEs in PostgreSQL.

• **Familiar with handling messy, real-world data** — you have experience in reconciliation, cleaning, or mapping tasks and recognize that not all processes can be automated.

• **Detail-oriented and methodical** — you pay attention to discrepancies and seek to understand their underlying causes.

• **Good documentation practices** — you understand that failing to document mappings and assumptions contributes to technical debt.

• **Self-motivated** — you can tackle ambiguous challenges, conduct independent research, and communicate your findings effectively.

• **Background in energy, utilities, or market data (any region)**.

• **Familiar with UK energy markets, Elexon data, or grid operations**.

• **Experience with dbt for transformation pipelines**.

• **Acquainted with time-series data challenges (irregular timestamps, gaps, restatements)**.

🏝️ Benefits

• Numerous opportunities for learning and professional development.

• B2B contract with paid vacation.