
Data Engineer
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in United Kingdom, +1 more country.
• Develop ingestion and transformation pipelines that populate the Knowledge Graph from internal systems, enrichment outputs, and third-party data sources.
• Execute entity resolution and linking logic in a production environment.
• Oversee late-arriving data, conflicting sources, and changes in graph schema over time.
• Create query and serving layers utilized by search, matching, and data product teams.
• Model the graph for analytical and application purposes across BigQuery, PostgreSQL, and Elasticsearch / OpenSearch.
• Provide support for external-facing data products with dependable export and delivery pipelines.
• Establish data quality checks, lineage, and monitoring throughout graph pipelines.
• Manage production operations, including alerting, backfills, and incremental reprocessing.
• Contribute to data contracts to ensure downstream teams can depend on the graph.
• Over 3 years of experience in building production data pipelines.
• Proficient in Python and SQL, with a track record of writing clean, production-ready code.
• Familiarity with PostgreSQL or other relational database systems.
• Strong data modeling abilities, including schema design for evolving requirements.
• Experience in integrating complex, multi-source data, including deduplication and normalization.
• Practical experience with Elasticsearch / OpenSearch or a similar serving layer.
• Comfortable with testing, code reviews, CI, and managing your own pipelines.
• Knowledge of graph databases, graph data modeling, taxonomies, or ontologies.
• Experience with entity resolution at scale.
• Proficiency with BigQuery, Kafka, dbt, or related data platforms and frameworks.
• Familiarity with Docker, Kubernetes, and cloud platforms such as AWS or GCP.
• Tenure gifts, including vouchers, extra holiday days, and sabbaticals for each year of service.
• Health insurance provided through Vitality.
• Remote working options for up to 20 days each year, offering flexibility and a change of scenery.
• Employee Assistance Programme with tailored health and wellbeing advice from specialized teams.
• Enhanced maternity and paternity leave benefits.
• 25 days of annual leave plus bank holidays, including a week's closure during Christmas.
• MyMindPal app for online mental fitness support.
• Corporate events, ranging from quarterly gatherings to annual winter and summer celebrations.
SysMap Solutions
Get handpicked remote jobs straight to your inbox weekly.