Senior Data Engineer

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Design and develop data pipelines and platform capabilities that support AI applications, knowledge systems, and AI workflows.

• Create and sustain ingestion, transformation, chunking, embeddings, retrieval, vector search, metadata, and knowledge-management pipelines.

• Develop secure and reusable access to enterprise data and systems through APIs, MCP, tool calling, and similar methodologies.

• Construct reusable services, libraries, frameworks, and developer tools for implementing AI capabilities in production.

• Implement data modeling, data quality, lineage, access, reliability, and governance practices for AI data and systems.

• Establish methodologies for AI deployment, observability, evaluation, and lifecycle management.

• Collaborate with Engineering, Product, IT, and stakeholders to transition AI use cases from prototypes to scalable production.

• Ensure that AI platform capabilities comply with security, privacy, access control, and data governance requirements.

• Assess emerging AI and data technologies for potential benefits to Oyster.

⛳️ Requirements

• A minimum of 5 years of experience in data engineering, platform engineering, backend engineering, ML engineering, or a related field.

• Proven experience in building and managing production systems.

• Proficient in Python and SQL.

• Solid understanding of data engineering principles, including data pipelines, data modeling, data quality, orchestration, and secure data access.

• Familiarity with Snowflake, Databricks, or similar modern data platforms.

• Experience using dbt, Airflow, or equivalent tools.

• Hands-on experience in building or supporting production systems utilizing LLMs / generative AI.

• Practical knowledge of one or more of RAG, embeddings, vector search, tool/function calling, AI agents, or enterprise knowledge systems.

• Experience in creating reusable data or platform capabilities across different teams.

• Capability to transition systems from experimentation to reliable production, focusing on scalability, observability, performance, and maintainability.

• Understanding of security, authentication/authorization, privacy, and data governance.

• Ability to collaborate across Engineering, Product, and IT to resolve ambiguous AI and data challenges.

• Reliable home internet connection, or the ability to secure one.

• Proficient English language skills.

• Must reside within UTC−6 to UTC+3.

• Authorized to work in your location.

• Bonus: Experience with AWS Bedrock or other managed foundation-model platforms.

• Bonus: Familiarity with MCP or similar approaches.

• Bonus: Experience with LLM evaluation, observability, monitoring, or AI quality.

• Bonus: Experience with LangChain, LangGraph, vector databases, search technologies, AI security, governance, responsible AI, internal developer platforms, SDKs, APIs, reusable infrastructure, or data/AI/ML platform environments.

🏝️ Benefits

• 40 days of leave annually (including holidays and vacation), or more as required by your country.

• Plumm mental well-being service.

• Monthly well-being allowance in the ThanksBen wallet.

• At least three months of paid parental leave for all new parents.

• Job protection for up to 12 months or as mandated locally.

• WFH stipend for laptop and home office equipment.

• Fully remote work from home.

• Flexible, asynchronous, collaborative work environment.

• Inclusive, global work culture.