Senior AI Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design and develop an enterprise AI platform featuring LLM-based routing, intelligent model selection, fallback strategies, and cost optimization.

• Build and manage the MCP (Model Context Protocol) gateway infrastructure to facilitate seamless integration of enterprise tools and internal data with AI agents.

• Architect orchestration frameworks based on LangGraph for complex agent workflows, allowing developers to create multi-step AI applications.

• Implement components for the RAG (Retrieval-Augmented Generation) platform, including vector search integration, prompt optimization, and chunking strategies.

• Establish comprehensive observability using Langfuse and similar tools, including tracing, cost monitoring, token usage analytics, and LLM quality metrics.

• Design and optimize APIs for LLM interactions to provide developers with seamless access to platform capabilities.

• Construct deployment and orchestration pipelines utilizing Kubernetes (K8s) with ArgoCD for GitOps-driven AI service deployments.

• Create CI/CD infrastructure with GitLab CI/CD for automated testing, deployment, and versioning of AI platform components.

• Implement security measures, authentication, and rate limiting for AI endpoints to protect against misuse and ensure multi-tenant isolation.

• Develop self-service developer interfaces and documentation that empower non-AI experts to create sophisticated agent applications.

• Design systems for prompt management and versioning to enable team collaboration on prompts and performance tracking across versions.

• Lead technical initiatives, conduct code reviews, mentor engineers, and promote an AI-first engineering culture.

⛳️ Requirements

• A minimum of 4 years of experience as a Platform Engineer, Backend Engineer, or AI Engineer with practical experience in platform/service delivery.

• Strong foundations in software engineering: proficiency in Python and/or Go/Java, adhering to clean code practices and system design principles.

• Hands-on production experience with container orchestration using Kubernetes and ArgoCD for GitOps deployments.

• Advanced expertise in GitLab CI/CD, including designing robust pipelines, managing deployments, and optimizing build efficiency.

• Practical knowledge of LLM frameworks and agent systems (such as LangGraph, Pydantic AI, or similar technologies).

• Familiarity with RAG systems, including vector databases, similarity search, and prompt engineering for retrieval-augmented contexts.

• Understanding of LLM routing and optimization strategies, including cost-aware model selection, latency reduction, and multi-model orchestration.

• Experience in building or managing gateway/proxy infrastructure, including API gateways, reverse proxies, and load balancing techniques.

• Strong background in infrastructure-as-code, version control (Git), and CI/CD best practices.

• Excellent communication skills, with the ability to collaborate effectively with AI/ML teams, data engineers, and product managers to translate requirements into platform solutions.

🏝️ Benefits

• A training budget for courses and conferences that interest you.

• An additional day off on your birthday.

• An extra day off for parents.

• Equipment tailored to your individual needs.

• Private medical care and group insurance.

• Access to an e-learning platform for English learning and a benefits platform.

• Access to a wellbeing platform, along with opportunities for workshops and private therapy sessions.

• Flexible remote work options, as well as the opportunity to work from the office in Warsaw or a coworking space in your city.