AI Platform Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Design and manage a sovereign LLM platform, which includes an OpenAI-compatible gateway, model serving, and GPU infrastructure.

• Execute customer-specific knowledge integrations (RAG) utilizing vector databases, embeddings, and reranking techniques.

• Maintain cost control, tenant isolation, data protection, and implement necessary guardrails.

• Create monitoring and observability systems to assess the performance, quality, and usage of AI services.

• Continue developing the container-based platform using Docker, Coolify, and Kubernetes.

• Automate deployment processes and take charge of CI/CD operations.

• Oversee Linux, cloud, and database infrastructure while ensuring stability, security, and availability.

• Build and enhance solutions for monitoring, logging, and alerting.

• Actively influence the architecture of the platform and AI services.

• Implement Infrastructure as Code and standardized deployment frameworks.

• Ensure operating models are compliant with data protection and secure for tenants.

• Document solutions, disseminate knowledge within the team, and assess new technologies relevant to platform engineering and AI.

⛳️ Requirements

• Bachelor's degree in Computer Science, Business Informatics, or a similar field.

• Multiple years of experience in DevOps, platform engineering, or cloud/infrastructure settings.

• Strong practical experience in managing container-based applications and contemporary platforms.

• Background in developing and operating LLM and AI services in production, ideally within self-hosted environments.

• Proficient knowledge of Kubernetes, Docker, and Linux.

• Familiarity with CI/CD pipelines, cloud platforms—especially Azure—and PostgreSQL.

• Hands-on experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions.

• Competent Python skills for automation and integrations.

• Independent and methodical work style, with a strong sense of ownership and a keen awareness of security and data protection.

• Deep understanding of architecture and platform engineering.

🏝️ Benefits

• Open and collaborative company culture.

• Trust-based working environment.

• Comprehensive onboarding with support from the entire AIS team.

• Flat hierarchies, swift decision-making processes, and a high degree of freedom to shape your work.

• Strategic role with significant influence over the future platform landscape.

• Opportunity to engage in sovereign LLM hosting and AI infrastructure projects.

• Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies.

• Chance to actively shape standards, processes, and architectural decisions.

• Individual professional development budget for conferences, certifications, and specialized training.

• Clear career and development pathways.

• Opportunity to specialize as an AI Platform Engineer or LLMOps expert.

• Small, focused, and agile team.

• Open feedback culture with regular one-on-one meetings and retrospectives.