AI Platform Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Design and manage a sovereign LLM platform, incorporating an OpenAI-compatible gateway, model serving, and GPU infrastructure.

• Implement tailored knowledge integrations (RAG) utilizing vector databases, embeddings, and reranking methodologies.

• Ensure effective cost management, tenant isolation, data protection, and appropriate guardrails.

• Set up monitoring and observability to assess the performance, quality, and usage of AI services.

• Advance the container-based platform utilizing Docker, Coolify, and Kubernetes.

• Automate deployment processes and take charge of CI/CD for in-house developments.

• Oversee Linux, cloud, and database infrastructure, ensuring stability, security, and availability.

• Develop and improve monitoring, logging, and alerting solutions.

• Actively contribute to the architectural design of the platform and AI services.

• Implement Infrastructure as Code and standardized deployment methodologies.

• Ensure operating models are compliant with data protection regulations and maintain tenant isolation.

• Document solutions, disseminate knowledge within the team, and assess new technologies in platform engineering and AI.

⛳️ Requirements

• Bachelor's degree in computer science, business informatics, or a related field.

• Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments.

• Extensive hands-on experience with container-based applications and modern platforms.

• Proven experience in deploying and managing LLM and AI services in production, preferably in self-hosted scenarios.

• Strong expertise in Kubernetes, Docker, and Linux environments.

• Familiarity with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL.

• Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions.

• Competent Python skills for automation and integration tasks.

• Independent and structured work ethic, high degree of ownership, and a strong focus on security and data protection.

• Robust architectural and platform knowledge.

🏝️ Benefits

• An open and collaborative company culture within a trusting work environment.

• Comprehensive onboarding process with support from the entire AIS team.

• Flat organizational structure, swift decision-making processes, and a high level of autonomy.

• A strategic role with substantial influence on the future landscape of the platform.

• Opportunity to engage in sovereign LLM hosting and AI infrastructure projects.

• Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies.

• Opportunity to actively influence standards, processes, and architectural choices.

• Individual professional development budget for conferences, certifications, and specialized training.

• Clear pathways for career progression and development.

• Opportunity to specialize as an AI Platform Engineer or LLMOps expert.

• A small, focused, and agile team with rapid decision-making processes.

• An open feedback culture supported by regular one-on-one meetings and retrospectives.