AI Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• You will develop and operate our sovereign LLM platform, which includes an OpenAI-compatible gateway, model serving, and GPU infrastructure.

• You will implement custom knowledge connections (RAG) using vector databases, embeddings, and reranking.

• You will ensure cost control, tenant separation, data protection, and guardrails.

• You will establish monitoring and observability for the performance, quality, and usage of AI services.

• You will manage and further develop our container-based platform based on Docker, Coolify, and Kubernetes.

• You will automate deployments and take responsibility for CI/CD processes for our in-house developments.

• You will oversee our Linux, cloud, and database infrastructure, ensuring stability, security, and availability.

• You will build and enhance monitoring, logging, and alerting solutions.

• You will actively shape the architecture of our platform and AI services.

• You will establish Infrastructure as Code and standardized deployment processes.

• You will ensure data protection-compliant and tenant-secure operational models.

• You will document solutions, share knowledge within the team, and evaluate new technologies in platform engineering and AI.

⛳️ Requirements

• Completed degree in (business) computer science or a comparable qualification.

• Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments.

• Solid practical experience in operating container-based applications and modern platforms.

• Experience in building and operating LLM and AI services, ideally in self-hosted environments.

• Very good knowledge of Kubernetes, Docker, and Linux.

• Experience with CI/CD pipelines, cloud platforms (especially Azure), and PostgreSQL.

• Practical experience with LLM gateways, RAG architectures, vector databases, and model serving solutions.

• Strong Python skills for automation and integrations.

• Independent and structured working style with a high level of personal responsibility, as well as security and data protection awareness.

• Strong understanding of architecture and platforms.

🏝️ Benefits

• Open and cooperative company culture.

• Trusting working atmosphere.

• Comprehensive onboarding with support from the entire AIS team.

• Flat hierarchies and short decision-making processes.

• Strategic role with significant influence on the future platform landscape.

• Opportunity to work in one of the most exciting technology fields in IT: sovereign LLM hosting and AI infrastructures.

• Modern infrastructure with Kubernetes, Docker, CI/CD, and cloud technologies.

• Opportunity to actively shape standards, processes, and architectural decisions.

• Individual training budget for conferences, certifications, and professional training.

• Clear career and development paths.

• Opportunity to specialize as an AI Platform Engineer or LLMOps expert.

• Small, focused, and agile team with short decision-making processes.

• Open feedback culture with regular one-on-one meetings and retrospectives.