Lead AI Platform Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Collaborate with the Head of Data & AI to co-manage the AI platform.

• Outline the platform's architecture, roadmap, and decisions regarding build-versus-buy.

• Establish standards for infrastructure, access, and deployment in conjunction with IT, security, and ML/AI engineers.

• Develop AI platform components using Terraform on AWS and the cloud engineering team's GitLab configuration.

• Manage AWS Bedrock as the model gateway, including access management, guardrails, quotas, and cost allocation per team.

• Scale SageMaker and GPU workloads effectively.

• Determine when managed APIs are adequate for the needs.

• Facilitate orchestration and CI/CD processes integrated with Snowflake.

• Create reusable components and enable self-service deployment functionalities.

• Ensure tracing, evaluation, monitoring, and cost transparency for models and agents.

• Enforce least-privilege access, maintain audit trails, and implement technical guardrails for responsible AI usage.

• Assist non-technical colleagues in safely utilizing approved AI tools.

• Mentor junior team members and establish engineering standards as the AI team expands.

⛳️ Requirements

• A minimum of 6 years of experience in platform engineering, DevOps, cloud engineering, or MLOps.

• Proven experience in designing and operating platforms in a production environment.

• Strong proficiency in AWS.

• Hands-on experience with Terraform or AWS CDK.

• Familiarity with access control, secrets management, and audit logging.

• Experience with CI/CD tools, such as GitLab CI.

• Proficient in Docker.

• Knowledge of workflow orchestration tools, such as Airflow.

• Experience with Snowflake or similar cloud data platforms.

• Background in running ML and LLM workloads in a production setting.

• Familiarity with managed model access solutions, such as AWS Bedrock or equivalent platforms.

• Experience in implementing guardrails, evaluation, and cost management strategies.

• Capacity to make and justify architectural decisions.

• Ability to mentor and guide fellow engineers.

• Daily engagement with AI coding tools.

• Proficiency in explaining technical trade-offs to non-technical audiences.

• Fluent in English.

• Conversational skills in German or Dutch are a plus.

• Experience with MCP servers or other AI agent infrastructure is advantageous.

• Familiarity with Kubernetes and self-hosted model serving, such as vLLM, is a plus.

• Working knowledge of GDPR and the EU AI Act is beneficial.

🏝️ Benefits

• Bike leasing and subsidy for bike purchases.

• Provision of home office equipment.

• Learning budget available for professional development.

• Days allocated for attending conferences.

• 100% remote work opportunity from anywhere within the EU.

• Regular team meetings held in one of the operational countries.