Senior AI DevOps, LLMOps

This is a fully remote position, open to applicants in Poland.

📋 Description

• Automate the process of Build-to-Production by designing and implementing effective CI/CD pipelines specifically for AI.

• Create tailored workflows for PromptOps.

• Streamline the deployment of Agentic workflows through automation.

• Provision and oversee high-performance computing environments, including GPU clusters and TPU pods.

• Define and implement Policy-as-Code for AI endpoints.

• Ensure a uniform environment across Hybrid Infrastructure.

• Design Progressive Delivery strategies for AI initiatives.

• Develop 'Evaluation-in-the-Loop' gates to be integrated within the pipeline.

• Provide in-depth observability into Inference Endpoints.

⛳️ Requirements

• A minimum of 10 years of experience in DevOps, SRE, or Cloud Engineering.

• At least 2 years of practical experience in MLOps or LLMOps.

• Proficient in advanced Kubernetes (K8s), particularly with KubeFlow, Ray, or NVIDIA Triton.

• Strong expertise in GitHub Actions/GitLab CI, alongside Terraform or Pulumi.

• Familiarity with tools such as Weights & Biases, MLflow, LangSmith, or Arize Phoenix.

• Knowledge of GPU virtualization, CUDA drivers, and management of on-premises hardware.

• Understanding of Open Policy Agent (OPA) and secret management practices (Vault).

🏝️ Benefits

• Health insurance.

• Flexible working arrangements.

• Opportunities for professional development.