Staff AI Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and implement a DevOps strategy while overseeing infrastructure architecture across diverse cloud systems in multiple environments and regions.

• Design and manage scalable Kubernetes platforms and large-scale containerized infrastructure.

• Oversee the infrastructure-as-code strategy and establish standards across various environments.

• Spearhead the implementation of DevSecOps, focusing on secrets management, compliance, auditing, IAM, and zero-trust networking.

• Enhance platform reliability, ensure performance SLAs, and optimize costs across production systems.

• Direct intricate cloud migrations and platform modernization projects.

• Manage the observability strategy and practices for production reliability.

• Guide the design and operation of AI/ML platform infrastructure, which includes model serving and deployment, GPU workload orchestration, LLM gateway and observability, vector store infrastructure, and CI/CD for AI/ML systems.

• Utilize modern AI tools such as Claude and Cursor to deliver high-quality work efficiently.

• Collaborate with engineering, product, and leadership teams to align platform strategy with business objectives and delivery goals.

• Convey complex infrastructure decisions and trade-offs to both technical and non-technical stakeholders.

• Facilitate design reviews, architecture discussions, and assessments for release readiness.

• Establish standards and best practices for platform engineering.

• Mentor junior and mid-level engineers.

• Serve as a technical escalation point for intricate infrastructure and platform challenges.

• Assess emerging tools and technologies to enhance platform reliability and improve the developer experience.

⛳️ Requirements

• Over 7 years of professional experience in DevOps or platform engineering, with a proven track record of leading complex platform initiatives.

• Extensive experience with AI/ML platform infrastructure, including model serving and deployment, GPU workload orchestration, LLM gateway and observability, vector store infrastructure, and CI/CD for AI/ML systems.

• Proficient in designing and provision of HPC cluster infrastructure utilizing CI/CD pipelines across AWS, CoreWeave, GCP, and OCI.

• Familiarity with HPC job schedulers and workload managers such as Slurm or equivalent for job submission and queue management.

• Advanced scripting and programming skills in languages such as Python, Go, Java, and Bash.

• In-depth cloud expertise in at least one major platform.

• Mastery of Kubernetes and container orchestration technologies.

• Proficient in infrastructure-as-code practices using multiple tools.

• Strong experience in CI/CD architecture at scale.

• Solid background in DevSecOps, including secrets management, compliance, and auditing.

• Knowledge of networking, IAM, security architecture, and zero-trust principles within cloud environments.

• Experience with service mesh, distributed systems, and microservices architecture.

• Demonstrated leadership and mentoring capabilities within a team or organization.

• Excellent communication skills with the ability to convey technical concepts to diverse audiences.

• Proven daily usage and expert knowledge of AI-driven tools like Claude and Cursor.

• Strong problem-solving abilities and the capacity to tackle complex technical and business challenges with sound judgment.

• Cloud certifications or experience in FinOps is a bonus.

🏝️ Benefits

• Paid time off

• Medical insurance

• Dental insurance

• Vision insurance

• 401(k)