Software Engineer, AI Platform

This is a fully remote position, open to applicants in California.

📋 Description

• Define the strategic roadmap for the internal AI chat and agent platform.

• Implement and enhance an open-source frontend solution.

• Create AI-native software engineering workflows within GitLab.

• Establish sandboxes for AI development while adhering to safety policies.

• Develop systems for AI observability and cost tracking.

• Manage the AI gateway layer responsible for model routing.

• Work in collaboration with the security/compliance director to meet requirements.

• Provide periodic reports to leadership regarding friction points and potential opportunities.

⛳️ Requirements

• Several years of experience in building, deploying, and maintaining production software.

• Proficiency in at least one of the following: Python, Go, or TypeScript, along with Terraform.

• Familiarity with API design, testing, code reviewing, and managing services in production environments.

• Practical experience in developing LLM-powered systems including retrieval pipelines, tool usage/MCP, and agent orchestration.

• Strong product sense for internal tools: experience in deploying, enhancing, and integrating open-source applications.

• Experience in developer-platform integration: working with Git-hosting APIs, webhooks, and CI/CD processes.

• Expertise in cloud and Kubernetes engineering: building and maintaining the infrastructure for your systems.

• Knowledge of sandboxing and isolation principles: understanding safe execution of model-generated code.

🏝️ Benefits

• Health insurance

• 401(k)

• Dental insurance

• Vision insurance

• Life insurance

• Paid time off

• Competitive salary