Staff AI Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, construct, and manage elements of the AI Gateway, encompassing centralized identity and authentication/authorization, token budgeting, data loss prevention (DLP) and content guardrails, multi-model routing and failover, MCP allow-listing, and request-level audit logging.

• Develop and sustain components of the Harness layer, including agent orchestration (LangGraph or its equivalent), prompt creation and context management, memory and state handling during multi-turn interactions, and model abstraction across providers like AWS Bedrock and Google Vertex.

• Create and enhance production services using Python (FastAPI) and pydantic.ai for LLM-powered components, while also contributing to the React/TypeScript interfaces that present platform functionalities to internal teams.

• Implement MCP/tool wiring for both internal and SaaS-embedded agents, ensuring that all callers, regardless of origin, adhere to the same policy controls.

• Contribute to the Claude and Gemini Enterprise plugin framework by developing, testing, and strengthening role-based skills and agents, while also aiding in the maturation of the pipeline for authoring, evaluating, and deploying plugins.

• Equip the platform for observability, including metrics, tracing, and audit trails, while also participating in on-call and operational support for platform services.

• Produce clear technical documentation and engage in architecture and code reviews, maintaining a high standard for quality, security, and maintainability.

• Collaborate with engineers across Enterprise Data, Enterprise Apps, Product Development, and Infosec to integrate the platform with governed data sources and shared architectural contracts.

• Assist the Sr. Director and model evaluation tooling in bridging the gap between evaluation outcomes and model selection, prompt tuning, and routing decisions.

⛳️ Requirements

• Practical experience in developing production services that cater to multiple consumers such as an API gateway, internal platform, or data platform, with hands-on exposure to authentication/authorization, rate limiting, observability, or audit logging; direct experience with AI and LLM platforms is a valuable asset but not mandatory.

• Experience with agent orchestration frameworks (LangGraph or equivalent) and interfacing with hosted model providers like AWS Bedrock or Google Vertex, coupled with a practical understanding of how context windows, memory, and tool-calling function in a production environment, beyond just conceptual knowledge.

• At least 5 years of professional software engineering experience, including work in building or managing AI and ML infrastructure within a production setting.

• Proficient in Python, preferably with FastAPI, and comfortable learning frameworks such as pydantic.ai for LLM-powered components; familiarity with React and TypeScript is an advantage.

• An interest in or exposure to the Model Context Protocol (MCP) and the challenges associated with governing tool access for agents operating across enterprise systems.

• Familiarity with enterprise AI deployments like Claude Enterprise (Anthropic) or Gemini Enterprise is a plus, particularly regarding their administration and the functioning of access and policy controls.

• Strong foundation in software engineering principles, including the ability to produce clean, tested, production-quality code, exceptional API design skills, and the capability to provide and receive constructive feedback during code and architecture reviews.

• Ability to thrive in a dynamic, evolving platform environment where ambiguity is common, and enthusiasm for transforming a rough architecture into efficient, reliable infrastructure is essential.

🏝️ Benefits

• Restricted Stock Units (RSUs)

• Employee Stock Purchase Plan (ESPP)

• Flexible time off

• Paid company holidays and paid sick time

• Gender-neutral parental leave

• Grandparent leave

• Medical, dental, and vision coverage

• 401(k) retirement plan with company match

• Life and disability insurance

• Health and dependent care FSA

• Voluntary benefits (hospital, accident, critical illness)

• Employee Assistance Program (EAP)

• ARAG pre-paid legal

• Nationwide pet insurance

• Cancer Care program

• Global business travel medical insurance

• Home office allowance

• Mobile phone reimbursement

• Wellness coach

• Wellness/gym reimbursement

• Fertility coverage

• Adoption & surrogacy reimbursement