Staff AI Architect

This is a fully remote position, open to applicants in Massachusetts.

📋 Description

• Take ownership of the AI reference architecture, encompassing orchestration, tool utilization, capability boundaries, memory and state management, retrieval, evaluation, and observability.

• Develop, prototype, code, and publish reference implementations for complex and ambiguous components.

• Design and architect internal shared AI platform services for model accessibility, routing, runtimes, evaluation, durable orchestration, and a self-service developer experience.

• Define versioned, schema-defined agent tools and capability layers utilizing standards like the Model Context Protocol.

• Create integration, identity, and authorization patterns to ensure safe agent interactions with enterprise systems.

• Re-architect workflows in finance, recruiting, sales operations, support, and IT to be AI-native.

• Incorporate governance and safety into the architecture, including capability boundaries, human approval processes, evaluation evidence, audit trails, and lifecycle management.

• Manage unit economics through model routing, context management, caching, batching, and cost attribution.

• Draft RFCs and ADRs, sustain durable interfaces, and establish technical standards for AI development, deployment, and operations.

• Elevate the technical standards through architecture reviews and impactful code; mentor engineers across the US and India.

• Collaborate with platform engineering, security, identity, data, program management, and business stakeholders.

⛳️ Requirements

• Significant experience as a software, solution, or enterprise architect, generally 10+ years, including responsibility for more than one project or team.

• Recent hands-on experience in building LLM and agentic systems in production.

• Familiarity with agent orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, OpenAI Agents SDK, or similar alternatives.

• Proficient with Model Context Protocol tooling, retrieval mechanisms, vector stores, and LLMOps.

• Knowledge in evaluation-first development, prompt and agent versioning, regression testing, observability for non-deterministic outputs, and cost attribution.

• Expertise in at least one production programming language: Python, Go, TypeScript, or Java.

• Experience with cloud-native infrastructure, including Kubernetes, serverless architecture, APIs, event-driven patterns, and observability.

• Background in architecting and integrating enterprise systems such as Workday, Salesforce, NetSuite, Greenhouse, ServiceNow, or similar platforms.

• Proficient in API and event-driven design, along with workflow and iPaaS platforms, and cloud data solutions.

• Understanding of agent identity and security aspects, including short-lived machine identity, scoped secrets, delegation with provenance, default-deny tool access, prompt-injection defense, and audit trails.

• Awareness of the OWASP Agentic AI risk landscape.

• Familiarity with NIST AI RMF, ISO/IEC 42001, and the EU AI Act.

• Ability to convert ambiguous business challenges into well-defined AI systems.

• Strong written and verbal communication skills, with the capability to influence both technical and non-technical stakeholders.

• Effective collaboration across time zones, including with engineering teams in India.

• Comfortable working remotely; the position also references the Boston/Cambridge area.

• A Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience is noted under 'Bonus Points' and is thus optional.

🏝️ Benefits

• Reimbursement for relevant conferences, training, and educational opportunities.

• Access to over 10,000 courses on LinkedIn Learning.

• Employee Assistance Program.

• Local employee meetups.

• Flexible time off policy.

• Competitive benefits package, varying according to local regulations and preferences.

• Bonus potential based on individual and company performance.

• Equity compensation for qualifying employees, including equity grants upon hire.

• Option to participate in the Employee Stock Purchase Program.