Senior Engineer, AI

This is a fully remote position, open to applicants in California.

📋 Description

• Establish, document, and oversee the secure-by-default framework for the company's AI initiatives.

• Create and document a secure-by-default reference architecture for AI workloads on Microsoft Azure.

• Design and manage production AI workloads on Azure AI Foundry, encompassing model deployment, evaluation, and monitoring.

• Develop and implement a comprehensive AI governance framework that includes intake, risk classification, audit trails, and executive reporting.

• Set security standards for MCP servers and maintain the approved tool library.

• Design enterprise landing zones and Well-Architected patterns for AI, addressing management structure, policy guardrails, networking, and cost/quota strategies.

• Implement identity and access architecture utilizing Microsoft Entra ID, RBAC, managed identities, and conditional access.

• Define retrieval and data architecture patterns such as RAG, Azure AI Search, embeddings, chunking, and retrieval-quality evaluation.

• Employ Microsoft Purview, custom Azure Policy, and Defender for Cloud for AI workloads.

• Maintain documentation for every production AI workload, including ownership, models, data, controls, evaluation, and runbooks.

• Draft architecture decision records, architecture briefs, and risk language suitable for board presentations.

• Collaborate with engineering teams to onboard groups to the reference architecture and tool library, while reviewing designs to ensure security and compliance.

• Keep abreast of advancements in Azure AI, agent frameworks, and AI governance standards.

• Provide technical leadership and mentorship throughout the AI program.

• Ensure adherence to data privacy, security, and AI governance regulations.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience is required.

• Over 10 years of professional experience in software engineering and architecture.

• At least 5 years of experience working with Microsoft Azure.

• Minimum of 2 years of experience architecting production AI / LLM workloads is essential.

• Proven experience in architecting and deploying production AI workloads on Azure AI Foundry.

• Extensive knowledge of Azure security architecture, including private endpoints, managed identities, Key Vault, network isolation, and data exfiltration controls.

• Experience in building or managing an end-to-end AI governance framework based on NIST AI RMF or ISO/IEC 42001.

• Proficiency in Model Context Protocol (MCP) server architecture.

• Experience in enterprise landing zones and Well-Architected designs for scalable AI workloads.

• Expertise in Microsoft Entra ID, RBAC, managed identities, conditional access, and on-behalf-of flows.

• Hands-on experience with production RAG, Azure AI Search, embeddings, and retrieval quality measurement.

• Familiarity with applying Microsoft Purview, custom Azure Policy, and Defender for Cloud to AI workloads.

• Strong written communication skills for engaging with executive audiences and working with legal, risk, and executive stakeholders.

• Excellent problem-solving, analytical, communication, and technical documentation abilities.

• Capability to lead architecture and governance efforts within a small, high-responsibility team.

• Ability to advise all organizational levels on AI capabilities, governance, and business processes.

• Proficient in analyzing complex data and producing detailed reports, business requirements, technical documentation, and presentations.

• Microsoft Azure certifications such as AI-102, AZ-305, or SC-100 are highly desirable.

• Publicly available artifacts like reference architectures, technical writing, or presentations are advantageous.

🏝️ Benefits

• Comprehensive healthcare plans for you and your family.

• Discretionary 401(k) match of 50% of the first 4% of pay contributed.

• Fitness, restaurant, retail, and other discounts available through the employee portal.

• Tailored training programs to enhance your skills.

• Employee referral bonuses to encourage team building.

• Educational reimbursement to support your learning and development.

• Participation in Carrington Charitable Foundation community programs.