Senior AI Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Develop, document, and oversee the secure-by-default framework for the company's AI initiative.

• Create reference architecture for AI operations on Microsoft Azure.

• Design and manage production AI operations on Azure AI Foundry, encompassing model deployment, assessment, and oversight.

• Establish and maintain a comprehensive AI governance framework that includes intake processes, risk classification, audit trails, and executive reporting.

• Set security standards for Model Context Protocol servers and manage the approved tools library.

• Create enterprise landing-zone and Well-Architected strategies for AI, detailing management structures, policy guardrails, networking, and cost/quota strategies.

• Implement identity and access architecture utilizing Microsoft Entra ID, RBAC, managed identities, conditional access, and on-behalf-of flows.

• Define data retrieval and architecture patterns using RAG, Azure AI Search, embeddings, chunking, and retrieval-quality assessment.

• Leverage Microsoft Purview, custom Azure Policy, and Defender for Cloud for AI workloads.

• Document all production AI workloads, detailing ownership, models, data, controls, assessments, and runbooks.

• Write ADRs, architectural briefs, and risk communications tailored for executive, legal, and risk stakeholders.

• Collaborate with engineering teams to integrate them into the reference architecture and tools library, reviewing designs for security and compliance.

• Keep abreast of developments in Azure AI, agent frameworks, and AI governance standards.

• Provide technical leadership and mentorship throughout the AI program.

• Ensure adherence to data privacy, security, and AI governance standards.

⛳️ Requirements

• Proven experience in architecting and deploying production AI workloads on Azure AI Foundry, including model deployment, evaluation, and monitoring.

• Extensive expertise in Azure security architecture, covering private endpoints, managed identities, Key Vault, network isolation, and data-exfiltration controls.

• Experience in establishing and managing an AI governance framework end-to-end using NIST AI RMF or ISO/IEC 42001.

• Hands-on experience with Model Context Protocol (MCP) server architecture, including tool surface design, authentication, transport, and least-privilege reasoning.

• Familiarity with enterprise landing-zone and Well-Architected methodologies for scaling AI workloads.

• Proficiency in Microsoft Entra ID, RBAC, managed identities, conditional access, and on-behalf-of flows.

• Experience with production RAG, Azure AI Search, embeddings, and measuring retrieval quality.

• Knowledge of applying Microsoft Purview, custom Azure Policy, and Defender for Cloud within AI governance.

• Strong written communication skills for executive audiences, including ADRs, architectural briefs, and risk communication.

• Excellent problem-solving, analytical, communication, and technical documentation abilities.

• Capability to lead architecture and governance initiatives within a small, high-responsibility team.

• Proficient in advising various organizational levels on AI capabilities, governance, and business processes.

• Ability to analyze intricate data and prepare detailed reports, business requirements, technical documentation, and presentations.

• Bachelor's degree in Computer Science, Engineering, or equivalent experience is required.

• Over 10 years of professional experience in software engineering and architecture.

• At least 5 years of experience with Microsoft Azure is a must.

• Minimum of 2 years architecting production AI / LLM workloads is required.

• Microsoft certifications such as Azure AI Engineer Associate (AI-102), Azure Solutions Architect Expert (AZ-305), or Cybersecurity Architect Expert (SC-100) are highly desirable.

• Public artifacts such as reference architectures, technical writing, or presentations are considered a plus.

🏝️ Benefits

• Comprehensive healthcare coverage for you and your family.

• Discretionary 401(k) matching of 50% on the first 4% of contributions.

• Discounts on fitness, dining, retail, and other services through the employee portal.

• Tailored training programs.

• Bonuses for employee referrals.

• Educational reimbursement opportunities.

• Contributions to the Carrington Charitable Foundation.