
Azure AI Platform Engineer III/Senior
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in California, +8 more states.
• Take ownership of the Azure infrastructure as code by authoring, reviewing, and deploying modular templates across both development and production environments.
• Manage Microsoft Foundry environments, including model deployments and the private Azure subscription, ensuring they function as production infrastructure through onboarding, upgrading, and retiring models.
• Oversee the AI gateway within Azure API Management, focusing on routing and transformation policies, consumer-specific keys, rate limits, and the onboarding of new models and consumers.
• Maintain the centralized tool registry, implementing identity and authentication patterns, versioning, and standards for reuse.
• Establish fleet-wide observability that encompasses logging, compliance log collection, monitoring, alerting, and usage telemetry attributed to both agents and users.
• Develop and manage evaluation infrastructure that controls releases and continuously assesses agents in production.
• Handle identity and access management using Entra ID's group-based least-privilege RBAC, managed identities, just-in-time elevation, and drift detection.
• Manage cost and performance through budgets and alerts, tagging, regular cost reviews, and optimizing latency and token usage.
• Set up guardrails and paved roads, which involve establishing spend limits, standardized build patterns, templates, and transitioning manually deployed services into code.
• Provide platform production support in collaboration with Cyber, Infrastructure, Network, Salesforce, and data teams while maintaining runbooks and documentation.
• A Bachelor's degree in a technical field (computer science, engineering, information systems, or a related area), or an equivalent mix of education and experience.
• A minimum of 6 years of experience in cloud platforms, infrastructure, DevOps, or site reliability engineering, with at least 3 years managing production workloads on Microsoft Azure.
• Experience in production infrastructure as code on Azure utilizing Bicep, ARM, or Terraform, including modular templates, parameterization, and multi-scope deployments.
• Proficiency in Azure identity and governance, encompassing Entra ID, RBAC, managed identities, Key Vault, and principles of least-privilege design.
• Understanding of Azure networking and security fundamentals, including VNets, private endpoints, TLS, and securing public endpoints.
• Familiarity with CI/CD and software fundamentals such as git, code review, deployment pipelines (GitHub Actions or Azure DevOps), and scripting in Bash, PowerShell, or Python.
• Knowledge of observability on Azure, specifically with Log Analytics, Application Insights, and KQL scripting.
• A solid understanding of LLM applications and agents, including model endpoints, tool calling, tokens, and evaluations, sufficient to design a platform for these functionalities.
• An effective communicator who documents processes well and can articulate infrastructure trade-offs to both engineers and business leaders.
• The selected candidate will be positioned in a role that best aligns with their skills and experience level.
• Opportunities for cross-functional collaboration.
• Development opportunities.
• Career advancement.
• Remote work options available, excluding certain states unless the candidate is willing to relocate.
RTX
CSAA Insurance Group, a AAA Insurer
Supabase
Get handpicked remote jobs straight to your inbox weekly.