Azure AI Platform Engineer III/Senior

Posted 1 day ago

This is a fully remote position, open to applicants in California, +8 more states.

📋 Description

• Take ownership of the Azure infrastructure as code by authoring, reviewing, and deploying modular templates across both development and production environments.

• Manage Microsoft Foundry environments, including model deployments and the private Azure subscription, ensuring they function as production infrastructure through onboarding, upgrading, and retiring models.

• Oversee the AI gateway within Azure API Management, focusing on routing and transformation policies, consumer-specific keys, rate limits, and the onboarding of new models and consumers.

• Maintain the centralized tool registry, implementing identity and authentication patterns, versioning, and standards for reuse.

• Establish fleet-wide observability that encompasses logging, compliance log collection, monitoring, alerting, and usage telemetry attributed to both agents and users.

• Develop and manage evaluation infrastructure that controls releases and continuously assesses agents in production.

• Handle identity and access management using Entra ID's group-based least-privilege RBAC, managed identities, just-in-time elevation, and drift detection.

• Manage cost and performance through budgets and alerts, tagging, regular cost reviews, and optimizing latency and token usage.

• Set up guardrails and paved roads, which involve establishing spend limits, standardized build patterns, templates, and transitioning manually deployed services into code.

• Provide platform production support in collaboration with Cyber, Infrastructure, Network, Salesforce, and data teams while maintaining runbooks and documentation.


⛳️ Requirements

• A Bachelor's degree in a technical field (computer science, engineering, information systems, or a related area), or an equivalent mix of education and experience.

• A minimum of 6 years of experience in cloud platforms, infrastructure, DevOps, or site reliability engineering, with at least 3 years managing production workloads on Microsoft Azure.

• Experience in production infrastructure as code on Azure utilizing Bicep, ARM, or Terraform, including modular templates, parameterization, and multi-scope deployments.

• Proficiency in Azure identity and governance, encompassing Entra ID, RBAC, managed identities, Key Vault, and principles of least-privilege design.

• Understanding of Azure networking and security fundamentals, including VNets, private endpoints, TLS, and securing public endpoints.

• Familiarity with CI/CD and software fundamentals such as git, code review, deployment pipelines (GitHub Actions or Azure DevOps), and scripting in Bash, PowerShell, or Python.

• Knowledge of observability on Azure, specifically with Log Analytics, Application Insights, and KQL scripting.

• A solid understanding of LLM applications and agents, including model endpoints, tool calling, tokens, and evaluations, sufficient to design a platform for these functionalities.

• An effective communicator who documents processes well and can articulate infrastructure trade-offs to both engineers and business leaders.

• The selected candidate will be positioned in a role that best aligns with their skills and experience level.


🏝️ Benefits

• Opportunities for cross-functional collaboration.

• Development opportunities.

• Career advancement.

• Remote work options available, excluding certain states unless the candidate is willing to relocate.

People also viewed

RTX6 hours ago

Lead Platform Engineer

US flagConnecticut OnlyFull-timePlatform Engineer$132.4k – $251.6k/year
ApplyView job
ECP7 hours ago

Lead AI Engineer, Platform

US flagUnited States OnlyFull-timePlatform Engineer
ApplyView job
CSAA Insurance Group, a AAA Insurer7 hours ago

Senior Director, Platform Engineering

US flagUnited States OnlyFull-timePlatform Engineer
ApplyView job
Supabase7 hours ago

Storage Platform Engineer

Anywhere in the WorldFull-timePlatform Engineer
ApplyView job
Clarity Innovations, Inc.7 hours ago

Principal Platform Engineer

US flagUnited States OnlyFull-timePlatform Engineer$111.7k – $189.9k/year
ApplyView job
Avenga16 hours ago

Observability Platform Engineer

GB flagUnited Kingdom OnlyFull-timePlatform Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers