Lead AI Platform Engineer

📋 Description

• Design, construct, and manage the corporate AI Gateway utilizing Azure API Management (APIM).

• Create sophisticated governance, authentication, routing, and observability policies tailored for generative AI workloads.

• Integrate various AI providers such as Azure OpenAI, Azure AI Foundry, GCP Vertex AI, AWS Bedrock, and Adobe Firefly.

• Implement FinOps strategies to oversee consumption, manage per-subscription quotas, token budgeting, and cost attribution.

• Develop and sustain infrastructure as code (IaC) through Terraform/OpenTofu.

• Construct and enhance CI/CD pipelines using GitHub Actions with OIDC authentication.

• Establish centralized observability frameworks employing Application Insights, KQL, Azure Workbooks, Datadog, and CloudWatch.

• Create APIM policies for SSE streaming, request/response transformation, retry mechanisms, fallback procedures, and backend routing.

• Focus on platform security by utilizing Azure AD, JWT validation, WAF tuning, Front Door, and Key Vault.

• Automate operations and administrative workflows with Bash, PowerShell, and Python.

• Generate technical documentation, OpenAPI specifications, and materials for both technical and non-technical audiences.

• Assist internal teams in the secure and scalable adoption of generative AI technologies.

• Translate technical constraints and architectural choices into clear recommendations suitable for diverse stakeholders.

• Operate independently to identify needs, prioritize enhancements, and continuously advance the platform.

⛳️ Requirements

• Extensive experience with Azure API Management (APIM).

• Profound understanding of Large Language Models (LLMs), encompassing tokenization, context windows, reasoning models, and multimodal workloads.

• Proficient in Azure OpenAI and Azure AI Foundry.

• Familiarity with multi-cloud architectures and integrations among AI providers.

• Expertise in Terraform/OpenTofu and infrastructure as code.

• Experience with GitHub Actions utilizing OIDC (without persisted secrets).

• Knowledge of REST APIs, OpenAPI 3.x, SSE streaming, and request/response transformation.

• Background in observability using Application Insights, KQL, Datadog, or comparable tools.

• Understanding of quota management, rate limiting, and FinOps strategies applied to generative AI.

• Proficient in authentication/authorization processes using Azure AD, OAuth2/OIDC, and JWT validation.

• Skills in troubleshooting and problem analysis within distributed environments.

• Experience with automation using Bash, Python, or PowerShell.

• Advanced proficiency in English for technical communication and international collaboration.

🏝️ Benefits

• All necessary equipment for your work (laptop and peripherals);

• Health and dental insurance;

• Life insurance;

• Mental health program;

• Anywhere office – flexibility to work from wherever you need;

• Meal and food allowances (VR/VA) (Flash benefits card);

• Home office allowance (Flash benefits card);

• Mobility allowance (Flash benefits card);

• Mentorship program for career development and guidance;

• Access to development tracks (investment in courses, etc.) and to our free learning platform featuring numerous self-learning courses;

• Private English lessons with a personal instructor;

• Awesomeness – delivery of themed and exclusive gifts;

• Gympass;

• Flexible working hours (40 hours per week);

• Birthday day off;

• Appreciation – recognition program with the option to give and receive monthly 'dentsu dollars';

• Fully remote or hybrid work (your choice).