Senior AI Platform Engineer – LLM Gateway

This is a fully remote position, open to applicants in Spain.

📋 Description

• Implement components and configurations of the LLM Gateway according to the architecture, corporate standards, and controls.

• Design integrations and consumption patterns.

• Integrate the LLM Gateway with existing corporate mechanisms.

• Configure the Gateway for connectivity with suppliers.

• Integrate agents and consumer services with the corporate endpoint.

• Facilitate reusable patterns.

• Automate deployments, configuration, and testing using Infrastructure as Code (IaC).

• Contribute to establishing a corporate LLM Gateway platform and defining corporate standards.

• Work on the existing architecture to enable corporate access to generative AI models through a Gateway.

⛳️ Requirements

• 5 years of experience in software architecture, backend development, or systems integration.

• Advanced experience in consuming OpenAI APIs.

• Experience in managing streaming.

• Proficiency in Python.

• Knowledge of API and network security.

• Experience with orchestration frameworks LangChain and LlamaIndex.

• Experience in implementing secure connectivity.

• Experience in Cloud & SaaS, including AWS to OpenAI and Azure to OpenAI.

🏝️ Benefits

• Remote or hybrid work model.

• Flexibility in organizing work to support a balance between personal and professional life.

• Buddy support from day one.

• Annual training plan.

• Official certifications.

• Learning spaces.

• 100% subsidized health insurance.

• Flexible compensation through Edenred.

• 25 days of annual vacation.

• Well-being-oriented benefits.

• Friendly and collaborative work environment.