
AI Platform Lead – AI Specialist
Posted Nov 13

Posted Nov 13
This is a fully remote position, open to applicants in Spain.
• Lead the AI Platform technically and define its technical direction.
• Address team inquiries and approve critical platform decisions.
• Co-lead the AI Center with the Cross-Functional Leader, aligning technical and business agendas.
• Develop reusable cross-cutting technical cases.
• Build and maintain shared components of the ecosystem.
• Manage the inventory of agents and their users through FinOps.
• Evaluate models to identify PII, biases, and hallucinations.
• Mitigate model drift over time.
• Construct quality assessment frameworks utilizing LLM-as-a-judge.
• Collaborate with Architects, Support, Integrations, DevOps, DevSecOps, Full Stack, the Cross-Functional Leader, and LLM providers.
• Maintain a comprehensive view of production agents and optimize the AI budget.
• Bachelor's degree in Computer Science / Engineering (mandatory).
• Master's degree preferred.
• Proficiency in Python and SQL; SQL Server on-prem as the primary data source.
• LangGraph experience.
• Orchestration of ML/GenAI pipelines using Airflow / Metaflow.
• RAG and retrieval on on-premise data due to regulations.
• Expertise in prompt engineering and context engineering.
• Design of evaluation frameworks for hallucination, factual consistency, precision/recall, latency, throughput, and cost, including golden datasets, regression gates in CI, and LLM-as-a-judge.
• Implementation of guardrails, fallbacks, and HITL patterns for responsible AI.
• Design from scratch of vector database implementations, with pgvector as the primary on-prem compatible option.
• Deep expertise in the functioning of LLMs.
• FinOps for tokens and cost/latency trade-offs.
• Experience with Pydantic, pytest, and type hints.
• Understanding of cybersecurity applied to AI, including handling of PII and boundary cloud/on-prem.
• Ability to set technical direction, make decisions under ambiguity, and coordinate the team.
• Experience with LangChain, LlamaIndex, CrewAI, and other agent frameworks is valued.
• Knowledge of hybrid retrieval, fine-tuning/PEFT (LoRA, QLoRA), multi-agent systems, ReAct, RLAIF, red-teaming, Graph RAG, model gateways, SSAS, MCP/A2A memory patterns, and TypeScript is valued.
• Proficiency in Spanish.
• Competitive salary and performance bonuses.
• Opportunities for professional development and training.
• Flexible work hours and remote work options.
• Access to cutting-edge technology and tools.
• Collaborative and innovative work environment.
Extend
OhioHealth
Capital One
Software Mind
Get handpicked remote jobs straight to your inbox weekly.