AI Architect

This is a fully remote position, open to applicants in Bulgaria, +3 more countries.

📋 Description

• Design and oversee the development of production-ready Generative AI solutions for clients from the discovery phase to implementation.

• Lead the architecture and delivery of Generative AI solutions.

• Provide guidance to development teams on appropriate tools, frameworks, and platforms.

• Convert business requirements into application, service, and target-state architectures.

• Take ownership of scalability, performance, latency, observability, security, and cost optimization for AI solutions.

• Lead technical design sessions and code reviews.

• Define adaptation strategies including prompting, RAG, fine-tuning, or distillation.

• Manage evaluation strategies involving golden datasets, offline and online evaluations, LLM-as-judge, and CI regression testing.

• Establish retrieval quality standards for chunking, hybrid search, reranking, query rewriting, and permission-aware retrieval.

• Define standards for AI security, privacy, Responsible AI, and governance controls.

• Oversee solution economics through model routing, caching, batching, and capacity planning.

• Support enterprise architecture standards and evaluate technology solutions.

• Supervise vendor developers while mentoring engineers and junior architects.

• Assist in business development by identifying and researching client opportunities.

• Enhance internal design and development practices while maintaining documentation.

• Foster internal relationships and enhance the firm's reputation.

⛳️ Requirements

• Over 5 years of experience in agile product delivery.

• Hands-on experience in designing and delivering large-scale production software solutions.

• Proven expertise in Generative AI solution architecture.

• Successfully delivered at least one Generative AI system to production and can articulate its architecture, failure modes, operating costs, and lessons learned.

• Bachelor's or Master's degree in Computer Science or Engineering, or equivalent practical experience.

• Strong hands-on experience with Generative AI architecture.

• Familiarity with large language models such as GPT-4, Gemini, and Llama.

• Experience with RAG, agent orchestration, and Microsoft Copilots.

• Proficient in vector search and retrieval engineering.

• Background in production AI agents.

• Experience with structured generation.

• Knowledge of cloud-native Azure architecture, including Azure Machine Learning and Azure AI services.

• Proficient in service-oriented, event-driven, and microservices architectures.

• Experience with relational and NoSQL data stores, such as Microsoft SQL Server and MongoDB.

• Familiarity with Docker and/or Kubernetes.

• Experience in DevOps and delivery practices, including CI/CD, automation, and environment management.

• Understanding of user-centered product practices.

• Experience with AI evaluation using golden datasets, LLM-as-judge, and prompt and model regression testing.

• Knowledge of LLMOps and observability.

• Understanding of model economics.

• Knowledge of AI security, including prompt injection, data exfiltration, jailbreak resistance, sandboxing, least-privilege identities, supply-chain risk, and the OWASP Top 10 for LLM Applications.

• Fluent in written and spoken English.

• Relevant Microsoft Azure certification is preferred.

• Familiarity with Model Context Protocol, model adaptation, multimodal AI, AI regulation and assurance frameworks, as well as consulting or professional-services experience are considered advantageous.

🏝️ Benefits

• Professional, positive, and team-oriented working environment.

• Gain professional experience in an international setting.

• Access to company training and excellent opportunities for professional and career growth.

• Engage in challenging and interesting projects.

• Additional medical insurance provided.

• Food vouchers worth EUR 102.26 per month.

• Sport card benefits.

• A fringe benefit package.

• Annual bonus opportunities.

• Flexibility to work from home.

• Centrally located office in Sofia.