This is a fully remote position, open to applicants in Hungary, +2 more countries.

📋 Description

• Direct the design and functionality of backend systems that integrate with LLMs and AI-driven search platforms

• Develop strong methodologies for assessing the quality and consistency of results generated by AI

• Ensure that LLM-enabled features are observable, testable, cost-effective, and adaptable to changes in models and external providers

• Assist the team in managing non-deterministic behavior, latency, rate limits, data quality, and graceful degradation in generative AI systems

• Keep abreast of advancements in LLMs and AI search, evaluating them in a practical manner

• Influence the architecture behind AI-search products

• Oversee the implementation of new capabilities

• Foster the growth and efficiency of the engineering team

• Convert customer requirements and emerging generative AI trends into dependable, scalable, and maintainable backend solutions

• Collaborate with Product, Engineering, and other relevant stakeholders

⛳️ Requirements

• Practical experience in building or managing production systems that utilize LLMs, generative AI, or AI-integrated external services

• Knowledge of how to assess and monitor LLM-enabled functionalities beyond conventional deterministic testing

• Experience in designing reliable integrations with third-party APIs, considering factors like cost, latency, rate limits, observability, and provider failures

• Capability to differentiate between effective AI applications and those better suited for traditional software solutions

• Familiarity with prompt management, retrieval-augmented generation, embeddings, vector search, or LLM evaluation frameworks is advantageous but not mandatory

• No background in training foundation models is necessary

• Backend engineering and technical leadership experience is inferred from the role