Senior GenAI Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Develop end-to-end features powered by LLM.

• Create and implement agentic workflows, retrieval mechanisms, and tool invocation using LangGraph.

• Deliver LangGraph functionalities as FastAPI services, incorporating streaming capabilities, persistence, and comprehensive testing.

• Construct evaluation datasets, regression testing suites, and LLM-as-judge assessments to evaluate prompt and model modifications.

• Transform user inquiries into efficient queries for the search platform.

• Coordinate multi-step research cycles and define model context.

• Identify whether incorrect responses stem from retrieval processes, queries, or prompts, and resolve the underlying problems.

• Implement Langfuse tracing within production workflows.

• Examine incorrect responses using actual production traces.

• Manage latency, token usage, and cost constraints.

• Direct requests among various model sizes and families through an AI gateway.

⛳️ Requirements

• Over 5 years of professional experience.

• Proficient in building and operating backend services, including APIs, asynchronous programming, and testing.

• Practical experience in deploying LLM features to production and maintaining them.

• Familiarity with agent/orchestration frameworks, preferably LangGraph.

• Hands-on experience with Retrieval-Augmented Generation (RAG).

• Experience in debugging LLM systems in production, focusing on tracing, evaluation, cost, and latency.

• Background in running cloud services, with a preference for Azure.

• Excellent problem-solving, analytical, and technical decision-making abilities.

• Proficient in English.

• Strong communication skills and ability to work collaboratively in a team.

• Open-minded, innovative, and driven to advance AI and automation.

• Nice to have: Experience with Azure OpenAI, AI Search, and App Service.

• Nice to have: Knowledge of infrastructure-as-code using Bicep.

• Nice to have: Experience in mentoring or as a technical lead.

🏝️ Benefits

• B2B contract.

• Fully remote work.

• Long-term engagement.

• Opportunity to work on a live LLM product.

• Access to a modern AI/LLM technology stack.

• Flexible working environment.