
Senior AI / LLM Engineer, HealthTech
Posted Jul 28

Posted Jul 28
This is a fully remote position, open to applicants in Ukraine.
• Develop and deploy LLM functionalities: retrieval (RAG), agents, tool utilization, and structured outputs, seamlessly integrated into our .NET services.
• Ensure quality ownership: create evaluation sets, assess before and after each modification, and detect regressions prior to customer impact.
• Manage production operations: monitor latency, cost per request, caching strategies, fallbacks, as well as monitoring and alerting systems.
• Establish guardrails: implement prompt-injection defenses, handle PII, validate outputs, and maintain audit trails.
• Create reusable building blocks for other product teams, preventing repetitive solutions to the same challenges.
• Collaborate with product teams and architects to select the appropriate tools. Advocate for simpler rules when they prove more effective than models.
• Embrace an AI-first approach: leverage Claude / Claude Code in daily development to enhance design, building, and testing speed.
• Actively engage in a remote scrum team: participate in sprint ceremonies, conduct PR reviews, and share knowledge.
• Over 5 years of experience in building production software, with a strong command of C# and modern .NET (.NET Core / .NET 6+).
• 1-2+ years of experience in developing LLM features that have gone into production and served real users.
• Proficient in retrieval methodologies: chunking, embeddings, hybrid searches, reranking, and accurately measuring result quality.
• Experience with agents and tool utilization: function calling, MCP or a similar tool protocol, and multi-step workflows with error management.
• Strong evaluation discipline: you have constructed evaluation sets and utilized them for decision-making. You can articulate how you determined a change was beneficial.
• Familiarity with cloud environments (preferably Azure) and solid engineering principles (clean design, testing, CI/CD).
• Awareness of cost and latency: you understand the cost per request of your features and the underlying reasons.
• Hands-on experience with AI coding assistants (Claude / Claude Code, Copilot, or similar tools).
• Ability to work autonomously within a remote, asynchronous-friendly team.
• Proficient in written and spoken English (B2+ level).
• Pragmatic mindset: during the interview, we will ask for an instance where you determined that a simple rule or a small classic model was a better solution than an LLM.
• Digital-First Approach: Exceptional talent transcends borders! Work from anywhere — we recruit and collaborate with professionals globally.
• Remote Work Model: Achieve a healthy work-life balance with our flexible working conditions, allowing you to perform your best from any location.
• Exciting Projects: Engage in meaningful projects across various industries that challenge and inspire creativity.
• Boost Your Expertise: Advance your career through continuous learning, development opportunities, and hands-on experience.
• Join the Best Team Ever: Collaborate with our diverse and multicultural team of passionate technologists and innovative thinkers.
Seeking Alpha
Seeking Alpha
Seeking Alpha
Peraton
Get handpicked remote jobs straight to your inbox weekly.