
Senior AI Product Engineer
Posted Jul 28

Posted Jul 28
This is a fully remote position, open to applicants in Europe.
• Take ownership of the complete quality of our AI-driven product experiences, enhancing response usefulness, consistency, and reliability in ways that users can truly appreciate.
• Develop evaluation frameworks and consistent test sets to enable us to assess AI quality in an objective manner rather than relying on anecdotes.
• Create and conduct experiments on prompts, contextual strategies, and model settings, linking each modification to activation, conversion, retention, or satisfaction metrics.
• Oversee and minimize AI-related expenses (tokens, latency, model selection, retrieval) without sacrificing user experience.
• Interpret AI failure patterns, hallucinations, inconsistent outputs, and weak reasoning into clear, prioritized solutions for Product and Engineering teams.
• Assist Product, Growth, and Engineering teams in understanding how AI modifications lead to tangible user and business impacts.
• A minimum of 5 years of experience in software engineering, AI product engineering, ML engineering, or a similar technical role, along with at least 2 years of hands-on experience with LLMs, prompt engineering, or applied AI systems.
• Demonstrated experience in enhancing AI features post-launch through analytics, experimentation, and structured evaluation, beyond just initial prompt design.
• Strong understanding of product analytics, funnel metrics, and the ability to connect AI behavior to business results.
• Proficient in diagnosing whether an AI quality issue arises from prompts, context, model constraints, UX, or data, and capable of addressing the appropriate layer.
• Excellent written communication skills and the ability to work independently in a remote, asynchronous environment.
• Comfortable collaborating closely with Product, Growth, Design, Engineering, QA, and Analytics teams.
• Embrace ownership, transparency, and a results-oriented mindset.
• Remote-first: work from any location globally, with no need for relocation.
• Flexible hours: we focus on outcomes rather than the time spent at a desk.
• Unlimited PTO: take the time you need to rest, recharge, and perform at your best.
• Learning & development budget: invest in courses, books, conferences, certifications, or anything that supports your growth.
• Performance-based compensation: your contributions directly influence your salary and career advancement.
• Join a small, senior, collaborative team where your work is recognized, and your decisions carry weight.
• Opportunity to develop products that are utilized by millions across more than 160 countries.
Smartsheet
Archy
RD Station
Get handpicked remote jobs straight to your inbox weekly.