Junior AI Engineer – Applied AI

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop, assess, and strengthen Guidewire Concierge, an omnichannel AI agent tailored for property and casualty insurers.

• Take ownership of complete segments of the agent, which includes prompt and context architecture, data retrieval over policy and coverage, tool/API integrations with core claims systems, and facilitating human handoffs.

• Establish and manage evaluation cycles, create golden sets, conduct trajectory assessments, utilize LLM as an evaluator, and perform error analysis on live call data.

• Ensure that evaluations serve as a gate for product releases.

• Enhance containment and resolution rates while maintaining accuracy standards.

• Equip the system with capabilities to track changes in containment and accuracy.

• Focus on the voice pathway, addressing turn-taking, interruptions, latency budgets, and LiveKit/SIP telephony functionality.

• Participate in carrier calls and review recordings to pinpoint conversation challenges.

• Contribute to shaping product direction, agent behavior, minimum viable product (MVP) decisions, and claims processes.

• Provide a brief overview of a delivered project where model unpredictability played a critical role and the strategies implemented to address it.

⛳️ Requirements

• Proven experience in building and deploying AI applications.

• Successfully shipped an LLM application relied upon by real users.

• Comprehensive understanding of LLMs, context engineering, retrieval-augmented generation (RAG), and agentic workflows.

• Strong background in machine learning (ML) and deep learning.

• Experience with rigorous evaluations, error analysis, and statistical assessments.

• Solid grasp of software engineering principles, including cost management, latency, reliability, scalability, data storage, distributed systems, testing, security, privacy, and CI/CD automation.

• Regular use of coding agents in daily tasks.

• Product insight and sufficient knowledge of the insurance sector to aid in product decisions.

• Willingness to continually learn as the field evolves.

• Preferred: Experience with real-time or streaming voice systems, including automatic speech recognition (ASR), text-to-speech (TTS), telephony, and SBC/SIPREC.

• Preferred: Background in insurance, claims, or another regulated industry.

• Preferred: Experience with internal evaluation or observability tools.

• Preferred: Knowledge of machine learning principles or experience in experimenting with, training, and deploying models in a production environment.

• Preferred: Exposure to P&C insurance or Guidewire products and services.

• Preferred: Familiarity with DSPy or GEPA prompt/pipeline optimization frameworks applied in production.

• Ability to clear criminal history and other background checks when required.

🏝️ Benefits

• Health insurance.

• Dental insurance.

• Vision insurance.

• Paid time off.

• Company-sponsored retirement plan.

• Certain roles may qualify for the annual company bonus plan.

• Certain roles may be eligible for commissions.

• Certain roles may qualify for long-term incentive awards.

• Disability-related accommodations and support available during the hiring process.