Senior AI Engineer

This is a fully remote position, open to applicants in Ireland.

📋 Description

• Design and deliver AI agent systems from conception to production, including early-stage experiments.

• Take responsibility for the data access layer, retrieval strategies, and integrations with Kota’s infrastructure such as Metabase and internal APIs.

• Create and manage an evaluation framework utilizing golden datasets, regression harnesses, and analysis of retrieval-versus-generation failures.

• Tackle prompt injection, data boundary issues, and silent failures in a regulated environment.

• Define the technical strategy for AI at Kota, influencing the architecture of agents and product opportunities.

• Collaborate with the AI pod and Platform team to identify and leverage AI opportunities.

• Partner with the AI Product Lead for effective project execution.

• Enhance engineering practices through peer reviews and comprehensive documentation.

• Expand responsibilities and shape the early AI pod as its scope evolves.

⛳️ Requirements

• Over 5 years of experience in software engineering.

• A minimum of 2 years directly involved in LLM or AI agent systems in a production environment.

• Solid understanding of agent architecture, including context management, tool utilization, retrieval strategies, and prompt design.

• Capability to make and justify trade-offs between various architectural approaches for agents.

• Experience in developing evaluation frameworks, encompassing golden datasets, regression testing, and analysis of retrieval-versus-generation failures.

• Comfortable working across the technology stack.

• Excellent written communication skills, with the ability to articulate technical decisions clearly to non-technical audiences.

• A background in fintech, payroll, HR tech, or benefits is highly advantageous.

• Familiarity with AWS, Azure, or the broader Microsoft ecosystem is a significant plus.

• Experience in generating synthetic evaluation data is an added benefit.

• Background in early-stage or scale-up environments is highly desirable.

• Ability to work within +/- 4 hours of GMT for collaborative purposes.

• Must have the right to work in the country of residence without requiring visa sponsorship.

🏝️ Benefits

• Health Insurance provided by Kota with a generous allowance.

• Workplace Pension with matched contributions up to 5% through Kota.

• Work-from-home stipend to assist with your home office setup.

• 25 days of Paid Time Off.

• Annual company-wide offsite and dedicated team offsite.

• Attractive stock options available for all employees.