Senior Product Engineer – Agent Training and Evals

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Develop tools for capturing and processing data from agents and humans engaged in real-world tasks on a large scale.

• Address complex challenges related to computing, orchestration, scalability, security, and reliability.

• Assist in formulating methods for training, benchmarking, and assessing AI agents.

• Collaborate with cutting-edge agentic AI technologies and swiftly advancing models.

• Make practical technical choices in a highly uncertain environment.

• Work closely with product engineering and AI research to transform customer issues into functional products.

• Contribute to significant impacts within a dynamic, high-ownership, cross-functional team.

⛳️ Requirements

• Extensive experience in creating scalable infrastructure or distributed systems within the cloud.

• Strong comprehension of system deployment, scaling, and security measures.

• Practical experience in integrating and assessing AI models or agents.

• Interest in the training, evaluation, and enhancement of AI agents.

• A robust product-oriented mindset focusing on delivering value to customers and the business.

• Ability to navigate ambiguity and swiftly transition from concept to functional system.

• Excellent communication and teamwork abilities.

• Experience with Python is advantageous, though not mandatory.

• Bonus: familiarity with image, video, or audio processing.

🏝️ Benefits

• Competitive salary.

• Comprehensive benefits package.

• Flexibility for remote work.

• Access to Prolific's distinct human data platform.

• Opportunities for pioneering research.