This is a fully remote position, open to applicants in Spain.

📋 Description

• Identify realistic failures in search-related tasks where an AI model delivers insufficient responses.

• Develop and assess search queries for effectiveness.

• Record instances of errors or shortcomings.

• Compose guidelines and evaluation criteria for accurate responses.

• Assess local relevance, quality of sources, outdated information, language discrepancies, incomplete responses, and region-specific irrelevance.

• Conduct multiple tests of queries prior to pinpointing failures.

⛳️ Requirements

• Proficiency in Spanish is essential.

• Strong research capabilities: adept at locating and validating information from diverse sources, with comfort in navigating various websites, databases, and documentation.

• Critical thinking skills: skilled at recognizing inconsistencies between sources, identifying outdated information, and understanding when information is not applicable to a particular locale or context.

• Meticulous attention to detail: capable of recognizing linguistic subtleties, local variations such as pricing, regulations, and requirements, as well as edge cases.

• Problem-solving orientation: willing to iterate and test solutions when issues arise.

• Relevant domain expertise in research, quality assurance, compliance, or similar fields that emphasize precision and source verification is highly preferred.

• Clarity in writing: capable of clearly articulating instructions and evaluation criteria.

• Extensive knowledge of the specific locale, encompassing local regulations, business practices, and cultural subtleties, is advantageous.