AI Language Quality Evaluator – Greek/English, Mid-Level

This is a fully remote position, open to applicants in Greece, +1 more country.

📋 Description

• Evaluate source and target texts alongside AI-identified bug reports

• Analyze the precision of AI-identified issues

• Ascertain if the detected problems are legitimate bugs

• Validate the accuracy of bug classifications and categories

• Categorize findings as correct, misclassified, partially accurate, false positives, or missed

• Cross-check flagged issues against visual UI context through screenshots

• Offer clear, evidence-supported descriptions for legitimate bugs

• Meticulously document explanations

• Suggest corrected translations when applicable

• Ensure consistency, accuracy, and completeness across evaluation data sets

• Perform flexible, task-oriented work as assignments arise

• Collaborate effectively with global teams and QA leaders

⛳️ Requirements

• Professional proficiency in both Greek and English

• Bachelor's degree in Linguistics, Computer Science, Languages, or a related field; or equivalent professional experience

• Degree or certification in Greek Language is mandatory

• Strong analytical and critical thinking capabilities

• Exceptional attention to detail

• Ability to recognize subtle linguistic discrepancies, inconsistencies, and UI flaws

• Experience in annotation, evaluation, translation, localization, linguistics, or QA is beneficial but not essential

• Proficient in working with spreadsheets, PDFs, screenshots, and structured datasets

• Experience in evaluating AI/LLM outputs is a plus

• Excellent logical reasoning and written communication abilities

• Capacity to differentiate genuine localization flaws from acceptable language or product behaviors

• Strong organizational and task management skills

• Independent working style with the ability to maintain high accuracy and productivity while collaborating with a global team

• Personal device (laptop/desktop) is required

• Availability in IST, preferably from 8 AM IST onward

• Reliable Wi-Fi connection during working hours

• Successful onboarding through Deel and provision of necessary documentation

• 1099 independent contractor role; W-8 BEN form provided for non-U.S. candidates

🏝️ Benefits

• Flexible, remote, task-oriented engagement

• Opportunity for supplemental income

• Training and guidance offered

• Chance to contribute to AI language and localization initiatives

• Gain practical experience in AI evaluation, bug classification, and linguistic QA

• Exposure to global teams and international projects

• Enhance professional profile in localization, AI, linguistics, and quality assurance

• Independent contractor engagement

• Competitive hourly pay ($7–$9 DOE)