This is a fully remote position, open to applicants in Alabama, +21 more states.

📋 Description

• Evaluate tailored AI/Gemini responses.

• Develop and experiment with multi-turn prompts.

• Analyze AI outputs for Grounding, Integration, and Helpfulness.

• Compare model outputs side-by-side.

• Spot incorrect personalization, flawed inferences, and hallucinations.

• Deliver comprehensive feedback and justifications.

⛳️ Requirements

• Bachelor’s or Master’s degree in IT or a related field.

• Excellent English reading and writing abilities.

• Strong analytical skills and keen attention to detail.

• Preferred experience in AI evaluation, data annotation, content moderation, or a similar field.

• Capability to work independently in a remote setting.

• Access to a laptop or desktop with a stable internet connection.

• Willingness to utilize a primary personal Google account and activate personal data sources for assessment purposes.

• Availability of 30–40 hours per week.

• Must be available during PST hours with a required overlap of 4 hours.

• Candidates must reside in one of the approved states: Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, or Wyoming.

• Proficient English language skills are essential.