AI Session Annotator, English

atMercorRemoteUS flagUnited StatesFreelanceArtificial IntelligenceMid-levelSenior$24 – $30/hour

Posted Aug 27

This is a fully remote position, open to applicants in United States.

📋 Description

• Analyze recorded interactions between users and an AI assistant while capturing video through their camera.

• Assess assistant responses in relation to the visible video content.

• Detect any hallucinated or fabricated visual elements.

• Rate the sessions based on visual interpretation, accuracy, relevance, response timing, and the use of spatial/directional language.

• Determine if safety warnings regarding health, physical safety, or financial security were issued in a timely and appropriate manner.

• Provide detailed comments for each score, supported by concrete evidence.

• Document conversations turn by turn in the intake form.

• Complete a brief calibration task upon request.

• Participate in projects focused on the training and enhancement of AI models.


⛳️ Requirements

• Native or near-native proficiency in English, both spoken and written.

• Ability to write clear and precise English.

• Ownership of an Android phone equipped with a functioning camera and microphone (mandatory).

• Strong attention to detail.

• Capability to consistently apply a rubric.

• Preferred: Previous experience in data annotation, linguistic quality assurance, content moderation, or AI model evaluation.

• Preferred: Educational background in linguistics, translation, or interpreting.

• Skill in identifying unnatural or non-native English and regional dialects.

• Status as an independent contractor.

• Must not require H1-B or STEM OPT sponsorship.


🏝️ Benefits

• Weekly payments processed via Stripe or Wise based on services rendered.

• Fully remote work environment.

• Flexible work schedule, allowing you to set your own hours.

• Competitive compensation.

• Opportunity to collaborate with leading researchers in the field.

• Chance to contribute to the development of the next generation of AI systems.

• Referral bonuses of up to $120 for each successful referral.

People also viewed

WON.ai20 hours ago

AI Strategist

AR flagArgentina OnlyFreelanceArtificial Intelligence
ApplyView job
The College Board21 hours ago

Director, AI Assisted Solutions

US flagUnited States OnlyFull-timeArtificial Intelligence$88k – $135k/year
ApplyView job
Mercor22 hours ago

AI Safety Experts – English, Assamese

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor22 hours ago

AI Safety Experts – English, Marathi

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor22 hours ago

AI Safety Expert – English, Bengali

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Gartner22 hours ago

Director, Analyst – AI Technology Economics

GB flagUnited Kingdom OnlyFull-timeArtificial Intelligence
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers