
AI Content Evaluator
Posted 17 hours ago

Posted 17 hours ago
This is a fully remote position, open to applicants in United States, +2 more locations.
• Review various professional materials such as documents, presentations, and spreadsheets.
• Evaluate outputs for accuracy, clarity, completeness, organization, and overall quality.
• Identify factual inaccuracies, inconsistencies, omissions, and weak reasoning.
• Assess whether materials conform to professional standards for practical application.
• Compare and rank AI-generated outputs based on established evaluation criteria.
• Determine which response or output better fulfills task requirements.
• Identify significant differences in quality, reasoning, structure, and presentation.
• Highlight incomplete, misleading, or poorly substantiated outputs.
• Review written materials for structure, readability, and accuracy.
• Evaluate presentation slides for clarity, coherence, and effective communication.
• Assess spreadsheets for logical consistency, organization, and accuracy.
• Identify formatting issues that hinder usability or diminish professional quality.
• Provide clear, concise, and well-reasoned written feedback.
• Justify ratings and preference decisions with specific evidence.
• Emphasize the most critical issues rather than relying on general impressions.
• Adhere to structured rubrics and project guidelines.
• Maintain consistent quality standards across a variety of evaluation tasks.
• A Bachelor's degree or higher.
• Residing in the United States or Canada.
• Excellent English reading comprehension and written communication skills.
• Strong analytical judgment across diverse professional subject areas.
• Exceptional attention to detail.
• Capability to identify errors, inconsistencies, formatting issues, and gaps in reasoning.
• Proficient in working with documents, presentations, spreadsheets, and common productivity tools.
• Ability to efficiently transition between different topics and content formats.
• Comfortable working independently within established evaluation guidelines.
• Previous experience in AI, machine learning, or model evaluation is not required.
• Work must be conducted without utilizing confidential or proprietary information from any employer, client, institution, or third party.
• H1-B and STEM OPT support is not available for this position.
• Part-time independent contractor engagement.
• Fully remote position available within the United States or Canada.
• Flexible scheduling based on project needs.
• Project guidelines and evaluation criteria will be provided.
• Projects may be extended, shortened, or concluded based on project requirements and performance.
EverCommerce
Welocalize
EverCommerce
bolt.new
Get handpicked remote jobs straight to your inbox weekly.