Data Analyst, AI Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Examine datasets and task outputs meticulously for accuracy, completeness, and conformity to guidelines.

• Detect and highlight inconsistencies, errors, and outputs that diverge from the provided instructions.

• Consistently apply structured rubrics and evaluation criteria across extensive data sets.

• Utilize sound judgment and document reasoning in ambiguous situations where guidelines may be unclear.

• Escalate patterns or recurring data problems for comprehensive analysis instead of addressing them on a case-by-case basis.

• Deliver clear, actionable written and verbal feedback that identifies issues and proposes resolution strategies.

• Maintain a high level of attention to detail while managing substantial volumes of repetitive data review tasks.

• Offer data analysis expertise to a client's data quality project and assist in training next-generation AI systems.

⛳️ Requirements

• 3–5+ years of experience in data review, data quality, quality assurance, or analytical positions.

• Proven ability in reviewing, validating, and critiquing data or deliverables based on specified criteria.

• Exceptional skill in adhering to detailed written instructions and accurately applying complex evaluation rubrics.

• Demonstrated ease with ambiguity, including making justified decisions when guidelines are insufficient.

• Advanced attention to detail and strong capabilities in spotting errors in repetitive or high-volume work.

• Excellent written and verbal communication skills for documenting findings and delivering feedback.

• Basic proficiency with spreadsheets (including sorting, filtering, and simple formulas).

• Familiarity with SQL or hands-on data querying is an advantage.

• No previous experience in AI is necessary.

🏝️ Benefits

• A highly attractive and competitive compensation package is offered.