AI Quality Analyst

This is a fully remote position, open to applicants in South Carolina.

📋 Description

• Evaluating and assessing the performance of AI models or algorithms based on their outputs or behaviors through a series of evaluative questions.

• Labeling specific elements of content rather than evaluating the content as a whole.

• Assigning predefined categories or labels to various items.

• Assessing the perceived quality and/or appropriateness of content.

• Generating labels to enhance the understanding of concepts, trends, etc.

• Creating additional training data for machine learning models by applying transformations to original data, including modifications to images (such as rotation, flipping, cropping), generating new text (such as paraphrasing and summarization), or altering audio/video signals (like speed modification and pitch shifting) to mitigate overfitting and enhance dataset diversity.

• Reviewing data to determine whether a product feature operates as intended according to the project guidelines.

• Labeling model outputs to ascertain whether a piece of content meets specific criteria. Examples include identifying clickbait, gaming videos, or branded content.

• Organizing or ranking items based on established preferences or criteria.

• Crafting prompts or questions intended for generating responses from a language model or another AI system.

• Conducting projects that assess the relevance of content using a relevancy scale (1-3, 1-5, etc.).

• Generating responses to prompts or questions utilizing a language model or other AI systems.

• Rewriting existing text while maintaining its original meaning, often to enhance clarity or style and ensure adherence to guidelines.

• Producing concise summaries from longer texts or datasets.

• Transcribing spoken language or audio content into written form.

• Translating text or spoken language from one language to another.

• Collecting and compiling various data types for the purpose of training, evaluating, or fine-tuning AI models. This may encompass text, images, videos, audio files, or other forms of digital content.

⛳️ Requirements

• A Bachelor’s degree or higher in a humanities specialization is mandatory. Advanced degrees, such as a Master’s or PhD, are highly preferred.

• Professional or expert-level proficiency (C1/C2) in English is required.

🏝️ Benefits

• Opportunities for professional development and growth.

• Collaborative and supportive work environment.

• Access to the latest technologies and resources.

• Flexible working arrangements.