AI Safety Expert – English, Odia

atMercorRemoteUS flagUnited StatesFreelanceArtificial IntelligenceMid-levelSenior$16 – $22/hour

Posted Sep 19

This is a fully remote position, open to applicants in United States.

πŸ“‹ Description

β€’ Conduct red-team assessments on conversational AI models and agents by implementing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulations.

β€’ Create human data by annotating failures, classifying vulnerabilities, and identifying systemic risks.

β€’ Utilize taxonomies, benchmarks, and playbooks to ensure consistent testing practices.

β€’ Generate reproducible reports, datasets, and attack scenarios for clients.

β€’ Evaluate AI outputs that pertain to sensitive issues such as bias, misinformation, or harmful behaviors.

β€’ Engage in projects focused on training and improving AI systems.

β€’ Identify vulnerabilities that automated tests overlook and enhance evaluation coverage.


⛳️ Requirements

β€’ Proficiency in both English and Odia is mandatory.

β€’ Strong discernment regarding language and content; capability to evaluate the accuracy, completeness, and appropriateness of AI responses.

β€’ Skill in detecting subtle errors, inconsistencies, and gaps.

β€’ Consistent adherence to guidelines and quality standards.

β€’ Ability to articulate reasoning clearly to both technical and non-technical audiences.

β€’ Flexibility to adapt across various projects, task types, and client needs.

β€’ Engagement as an independent contractor is required.

β€’ Note: H1-B and STEM OPT candidates cannot be accommodated.

β€’ Preferred: experience in adversarial machine learning, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction.

β€’ Preferred: background in cybersecurity, including penetration testing, exploit development, or reverse engineering.

β€’ Preferred: experience with socio-technical risks, including harassment/disinformation probing, abuse analysis, or conversational AI testing.

β€’ Preferred: background in psychology, acting, or writing to foster unconventional adversarial thinking.


🏝️ Benefits

β€’ Completely remote position.

β€’ Flexible scheduling options.

β€’ Weekly payments via Stripe or Wise.

β€’ Chance to gain experience in human data-driven AI red teaming.

β€’ Opportunity to contribute directly to enhancing the robustness, safety, and trustworthiness of AI systems.

β€’ Collaborate with top-tier researchers in the field.

β€’ Reasonable accommodations available upon request.

β€’ Referral bonuses of up to $90 for each successful referral.

People also viewed

WON.ai17 hours ago

AI Strategist

AR flagArgentina OnlyFreelanceArtificial Intelligence
ApplyView job
The College Board18 hours ago

Director, AI Assisted Solutions

US flagUnited States OnlyFull-timeArtificial Intelligence$88k – $135k/year
ApplyView job
Mercor19 hours ago

AI Safety Experts – English, Assamese

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor19 hours ago

AI Safety Experts – English, Marathi

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Mercor19 hours ago

AI Safety Expert – English, Bengali

US flagUnited States OnlyFreelanceArtificial Intelligence$16 – $22/hour
ApplyView job
Gartner19 hours ago

Director, Analyst – AI Technology Economics

GB flagUnited Kingdom OnlyFull-timeArtificial Intelligence
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers