AI Safety Expert – English, Odia

atMercorRemoteUS flagUnited StatesFreelanceArtificial IntelligenceMid-levelSenior$16 – $22/hour

Posted 3 days ago

This is a fully remote position, open to applicants in United States.

πŸ“‹ Description

β€’ Conduct red-team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

β€’ Create human data by annotating failures, identifying vulnerabilities, and highlighting systemic risks.

β€’ Implement taxonomies, benchmarks, and playbooks to ensure consistent testing processes.

β€’ Generate reproducible reports, datasets, and attack scenarios.

β€’ Evaluate AI outputs that may involve sensitive issues like bias, misinformation, or harmful behaviors.

β€’ Detect vulnerabilities overlooked by automated testing and enhance evaluation coverage.


⛳️ Requirements

β€’ Native proficiency in English and Odia.

β€’ Strong discernment regarding language and content.

β€’ Capability to evaluate whether AI responses are accurate, complete, and suitable.

β€’ Skill in identifying subtle errors, inconsistencies, and gaps.

β€’ Consistent adherence to guidelines and quality standards.

β€’ Ability to articulate reasoning clearly to both technical and non-technical audiences.

β€’ Flexibility to adapt across various projects, task types, and client needs.

β€’ Experience or specialization in adversarial machine learning, cybersecurity, socio-technical risk, or creative probing is a plus.

β€’ Must operate as an independent contractor.

β€’ H-1B and STEM OPT candidates are not eligible.


🏝️ Benefits

β€’ Fully remote position.

β€’ Flexible working hours / ability to work on your own schedule.

β€’ Weekly payments through Stripe or Wise.

β€’ Optional participation in higher-sensitivity projects.

β€’ Clear content guidelines and access to wellness resources.

β€’ Competitive compensation.

β€’ Referral opportunity allowing earnings of up to $90 for each successful referral.

People also viewed

Volga Partners1 day ago

Healthcare Subject Matter Expert – AI Model Evaluation

GB flagUnited Kingdom, +6 more countriesFreelanceArtificial Intelligence$35 – $150/hour
ApplyView job
Volga Partners1 day ago

Healthcare Subject Matter Expert – AI Model Evaluation

IN flagIndia, +6 more countriesFreelanceArtificial Intelligence$15 – $55/hour
ApplyView job
Gramian Consulting1 day ago

Personal Injury Law – AI Evaluation Specialist

US flagUnited States OnlyFreelanceArtificial Intelligence
ApplyView job
Gramian Consulting1 day ago

Employment Law – AI Evaluation Specialist

US flagUnited States OnlyFreelanceArtificial Intelligence
ApplyView job
GE Aerospace1 day ago

Defense Engines AI Transformation Leader

US flagOhio OnlyFull-timeArtificial Intelligence$176k – $235k/year
ApplyView job
TDS Global Solutions2 days ago

Forward Deployed Engineer, Applied AI

US flagUnited States OnlyFull-timeArtificial Intelligence
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers