AI Safety Expert, English, Odia

atMercorRemoteUS flagUnited StatesFreelanceArtificial IntelligenceMid-levelSenior$16 – $22/hour

Posted 2 days ago

This is a fully remote position, open to applicants in United States.

πŸ“‹ Description

β€’ Conduct red-team assessments on conversational AI models and agents utilizing jailbreaks, prompt injections, misuse scenarios, bias exploitation, and multi-turn manipulation.

β€’ Document failures, categorize vulnerabilities, and highlight systemic risks.

β€’ Adhere to taxonomies, benchmarks, and playbooks to ensure consistent testing practices.

β€’ Generate reproducible reports, datasets, and attack scenarios.

β€’ Evaluate AI outputs related to sensitive issues such as bias, misinformation, and harmful behaviors.

β€’ Identify vulnerabilities that automated tests may overlook.

β€’ Broaden evaluation coverage to minimize unexpected issues in production.

β€’ Enhance customer AI systems through data-driven human red teaming.


⛳️ Requirements

β€’ Proficient/native fluency in English and Odia is essential.

β€’ Strong discernment regarding language and content, including assessing AI responses for accuracy, completeness, and appropriateness.

β€’ Capability to spot subtle errors, inconsistencies, and gaps.

β€’ Consistent adherence to guidelines and quality standards.

β€’ Ability to clearly articulate reasoning to both technical and non-technical stakeholders.

β€’ Flexibility to adapt across various projects, task types, and clients.

β€’ Engagement as an independent contractor.

β€’ Must not require H1-B or STEM OPT visa support.

β€’ Preferred areas of expertise: adversarial machine learning, cybersecurity, socio-technical risk, or creative probing.


🏝️ Benefits

β€’ Completely remote position.

β€’ Flexible scheduling options.

β€’ Participation in higher-sensitivity projects is optional.

β€’ Clear guidelines and wellness resources available for sensitive-content tasks.

β€’ Weekly payments through Stripe or Wise.

β€’ Competitive compensation.

β€’ Collaborate with top researchers in the field.

β€’ Referral program: earn up to $90 for each successful referral, subject to limits.

β€’ Reasonable accommodations available upon request.

People also viewed

Volga Partners1 day ago

Healthcare Subject Matter Expert – AI Model Evaluation

GB flagUnited Kingdom, +6 more countriesFreelanceArtificial Intelligence$35 – $150/hour
ApplyView job
Volga Partners1 day ago

Healthcare Subject Matter Expert – AI Model Evaluation

IN flagIndia, +6 more countriesFreelanceArtificial Intelligence$15 – $55/hour
ApplyView job
Gramian Consulting1 day ago

Personal Injury Law – AI Evaluation Specialist

US flagUnited States OnlyFreelanceArtificial Intelligence
ApplyView job
Gramian Consulting1 day ago

Employment Law – AI Evaluation Specialist

US flagUnited States OnlyFreelanceArtificial Intelligence
ApplyView job
GE Aerospace1 day ago

Defense Engines AI Transformation Leader

US flagOhio OnlyFull-timeArtificial Intelligence$176k – $235k/year
ApplyView job
TDS Global Solutions2 days ago

Forward Deployed Engineer, Applied AI

US flagUnited States OnlyFull-timeArtificial Intelligence
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers