Business Analyst – Non-US Raters

Posted Oct 20

This is a fully remote position, open to applicants in Argentina, +7 more countries.

πŸ“‹ Description

β€’ Review, evaluate, and compare responses generated by various AI chatbots against established assessment criteria.

β€’ Conduct systematic evaluations of chatbot response accuracy, relevance, completeness, clarity, and overall quality.

β€’ Analyze business needs and convert them into evaluation guidelines and functional specifications.

β€’ Collect, interpret, and document data to ensure consistent and objective assessments.

β€’ Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.

β€’ Prepare evaluation reports, summaries, and accompanying documentation.

β€’ Work collaboratively with project managers and cross-functional teams to clarify requirements and address evaluation-related inquiries.

β€’ Monitor task progress, quality metrics, and project deliverables while adhering to deadlines.

β€’ Identify recurring issues related to response quality and offer actionable insights.

β€’ Uphold consistency, confidentiality, and high standards of quality throughout the evaluation process.

β€’ Submit a comprehensive assessment for each assigned task.


⛳️ Requirements

β€’ Bachelor's degree in Business Administration, Finance, Computer Science, or a relevant field.

β€’ A minimum of 3 years of experience as a Business Analyst or in a comparable analytical role.

β€’ Strong analytical thinking, problem-solving, and decision-making skills.

β€’ Exceptional written communication abilities with a knack for articulating findings clearly.

β€’ Keen attention to detail and the capacity to assess information impartially.

β€’ Proficient in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.

β€’ Experience in requirement gathering, process mapping, and business documentation.

β€’ Capability to work independently, juggle multiple priorities, and meet tight deadlines.

β€’ Strong documentation skills and the ability to adhere to structured evaluation guidelines.

β€’ Familiarity with Agile or Scrum methodologies is a plus.

β€’ Willingness to engage in a full-time, 16-week remote role with necessary time-zone overlap.

β€’ Availability for 8 hours per day, five days a week, including weekends as needed, with two weekdays off.

β€’ Minimum of 4 hours of overlap with the US Pacific Time (PST) zone.


🏝️ Benefits

β€’ Opportunity to engage in projects centered on AI evaluation and response quality.

β€’ Fully remote work arrangement allowing flexibility to work from your preferred location.

β€’ Exposure to structured AI assessment workflows and quality evaluation methodologies.

β€’ Chance to contribute to projects with a global impact.

β€’ Clearly outlined contract duration, hourly compensation, and evaluation responsibilities.

People also viewed

Gainwell Technologies17 hours ago

Claims Business Analyst

US flagWisconsin OnlyFull-timeBusiness Analyst$86.8k – $124k/year
ApplyView job
Worldwide Clinical Trials17 hours ago

Senior Business Analyst, AI Evaluation – Value Realization

US flagNorth Carolina OnlyFull-timeBusiness Analyst$84k – $167k/year
ApplyView job
Stryker17 hours ago

Senior Business Analyst, Service Now HRSD

US flagCalifornia, +4 more statesFull-timeBusiness Analyst$69.5k – $144.2k/year
ApplyView job
Endava18 hours ago

Business Analyst

US flagColorado OnlyFull-timeBusiness Analyst
ApplyView job
Franciscan Health18 hours ago

Application Business Analyst

US flagUnited States OnlyFull-timeBusiness Analyst$76.8k – $105.6k/year
ApplyView job
First Citizens Bank18 hours ago

Senior Business Analyst

US flagNorth Carolina OnlyFull-timeBusiness Analyst$136.9k – $154.6k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers