Social Workers, AI Conversation Evaluation

This is a fully remote position, open to applicants in Bangladesh.

📋 Description

• Evaluate AI interactions that involve interpersonal, advisory, and everyday decision-making situations.

• Assess if the AI obtained adequate context prior to making suggestions.

• Identify key missing details and propose appropriate follow-up inquiries.

• Ascertain if additional context could significantly alter the recommendation.

• Differentiate between essential information and non-critical details.

• Perform structured qualitative assessments using established evaluation criteria.

• Clearly document findings in spreadsheets, annotation tools, or labeling platforms.

• Maintain consistent judgment across cases and highlight ambiguous instances.

• Work collaboratively with research and quality teams to enhance evaluation standards.

• Engage in calibration and quality review activities.

⛳️ Requirements

• Educational background in psychology, social work, counseling, communication, qualitative research, HCI, conflict resolution, or other related advisory fields.

• MSW with LCSW or an equivalent social work license; or MA/MS with LMFT, LPC, LCPC, or an equivalent counseling license; or PhD/PsyD in specified psychology disciplines; or MA/PhD in specified related areas.

• Relevant professional qualifications paired with a minimum of 5 years of direct advisory, coaching, mediation, consulting, or client-facing experience.

• At least 3 years of pertinent professional practice.

• Experience in obtaining missing context through interviews, assessments, consultations, or advisory discussions.

• Capability to distinguish critical information from non-essential context.

• Excellent written English and strong qualitative analytical abilities.

• Exceptional attention to detail and ability to adhere to detailed labeling guidelines.

• Full-time availability of 40 hours per week with at least 4 hours of overlap during PST.

• Successful completion of a brief online assessment and delivery review.

🏝️ Benefits

• Competitive salary and comprehensive benefits package.

• Opportunities for professional development and growth.

• Collaborative and supportive work environment.

• Flexible working hours and remote work options.