Psychology & Counseling Expert, AI Conversation Evaluation

This is a fully remote position, open to applicants in Bangladesh.

📋 Description

• Evaluate AI-generated conversations that involve interpersonal, advisory, and everyday decision-making scenarios.

• Analyze whether the AI has collected adequate context prior to making recommendations.

• Identify crucial missing information and propose relevant follow-up questions.

• Assess if additional context could significantly alter the recommendation.

• Differentiate between essential information and non-critical details.

• Perform structured qualitative assessments using established evaluation criteria.

• Clearly document findings in spreadsheets, annotation tools, or labeling platforms.

• Maintain consistent judgment across cases and highlight ambiguous instances.

• Work collaboratively with research and quality teams to enhance evaluation standards.

• Engage in calibration and quality-review processes.

⛳️ Requirements

• Possess one of the following academic or professional qualifications: MSW with LCSW or a similar social-work license; MA/MS with LMFT, LPC, LCPC, or an equivalent counseling license; PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology; MA or PhD in HCI, Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research, or a closely related discipline; or a relevant professional credential paired with a minimum of 5 years of direct advisory, coaching, mediation, consulting, or client-facing experience.

• Have a minimum of 3 years of relevant professional experience, with over 5 years preferred for applicants with credentials.

• Demonstrated experience in gathering missing context through interviews, assessments, consultations, or advisory discussions.

• Capability to differentiate between critical information and non-essential context.

• Exceptional written English and qualitative analytical skills.

• High attention to detail and ability to adhere to precise labeling guidelines.

• Full-time availability of 40 hours per week with at least 4 hours of overlap in PST.

• Completion of a brief online assessment and delivery review.

🏝️ Benefits

• Competitive salary and benefits package.

• Opportunities for professional development and advancement.

• Flexible working hours and remote work options.