AI Conversation Research, Evaluation Specialist

This is a fully remote position, open to applicants in United States, +5 more countries.

📋 Description

• Analyze AI dialogues that reflect real-world interpersonal interactions and common decision-making scenarios.

• Detect gaps in context and suggest pertinent follow-up inquiries to enhance AI-generated responses.

• Determine if additional details would significantly alter an AI-generated suggestion.

• Differentiate between critical information influencing decisions and non-essential or descriptive elements.

• Perform qualitative assessments and record results in accordance with structured evaluation criteria.

• Evaluate whether dialogues take into account relevant personal, psychological, social, financial, practical, and organizational factors.

• Spot missed chances for clarification, deeper insights, and information gathering.

• Review discussions related to relationships, work, education, family, wellbeing, planning, and resource limitations.

• Collaborate with research teams to ensure evaluations are consistent and grounded in evidence.

• Uphold accuracy, clarity, and coherence while adhering to project timelines.

⛳️ Requirements

• A minimum of 3–5 years of relevant direct professional experience in one or more of the specified fields.

• Licensed Social Work pathway: A Master’s degree in Social Work (MSW) or an equivalent graduate-level credential.

• Licensed Social Work pathway: LCSW, LICSW, LMSW, or a comparable social work license or credential.

• Experience in client evaluation, case reviews, interviewing, counseling, or a related social work practice.

• Counseling, Therapy, or Psychology pathway: A Master’s degree in an appropriate field with an LMFT, LPC, LCPC, or equivalent counseling or therapy license; or a PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.

• Relevant experience in counseling, therapy, psychological assessment, interviewing, case reviews, or other client-facing roles.

• Qualitative Research, HCI, or Communication pathway: An MA, PhD, or equivalent advanced knowledge in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related field.

• Experience in conducting qualitative research, interviews, user studies, conversation analysis, thematic analysis, or qualitative coding.

• Proficient in systematically analyzing conversations to pinpoint missing context, communication trends, and opportunities for clarification.

• Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: relevant professional qualification or demonstrated expertise in the subject matter.

• A minimum of 5 years of direct advisory or client-facing experience for candidates qualifying through this pathway.

• Experience in coaching, mediation, student advising, organizational consulting, or similar professional roles.

• Proven ability to gather context, comprehend individual or organizational needs, and offer informed recommendations.

🏝️ Benefits

• Competitive salary and comprehensive health benefits.

• Opportunities for professional development and training.

• Flexible working hours and remote work options.

• Collaborative and inclusive work environment.