AI Conversation Evaluation, Research Specialist

This is a fully remote position, open to applicants in Serbia, +5 more countries.

📋 Description

• Analyze AI conversations that pertain to interpersonal relationships, workplace dynamics, education, family issues, daily planning, wellness, and other real-life decisions.

• Assess whether the AI obtained adequate context prior to offering advice, suggestions, or proposed solutions.

• Identify any gaps in information and propose pertinent follow-up questions that could enhance the quality of the AI's responses.

• Evaluate if additional context could significantly alter the recommendation or decision made.

• Differentiate between critical information that could influence outcomes and non-essential details that are merely descriptive.

• Perform qualitative evaluations following structured guidelines and consistently document findings.

• Recognize missed chances for clarification, contextual comprehension, and information acquisition.

• Take into account relevant personal, psychological, social, financial, practical, and organizational aspects when reviewing conversations.

• Work collaboratively with research teams to uphold consistent evaluation standards and ensure high-quality assessments.

• Accurately complete assigned tasks within designated project timelines.

⛳️ Requirements

• A minimum of 3–5 years of relevant professional experience in one or more applicable fields.

• Licensed Social Work: A Master's degree in Social Work (MSW) or an equivalent graduate-level qualification.

• Licensed Social Work: LCSW, LICSW, LMSW, or an equivalent applicable social work credential or license.

• Experience in client assessment, case reviews, interviewing, counseling, or related social work practices.

• Counseling, Therapy, or Psychology: A Master's degree in a relevant field with an LMFT, LPC, LCPC, or equivalent counseling or therapy credential; or a PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.

• Significant experience in counseling, therapy, psychological assessment, interviewing, case reviews, or other client-facing professional roles.

• Qualitative Research, HCI, or Communication: MA, PhD, or equivalent advanced qualifications in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related area.

• Proven experience in conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.

• Ability to systematically analyze conversations and identify missing context or patterns in human communication.

• Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields: Relevant professional qualification, credential, or established subject-matter expertise.

• At least 5 years of direct advisory or client-facing experience for candidates qualifying through this path.

• Experience in coaching, mediation, student advising, organizational consulting, or similar professional roles.

• Demonstrated capability to gather context, comprehend individual or organizational needs, and provide informed recommendations.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional growth and development.

• Comprehensive health and wellness benefits.

• Flexible work arrangements.