JobFetch

Context Elicitation & Conversation Evaluation Specialist

Pay
Pay not listed
Where
Remote
Type
Contract
Eligibility
Country eligibility not stated. Check with the provider before applying.
Listing
Last verified Nov 2, 2026

Apply opens the provider’s application page. You apply there yourself: we never submit applications, and opening the page doesn’t mean you’ve applied. Nobody can promise you’ll be hired.

Some Apply links are referral links. If you apply through them, the provider may pay us a commission. Referral disclosure

Explore weekly job alerts for your skills

Overview

Support AI conversation evaluation research as a subject matter expert in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields.

Review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.

Responsibilities

  • Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
  • Identify missing context and recommend relevant follow-up questions.
  • Evaluate whether additional information would have changed the AI's recommendations.
  • Distinguish between critical (load-bearing) and non-essential information.
  • Conduct qualitative reviews and document findings using structured evaluation guidelines.
  • Collaborate with research teams to ensure consistent, high-quality assessments.

Requirements

  • At least 3-5 years of direct practice and professional experience in at least one of the following areas:
  • Licensed Social Work: MSW or equivalent graduate-level qualification in Social Work; LCSW, LICSW, LMSW, or equivalent applicable social work license/credential; experience with client assessment, case review, interviewing, counseling, or related social-work practice.
  • Counseling, Therapy, or Psychology: MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential, or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology; experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work.
  • Qualitative Research, HCI, or Communication: MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline; experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.
  • Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields: relevant professional qualification, credential, or demonstrated subject-matter expertise; significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work; experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance.

Preferred

  • Experience eliciting relevant context when clients initially provide incomplete information.
  • Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors.
  • Qualitative coding or structured case review.
  • Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative.
  • Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering.

Engagement and pay

  • No pay figures or weekly-hours commitment stated in the source.
  • Fully remote.
  • The source headline states 'Full-time', while this listing records the engagement type as Contract; the source provides no further offer details to reconcile the two. Confirm the engagement type with the provider before applying.

Eligibility

  • The source states: Must be based in Latam, Southeastern Europe, Asia, Africa.

Skills

  • psychology
  • social work
  • counseling
  • qualitative research
  • communication