Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Behavioral Health Specialist - AI Evaluation

  • Behavioral Health Specialist - AI Evaluation job type Posted on: Nov 19, 2026
  • Behavioral Health Specialist - AI Evaluation experience level Mercor
  • Behavioral Health Specialist - AI Evaluation employment type New York, New York
  • Behavioral Health Specialist - AI Evaluation salary Salary: $45 per hour
  • Behavioral Health Specialist - AI Evaluation employment type Remote
  • Behavioral Health Specialist - AI Evaluation salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Behavioral Health Specialist - AI Evaluation roles in New York.

View Salary Guide →

Job Title :

Behavioral Health Specialist - AI Evaluation

Job Type :

Full-Time

Job Location :

New York New York United States

Remote :

Yes

Jobcon Logo Job Description :

Job DescriptionJob DescriptionAbout the job\nMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.\nPosition: Behavioral Health Expert, AI Safety and Model EvaluationType: ContractCompensation: $45–$70/hourLocation: RemoteCommitment: 20–40 hours/week\nRole Responsibilities\n\n Evaluate conversations between users and AI models on topics like relationships, emotional wellbeing, and beliefs. Assess if responses are neutral, appropriate, and safe.\n Identify patterns of concern such as excessive agreement or moralizing. Document them with clear written rationale.\n Develop rubrics and guidelines for balanced, supportive replies based on counseling and behavioral health practices.\n Design test scenarios to probe how models handle sensitive but non-crisis topics.\n Collaborate with researchers to maintain consistent and well-documented evaluation standards.\n\nQualifications\nMust-Have\n\n Degree in psychology, counseling, social work, behavioral health, or equivalent professional experience.\n 3+ years of professional experience in mental health, counseling, or social services.\n Ability to remain neutral and nonjudgmental across diverse perspectives.\n Familiarity with concepts like sycophancy and cognitive distortions.\n Ability to engage reliably for 20+ hours/week during weekdays.\n Strong written communication skills.\n\nPreferred\n\n Background in AI safety, applied ethics, or content policy.\n Experience in relationship counseling or spiritual care.\n Familiarity with the psychology of misinformation.\n\nApplication Process (Takes 20–30 mins to complete)\n\n Upload resume\n AI interview based on your resume\n Submit form\n\nResources & Support\n\n For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome\n For any help or support, reach out to: support@mercor.com\n\nPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Jobcon Logo Position Details

Posted:

Nov 19, 2026

Reference Number:

16275_88fbf5a31

Employment:

Full-time

Salary:

$45 per hour

City:

New York

Job Origin:

APPCAST_CPC

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Behavioral Health Specialist - AI Evaluation    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job DescriptionJob DescriptionAbout the job\nMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.\nPosition: Behavioral Health Expert, AI Safety and Model EvaluationType: ContractCompensation: $45–$70/hourLocation: RemoteCommitment: 20–40 hours/week\nRole Responsibilities\n\n Evaluate conversations between users and AI models on topics like relationships, emotional wellbeing, and beliefs. Assess if responses are neutral, appropriate, and safe.\n Identify patterns of concern such as excessive agreement or moralizing. Document them with clear written rationale.\n Develop rubrics and guidelines for balanced, supportive replies based on counseling and behavioral health practices.\n Design test scenarios to probe how models handle sensitive but non-crisis topics.\n Collaborate with researchers to maintain consistent and well-documented evaluation standards.\n\nQualifications\nMust-Have\n\n Degree in psychology, counseling, social work, behavioral health, or equivalent professional experience.\n 3+ years of professional experience in mental health, counseling, or social services.\n Ability to remain neutral and nonjudgmental across diverse perspectives.\n Familiarity with concepts like sycophancy and cognitive distortions.\n Ability to engage reliably for 20+ hours/week during weekdays.\n Strong written communication skills.\n\nPreferred\n\n Background in AI safety, applied ethics, or content policy.\n Experience in relationship counseling or spiritual care.\n Familiarity with the psychology of misinformation.\n\nApplication Process (Takes 20–30 mins to complete)\n\n Upload resume\n AI interview based on your resume\n Submit form\n\nResources & Support\n\n For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome\n For any help or support, reach out to: support@mercor.com\n\nPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Loading
Please wait..!!