Skip to main content
Loading
loadingbar
Loading, Please wait..!!

DevOps Engineer - AI Model Evaluator

  • DevOps Engineer - AI Model Evaluator job type Posted on: Nov 17, 2026
  • DevOps Engineer - AI Model Evaluator experience level Mercor
  • DevOps Engineer - AI Model Evaluator employment type New York, New York
  • DevOps Engineer - AI Model Evaluator salary Salary: $85 per hour
  • DevOps Engineer - AI Model Evaluator employment type Remote
  • DevOps Engineer - AI Model Evaluator salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for DevOps Engineer - AI Model Evaluator roles in New York.

View Salary Guide →

Job Title :

DevOps Engineer - AI Model Evaluator

Job Type :

Full-Time

Job Location :

New York New York United States

Remote :

Yes

Jobcon Logo Job Description :

Job DescriptionJob DescriptionAbout the job\nMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.\nPosition: DevOps / SRE / Cloud Engineer (Coding Agent Experience)Type: ContractCompensation: $85/hourLocation: Remote\nRole Responsibilities\n\n Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.\n Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.\n Identify bugs, edge cases, reliability issues, and failure modes in model outputs.\n Compare outputs from multiple frontier models to assess their strengths and weaknesses.\n Apply professional engineering judgment to realistic infrastructure engineering scenarios.\n\nQualifications\nMust-Have\n\n 2+ years of professional DevOps, SRE, or Cloud Engineering experience.\n Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.\n Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.\n Ability to evaluate model-generated infrastructure and reliability engineering solutions.\n\nPreferred\n\n Experience supporting production-scale systems.\n\nCompensation & Legal\n\n $400 per accepted task\n Compensation tied to accepted work.\n\nApplication Process (Takes 20–30 mins to complete)\n\n Upload resume\n AI interview based on your resume\n Submit form\n\nResources & Support\n\n For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome\n For any help or support, reach out to: support@mercor.com\n\nPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Jobcon Logo Position Details

Posted:

Nov 17, 2026

Reference Number:

16275_b6debe973

Employment:

Full-time

Salary:

$85 per hour

City:

New York

Job Origin:

APPCAST_CPC

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

DevOps Engineer - AI Model Evaluator    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job DescriptionJob DescriptionAbout the job\nMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.\nPosition: DevOps / SRE / Cloud Engineer (Coding Agent Experience)Type: ContractCompensation: $85/hourLocation: Remote\nRole Responsibilities\n\n Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.\n Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.\n Identify bugs, edge cases, reliability issues, and failure modes in model outputs.\n Compare outputs from multiple frontier models to assess their strengths and weaknesses.\n Apply professional engineering judgment to realistic infrastructure engineering scenarios.\n\nQualifications\nMust-Have\n\n 2+ years of professional DevOps, SRE, or Cloud Engineering experience.\n Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.\n Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.\n Ability to evaluate model-generated infrastructure and reliability engineering solutions.\n\nPreferred\n\n Experience supporting production-scale systems.\n\nCompensation & Legal\n\n $400 per accepted task\n Compensation tied to accepted work.\n\nApplication Process (Takes 20–30 mins to complete)\n\n Upload resume\n AI interview based on your resume\n Submit form\n\nResources & Support\n\n For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome\n For any help or support, reach out to: support@mercor.com\n\nPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Loading
Please wait..!!