Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Senior Software Engineer, Model Evaluation

  • Senior Software Engineer, Model Evaluation job type Posted on: Nov 18, 2026
  • Senior Software Engineer, Model Evaluation experience level Clera
  • Senior Software Engineer, Model Evaluation employment type San Francisco, California
  • Senior Software Engineer, Model Evaluation salary Salary: $180,000 per year
  • Senior Software Engineer, Model Evaluation employment type Onsite
  • Senior Software Engineer, Model Evaluation salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Senior Software Engineer, Model Evaluation roles in California.

View Salary Guide →

Job Title :

Senior Software Engineer, Model Evaluation

Job Type :

Full-Time

Job Location :

San Francisco California United States

Remote :

No

Jobcon Logo Job Description :

Job Description

Job Description
About the Role

Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

What You'll Do
  • Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.

  • Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.

  • Train and fine-tune models, using evaluation results to guide experiments.

  • Identify agent failures, improve production systems, and measure whether changes work.

  • Help establish the team's research and evaluation practices.

What We're Looking For
  • At least 3 years of experience, operating at a senior or staff level.

  • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.

  • Practical experience training and fine-tuning models, not only using models through APIs.

  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.

  • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

Compensation & Benefits

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

Location

Hybrid in San Francisco, California, United States.

Compensation Range: $180K - $250K

Jobcon Logo Position Details

Posted:

Nov 18, 2026

Reference Number:

ac419029

Employment:

Full-time

Salary:

$180,000 per year

City:

San Francisco

Job Origin:

ziprecruiter

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Senior Software Engineer, Model Evaluation    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Description

Job Description
About the Role

Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

What You'll Do
  • Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.

  • Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.

  • Train and fine-tune models, using evaluation results to guide experiments.

  • Identify agent failures, improve production systems, and measure whether changes work.

  • Help establish the team's research and evaluation practices.

What We're Looking For
  • At least 3 years of experience, operating at a senior or staff level.

  • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.

  • Practical experience training and fine-tuning models, not only using models through APIs.

  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.

  • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

Compensation & Benefits

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

Location

Hybrid in San Francisco, California, United States.

Compensation Range: $180K - $250K

Loading
Please wait..!!