Loading, Please wait..!!
Senior Software Engineer, Model Evaluation
-
Posted on: Nov 18, 2026
-
San Francisco, California
-
Salary: $180,000 per year
-
Onsite
-
Full-time
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Senior Software Engineer, Model Evaluation roles in California.
View Salary Guide →Find your match !
Job Title :
Senior Software Engineer, Model Evaluation
Job Type :
Full-Time
Job Location :
San Francisco California United States
Remote :
No
Job Description :
Job Description
Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.
What You'll DoDesign and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.
Train and fine-tune models, using evaluation results to guide experiments.
Identify agent failures, improve production systems, and measure whether changes work.
Help establish the team's research and evaluation practices.
At least 3 years of experience, operating at a senior or staff level.
Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
Practical experience training and fine-tuning models, not only using models through APIs.
Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.
Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.
LocationHybrid in San Francisco, California, United States.
Compensation Range: $180K - $250K
Position Details
Posted:
Nov 18, 2026
Reference Number:
ac419029
Employment:
Full-time
Salary:
$180,000 per year
City:
San Francisco
Job Origin:
ziprecruiter
Share this job:
Please wait..!!

