Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Principal AI/ML Engineer

  • Principal AI/ML Engineer job type Posted on: Nov 17, 2026
  • Principal AI/ML Engineer experience level LHH
  • Principal AI/ML Engineer employment type San Francisco, California
  • Principal AI/ML Engineer salary Salary: $280,000 per year
  • Principal AI/ML Engineer employment type Remote
  • Principal AI/ML Engineer salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Principal AI/ML Engineer roles in California.

View Salary Guide →

Job Title :

Principal AI/ML Engineer

Job Type :

Full-Time

Job Location :

San Francisco California United States

Remote :

Yes

Jobcon Logo Job Description :

Job Description

Job Description

LHH is partnering with an global firm that is expanding its investment in AI and looking for a Principal highly hands-on AI/ML engineer to help build the technical foundation behind its next generation of AI solutions.

\n

This is not a traditional AI application-development or prompt-engineering role. We're looking for someone who understands what happens beneath the API layer and can work across infrastructure, models, deployment, serving, monitoring, integrations, and production support.

\n

\n

The right person will be equally comfortable experimenting with an open-source model, troubleshooting GPU or resource constraints, building an inference environment, writing Python, deploying containers, and figuring out a technical problem that doesn't already have a playbook.

\n

\n

What You'll Do

\n
    \n
  • \n

    Partner directly with executives and senior stakeholders to translate complex business needs into practical AI strategies and technical solutions.

  • \n
  • \n

    Serve as a trusted technical advisor when evaluating AI opportunities, risks, architecture, infrastructure, and emerging technologies.

  • \n
  • \n

    Design, build, deploy, operate, and troubleshoot production AI/ML environments.

  • \n
  • \n

    Deploy and optimize open-source and locally hosted AI models, including models such as Llama, Mistral, Qwen, Gemma, or comparable technologies.

  • \n
  • \n

    Build and support AI workloads running on GPU-backed infrastructure.

  • \n
  • \n

    Evaluate model size, GPU memory, RAM, quantization, inference requirements, latency, throughput, and available compute when designing solutions.

  • \n
  • \n

    Build and maintain model-serving and inference environments.

  • \n
  • \n

    Take AI solutions from early experimentation through production deployment and ongoing operational support.

  • \n
  • \n

    Build and integrate LLM, RAG, retrieval/search, agentic AI, and workflow automation solutions.

  • \n
  • \n

    Develop APIs and integrations across structured and unstructured enterprise data sources.

  • \n
  • \n

    Containerize and orchestrate AI workloads using technologies such as Docker and Kubernetes.

  • \n
  • \n

    Implement monitoring, observability, evaluation, and performance testing across AI systems.

  • \n
  • \n

    Troubleshoot complex issues across infrastructure, model, application, integration, and data layers.

  • \n
  • \n

    Evaluate when hosted AI platforms make sense versus when solutions should be deployed within internally controlled infrastructure.

  • \n
  • \n

    Research and experiment with emerging models, inference frameworks, infrastructure, and deployment technologies.

  • \n
  • \n

    Work independently through ambiguous technical challenges while collaborating with both technical and nontechnical stakeholders.

  • \n
  • \n

    Help establish scalable, secure, and repeatable approaches to delivering AI solutions.

  • \n
\n

\n

What We're Looking For

\n
    \n
  • \n

    5+ years of hands-on AI Infrastructure, MLOps, and platform engineering experience.

  • \n
  • \n

    Experience deploying AI/ML workloads into production rather than exclusively consuming hosted AI APIs.

  • \n
  • \n

    Hands-on experience deploying or experimenting with open-source/local models.

  • \n
  • \n

    Practical experience with GPU-backed AI workloads and an understanding of: GPU memory / VRAM, System RAM and capacity, Model sizing, Quantization, Inference performance, Resource constraints, Latency and throughput

  • \n
  • \n

    Strong software engineering skills with Python or another applicable programming language.

  • \n
  • \n

    Experience with Docker, Kubernetes, APIs, and modern deployment practices.

  • \n
  • \n

    Experience with model serving/inference technologies such as vLLM, NVIDIA Triton, Hugging Face, Ollama, Ray Serve, TGI, llama.cpp, or comparable tools.

  • \n
  • \n

    Understanding of RAG, embeddings, vector search, information retrieval, structured/unstructured data, and model evaluation.

  • \n
  • \n

    Experience implementing monitoring and observability for production applications or AI systems.

  • \n
  • \n

    Ability to independently research unfamiliar technologies and solve problems without relying on an established playbook.

  • \n
  • \n

    Strong security mindset when working with confidential or sensitive data.

  • \n
  • \n

    Ability to communicate technical decisions, limitations, and tradeoffs to both technical and nontechnical stakeholders.

  • \n
\n

\n

Fully remote in select states: AR, CA, CO, DC, DE, FL, GA, IL, KS, LA, MA, MD, ME, MI, MN, MO, NC, NJ, NM, NV, NY, ND, OH, OR, PA, RI, TX, UT, VA, WA, WI

\n

\n

Disclaimer: This is not a C2C/C2H opportunity and only accepting candidates within the US or authorized to work/not needing sponsorship now or in the future.

\n

\n

Equal Opportunity Employer/Veterans/Disabled

\n

\n

To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.lhh.com/us/en/candidate-privacy

\n

\n

The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:

\n

- The California Fair Chance Act

\n

- Los Angeles City Fair Chance Ordinance

\n

- Los Angeles County Fair Chance Ordinance for Employers

\n

- San Francisco Fair Chance Ordinance

\n
\n
Pay Details: $280,000.00 to $350,000.00 per year\n
\n
Search managed by: Brittanie Chambers \n
\n
\nEqual Opportunity Employer/Veterans/Disabled\n
\n
\nMilitary connected talent encouraged to apply\n
\n
\nTo read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.lhh.com/us/en/candidate-privacy\n
\n
\nThe Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:\n
\n
    \n
  • The California Fair Chance Act
  • \n
  • Los Angeles City Fair Chance Ordinance
  • \n
  • Los Angeles County Fair Chance Ordinance for Employers
  • \n
  • San Francisco Fair Chance Ordinance
  • \n
\n
\n
\n

Massachusetts Candidates Only: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

\nCompany Description

Global Management Consulting firm.

Company Description

Global Management Consulting firm.

Jobcon Logo Position Details

Posted:

Nov 17, 2026

Reference Number:

ea23bca7

Employment:

Full-time

Salary:

$280,000 per year

City:

San Francisco

Job Origin:

ziprecruiter

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Principal AI/ML Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Description

Job Description

LHH is partnering with an global firm that is expanding its investment in AI and looking for a Principal highly hands-on AI/ML engineer to help build the technical foundation behind its next generation of AI solutions.

\n

This is not a traditional AI application-development or prompt-engineering role. We're looking for someone who understands what happens beneath the API layer and can work across infrastructure, models, deployment, serving, monitoring, integrations, and production support.

\n

\n

The right person will be equally comfortable experimenting with an open-source model, troubleshooting GPU or resource constraints, building an inference environment, writing Python, deploying containers, and figuring out a technical problem that doesn't already have a playbook.

\n

\n

What You'll Do

\n
    \n
  • \n

    Partner directly with executives and senior stakeholders to translate complex business needs into practical AI strategies and technical solutions.

  • \n
  • \n

    Serve as a trusted technical advisor when evaluating AI opportunities, risks, architecture, infrastructure, and emerging technologies.

  • \n
  • \n

    Design, build, deploy, operate, and troubleshoot production AI/ML environments.

  • \n
  • \n

    Deploy and optimize open-source and locally hosted AI models, including models such as Llama, Mistral, Qwen, Gemma, or comparable technologies.

  • \n
  • \n

    Build and support AI workloads running on GPU-backed infrastructure.

  • \n
  • \n

    Evaluate model size, GPU memory, RAM, quantization, inference requirements, latency, throughput, and available compute when designing solutions.

  • \n
  • \n

    Build and maintain model-serving and inference environments.

  • \n
  • \n

    Take AI solutions from early experimentation through production deployment and ongoing operational support.

  • \n
  • \n

    Build and integrate LLM, RAG, retrieval/search, agentic AI, and workflow automation solutions.

  • \n
  • \n

    Develop APIs and integrations across structured and unstructured enterprise data sources.

  • \n
  • \n

    Containerize and orchestrate AI workloads using technologies such as Docker and Kubernetes.

  • \n
  • \n

    Implement monitoring, observability, evaluation, and performance testing across AI systems.

  • \n
  • \n

    Troubleshoot complex issues across infrastructure, model, application, integration, and data layers.

  • \n
  • \n

    Evaluate when hosted AI platforms make sense versus when solutions should be deployed within internally controlled infrastructure.

  • \n
  • \n

    Research and experiment with emerging models, inference frameworks, infrastructure, and deployment technologies.

  • \n
  • \n

    Work independently through ambiguous technical challenges while collaborating with both technical and nontechnical stakeholders.

  • \n
  • \n

    Help establish scalable, secure, and repeatable approaches to delivering AI solutions.

  • \n
\n

\n

What We're Looking For

\n
    \n
  • \n

    5+ years of hands-on AI Infrastructure, MLOps, and platform engineering experience.

  • \n
  • \n

    Experience deploying AI/ML workloads into production rather than exclusively consuming hosted AI APIs.

  • \n
  • \n

    Hands-on experience deploying or experimenting with open-source/local models.

  • \n
  • \n

    Practical experience with GPU-backed AI workloads and an understanding of: GPU memory / VRAM, System RAM and capacity, Model sizing, Quantization, Inference performance, Resource constraints, Latency and throughput

  • \n
  • \n

    Strong software engineering skills with Python or another applicable programming language.

  • \n
  • \n

    Experience with Docker, Kubernetes, APIs, and modern deployment practices.

  • \n
  • \n

    Experience with model serving/inference technologies such as vLLM, NVIDIA Triton, Hugging Face, Ollama, Ray Serve, TGI, llama.cpp, or comparable tools.

  • \n
  • \n

    Understanding of RAG, embeddings, vector search, information retrieval, structured/unstructured data, and model evaluation.

  • \n
  • \n

    Experience implementing monitoring and observability for production applications or AI systems.

  • \n
  • \n

    Ability to independently research unfamiliar technologies and solve problems without relying on an established playbook.

  • \n
  • \n

    Strong security mindset when working with confidential or sensitive data.

  • \n
  • \n

    Ability to communicate technical decisions, limitations, and tradeoffs to both technical and nontechnical stakeholders.

  • \n
\n

\n

Fully remote in select states: AR, CA, CO, DC, DE, FL, GA, IL, KS, LA, MA, MD, ME, MI, MN, MO, NC, NJ, NM, NV, NY, ND, OH, OR, PA, RI, TX, UT, VA, WA, WI

\n

\n

Disclaimer: This is not a C2C/C2H opportunity and only accepting candidates within the US or authorized to work/not needing sponsorship now or in the future.

\n

\n

Equal Opportunity Employer/Veterans/Disabled

\n

\n

To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.lhh.com/us/en/candidate-privacy

\n

\n

The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:

\n

- The California Fair Chance Act

\n

- Los Angeles City Fair Chance Ordinance

\n

- Los Angeles County Fair Chance Ordinance for Employers

\n

- San Francisco Fair Chance Ordinance

\n
\n
Pay Details: $280,000.00 to $350,000.00 per year\n
\n
Search managed by: Brittanie Chambers \n
\n
\nEqual Opportunity Employer/Veterans/Disabled\n
\n
\nMilitary connected talent encouraged to apply\n
\n
\nTo read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.lhh.com/us/en/candidate-privacy\n
\n
\nThe Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:\n
\n
    \n
  • The California Fair Chance Act
  • \n
  • Los Angeles City Fair Chance Ordinance
  • \n
  • Los Angeles County Fair Chance Ordinance for Employers
  • \n
  • San Francisco Fair Chance Ordinance
  • \n
\n
\n
\n

Massachusetts Candidates Only: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

\nCompany Description

Global Management Consulting firm.

Company Description

Global Management Consulting firm.

Loading
Please wait..!!