Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Senior LLM Model Optimization Consultant

  • Senior LLM Model Optimization Consultant job type Posted on: Nov 16, 2026
  • Senior LLM Model Optimization Consultant experience level Predactica™
  • Senior LLM Model Optimization Consultant employment type United, West Virginia
  • Senior LLM Model Optimization Consultant employment type Onsite
  • Senior LLM Model Optimization Consultant salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Senior LLM Model Optimization Consultant roles in West Virginia.

View Salary Guide →

Job Title :

Senior LLM Model Optimization Consultant

Job Type :

Full-Time

Job Location :

United West Virginia United States

Remote :

No

Jobcon Logo Job Description :

Job Description

About the Role\n

We are seeking a highly experienced Senior LLM Model Optimization Engineer for a consulting engagement focused on optimizing Large Language Models (LLMs) deployed in an on-premises environment.

\n


\n

The ideal candidate will have deep hands-on expertise in transformer architectures, neural network weight tuning, layer-level optimization, and GPU-accelerated deep learning. This role requires experience working directly with model internals to improve accuracy, computational efficiency, memory utilization, and inference performance.

\n


\n

This is a model-level engineering role, not a prompt engineering, RAG, or LLM application development position.

Key Responsibilities\n
    \n
  • Analyze and optimize transformer-based LLM architectures, including attention mechanisms, feed-forward layers, and normalization components.
  • \n
  • Perform model weight tuning through full and selective fine-tuning, gradient-based optimization, and parameter-efficient techniques.
  • \n
  • Identify opportunities for layer-level optimization, including layer freezing, pruning, compression, and architectural improvements.
  • \n
  • Optimize model training and inference performance on on-premises GPU infrastructure.
  • \n
  • Apply techniques such as quantization, mixed-precision computation, knowledge distillation, and model compression.
  • \n
  • Profile and troubleshoot GPU memory utilization, computational bottlenecks, and model execution performance.
  • \n
  • Develop benchmarking and evaluation frameworks to measure accuracy, latency, throughput, and resource utilization.
  • \n
  • Collaborate with infrastructure and AI engineering teams to deploy and validate optimized models.
  • \n
Required Qualifications\n
    \n
  • 5+ years of hands-on experience in machine learning or deep learning engineering, including substantial experience with transformer-based models.
  • \n
  • Strong expertise in Python, PyTorch, and transformer architectures.
  • \n
  • Demonstrated experience tuning LLM model weights, including optimizer configuration, backpropagation, gradient management, and fine-tuning strategies.
  • \n
  • Hands-on experience modifying or optimizing transformer layers, attention mechanisms, and neural network components.
  • \n
  • Experience with model optimization techniques such as LoRA, QLoRA, pruning, quantization, and selective layer fine-tuning.
  • \n
  • Strong understanding of GPU computing, CUDA fundamentals, and GPU memory optimization.
  • \n
  • Experience evaluating model performance and balancing accuracy, latency, memory usage, and computational efficiency.
  • \n
  • Experience working with open-weight LLMs such as Llama, Mistral, or Qwen.
  • \n
Preferred Qualifications\n
    \n
  • Experience with NVIDIA GPU environments and CUDA/C++ kernel development.
  • \n
  • Experience with DeepSpeed, PyTorch FSDP, or distributed model training.
  • \n
  • Knowledge of FlashAttention, Triton, TensorRT-LLM, or vLLM.
  • \n
  • Experience with quantization-aware training, structured pruning, or knowledge distillation.
  • \n
  • Experience optimizing LLMs on enterprise-managed or on-premises GPU clusters.
  • \n
  • Experience with Hugging Face Transformers, PEFT, and model profiling tools.
  • \n
Ideal Candidate\n

We are particularly interested in engineers who have directly modified, fine-tuned, or optimized LLM weights and transformer layers, rather than exclusively integrating pretrained models through APIs.

\n

Candidates should be able to demonstrate measurable improvements in model quality, GPU memory efficiency, inference latency, or computational performance from previous engagements.

Jobcon Logo Position Details

Posted:

Nov 16, 2026

Reference Number:

791ccf19f8efebda

Employment:

Full-time

City:

United

Job Origin:

ziprecruiter

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Senior LLM Model Optimization Consultant    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Description

About the Role\n

We are seeking a highly experienced Senior LLM Model Optimization Engineer for a consulting engagement focused on optimizing Large Language Models (LLMs) deployed in an on-premises environment.

\n


\n

The ideal candidate will have deep hands-on expertise in transformer architectures, neural network weight tuning, layer-level optimization, and GPU-accelerated deep learning. This role requires experience working directly with model internals to improve accuracy, computational efficiency, memory utilization, and inference performance.

\n


\n

This is a model-level engineering role, not a prompt engineering, RAG, or LLM application development position.

Key Responsibilities\n
    \n
  • Analyze and optimize transformer-based LLM architectures, including attention mechanisms, feed-forward layers, and normalization components.
  • \n
  • Perform model weight tuning through full and selective fine-tuning, gradient-based optimization, and parameter-efficient techniques.
  • \n
  • Identify opportunities for layer-level optimization, including layer freezing, pruning, compression, and architectural improvements.
  • \n
  • Optimize model training and inference performance on on-premises GPU infrastructure.
  • \n
  • Apply techniques such as quantization, mixed-precision computation, knowledge distillation, and model compression.
  • \n
  • Profile and troubleshoot GPU memory utilization, computational bottlenecks, and model execution performance.
  • \n
  • Develop benchmarking and evaluation frameworks to measure accuracy, latency, throughput, and resource utilization.
  • \n
  • Collaborate with infrastructure and AI engineering teams to deploy and validate optimized models.
  • \n
Required Qualifications\n
    \n
  • 5+ years of hands-on experience in machine learning or deep learning engineering, including substantial experience with transformer-based models.
  • \n
  • Strong expertise in Python, PyTorch, and transformer architectures.
  • \n
  • Demonstrated experience tuning LLM model weights, including optimizer configuration, backpropagation, gradient management, and fine-tuning strategies.
  • \n
  • Hands-on experience modifying or optimizing transformer layers, attention mechanisms, and neural network components.
  • \n
  • Experience with model optimization techniques such as LoRA, QLoRA, pruning, quantization, and selective layer fine-tuning.
  • \n
  • Strong understanding of GPU computing, CUDA fundamentals, and GPU memory optimization.
  • \n
  • Experience evaluating model performance and balancing accuracy, latency, memory usage, and computational efficiency.
  • \n
  • Experience working with open-weight LLMs such as Llama, Mistral, or Qwen.
  • \n
Preferred Qualifications\n
    \n
  • Experience with NVIDIA GPU environments and CUDA/C++ kernel development.
  • \n
  • Experience with DeepSpeed, PyTorch FSDP, or distributed model training.
  • \n
  • Knowledge of FlashAttention, Triton, TensorRT-LLM, or vLLM.
  • \n
  • Experience with quantization-aware training, structured pruning, or knowledge distillation.
  • \n
  • Experience optimizing LLMs on enterprise-managed or on-premises GPU clusters.
  • \n
  • Experience with Hugging Face Transformers, PEFT, and model profiling tools.
  • \n
Ideal Candidate\n

We are particularly interested in engineers who have directly modified, fine-tuned, or optimized LLM weights and transformer layers, rather than exclusively integrating pretrained models through APIs.

\n

Candidates should be able to demonstrate measurable improvements in model quality, GPU memory efficiency, inference latency, or computational performance from previous engagements.

Loading
Please wait..!!