Loading, Please wait..!!
Senior LLM Model Optimization Consultant
-
Posted on: Nov 16, 2026
-
United, West Virginia
-
Onsite
-
Full-time
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Senior LLM Model Optimization Consultant roles in West Virginia.
View Salary Guide →Find your match !
Job Title :
Senior LLM Model Optimization Consultant
Job Type :
Full-Time
Job Location :
United West Virginia United States
Remote :
No
Job Description :
Job Description
We are seeking a highly experienced Senior LLM Model Optimization Engineer for a consulting engagement focused on optimizing Large Language Models (LLMs) deployed in an on-premises environment.
\nThe ideal candidate will have deep hands-on expertise in transformer architectures, neural network weight tuning, layer-level optimization, and GPU-accelerated deep learning. This role requires experience working directly with model internals to improve accuracy, computational efficiency, memory utilization, and inference performance.
\nThis is a model-level engineering role, not a prompt engineering, RAG, or LLM application development position.
- \n
- Analyze and optimize transformer-based LLM architectures, including attention mechanisms, feed-forward layers, and normalization components. \n
- Perform model weight tuning through full and selective fine-tuning, gradient-based optimization, and parameter-efficient techniques. \n
- Identify opportunities for layer-level optimization, including layer freezing, pruning, compression, and architectural improvements. \n
- Optimize model training and inference performance on on-premises GPU infrastructure. \n
- Apply techniques such as quantization, mixed-precision computation, knowledge distillation, and model compression. \n
- Profile and troubleshoot GPU memory utilization, computational bottlenecks, and model execution performance. \n
- Develop benchmarking and evaluation frameworks to measure accuracy, latency, throughput, and resource utilization. \n
- Collaborate with infrastructure and AI engineering teams to deploy and validate optimized models.
- \n
- 5+ years of hands-on experience in machine learning or deep learning engineering, including substantial experience with transformer-based models. \n
- Strong expertise in Python, PyTorch, and transformer architectures. \n
- Demonstrated experience tuning LLM model weights, including optimizer configuration, backpropagation, gradient management, and fine-tuning strategies. \n
- Hands-on experience modifying or optimizing transformer layers, attention mechanisms, and neural network components. \n
- Experience with model optimization techniques such as LoRA, QLoRA, pruning, quantization, and selective layer fine-tuning. \n
- Strong understanding of GPU computing, CUDA fundamentals, and GPU memory optimization. \n
- Experience evaluating model performance and balancing accuracy, latency, memory usage, and computational efficiency. \n
- Experience working with open-weight LLMs such as Llama, Mistral, or Qwen.
- \n
- Experience with NVIDIA GPU environments and CUDA/C++ kernel development. \n
- Experience with DeepSpeed, PyTorch FSDP, or distributed model training. \n
- Knowledge of FlashAttention, Triton, TensorRT-LLM, or vLLM. \n
- Experience with quantization-aware training, structured pruning, or knowledge distillation. \n
- Experience optimizing LLMs on enterprise-managed or on-premises GPU clusters. \n
- Experience with Hugging Face Transformers, PEFT, and model profiling tools.
We are particularly interested in engineers who have directly modified, fine-tuned, or optimized LLM weights and transformer layers, rather than exclusively integrating pretrained models through APIs.
\nCandidates should be able to demonstrate measurable improvements in model quality, GPU memory efficiency, inference latency, or computational performance from previous engagements.
Position Details
Posted:
Nov 16, 2026
Reference Number:
791ccf19f8efebda
Employment:
Full-time
City:
United
Job Origin:
ziprecruiter
Share this job:
Please wait..!!

