Job DescriptionJob DescriptionSenior Machine Learning Engineer, Inference Job Summary\nFor our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise in ML inference optimization to join its inference team.\nIn this role, you will own inference optimization end-to-end – taking models from research to production at consumer scale and solving latency and throughput problems for realtime AI products used by hundreds of millions of people.\nOur client is a well-funded, venture-backed AI research lab and realtime inference provider with a small, senior engineering team.Team\nInference: The team owns how our client’s models run in production – inference engines, GPU efficiency, model acceleration and the distributed serving infrastructure behind realtime voice and LLM products.\nThis is an opportunity for senior engineers who want to work deep inside modern inference engines on problems at real consumer scale.Responsibilities\n\n Own inference optimization end-to-end, from research models to production deployment;\n Optimize latency and throughput of realtime voice and LLM inference at consumer scale;\n Work inside inference engines such as vLLM, TRT-LLM and SGLang to improve performance;\n Apply model acceleration techniques – quantization, distillation, speculative decoding, caching, continuous batching and paged attention;\n Write high-performance code in C++, CUDA, Rust or optimized Python for GPU workloads;\n Build and scale distributed multi-GPU and multi-node serving with Kubernetes, Ray and custom load balancing for high concurrency;\n Collaborate with research and product teams to bring new models into production.\nRequirements\n\n 5+ years of experience as an ML inference or systems engineer, at senior level (Google L5 / Meta E5 or equivalent);\n Hands-on ML inference optimization inside vLLM or TRT-LLM (engine-level work, not only deployment);\n Experience building backend/ML systems and serving models in production;\n Systems programming and GPU optimization skills: C++, CUDA, Rust or optimized Python;\n Experience with model acceleration: quantization, distillation, speculative decoding, caching, continuous batching, paged attention;\n Distributed systems experience: Kubernetes, Ray, load balancing, multi-GPU/multi-node inference, high concurrency;\n Based in the US, Canada, UK, Germany, Switzerland or Serbia;\n Excellent communication skills in English.\nNice to have\n\n A track record of fast promotions;\n Public technical work – open-source inference engine contributions or technical write-ups;\n PhD in Computer Science, Physics or Mathematics, or a degree from a top CS program;\n Ability to commute to Mountain View, CA.\nThe offer\n\n Project/Client: Fast-growing AI company (realtime voice and LLM)\n Location: Onsite in Mountain View, CA (preferred), or remote in the US, Canada, UK, Germany, Switzerland or Serbia\n Language: English\n Engagement: Full-time\n Contract: Permanent employment\n Salary: $250K–$300K base + competitive equity\n Visa and relocation: H-1B / OPT transfers supported; relocation assistance to the San Francisco Bay Area\nSelection Process Stage 1–3: AIDA Recruitment pre-selection\n\n Stage 1: CV Screening. Your application will be reviewed within 24 hours of submission.\n Stage 2: Pre-Screening. A short Q/A session to assess your experience and technical background. You can choose between an automated Q/A video session (recommended for faster feedback) or a recruiter interview.\n Stage 3: Shortlisting. Candidates whose experience best matches the role will be shortlisted and presented to the hiring manager.\nClient interview process\n\n Stage 4: Recruiter interview. A 30-minute conversation with the client’s talent team.\n Stage 5: Technical interview – ML exercise. 90 minutes, based on a real production problem; onsite in Mountain View preferred for local candidates, remote otherwise.\n Stage 6: Hiring manager interview. 30 minutes.\n Stage 7: ML system design interview. 45 minutes.\n Stage 8: CTO interview. 45 minutes, mostly behavioural.\n Stage 9: CEO interview. 30 minutes, culture and vision fit.\n\nOffer and onboarding\nSuccessful candidates will receive an offer and begin the onboarding process.About Employer\nAIDA Recruitment – a partner for technology-sector companies. We recruit IT specialists from all around the world for our clients. We use digital technology to work faster, be more efficient, and provide the best solutions for both clients and candidates.Additional Information\n\n We aim to keep candidates informed throughout the process and provide updates after each completed stage.\n\nInformation about the processing of your personal data is provided in our Privacy Policy.
Click on the below icons to share this job to Linkedin, Twitter!
Job DescriptionJob DescriptionSenior Machine Learning Engineer, Inference Job Summary\nFor our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise in ML inference optimization to join its inference team.\nIn this role, you will own inference optimization end-to-end – taking models from research to production at consumer scale and solving latency and throughput problems for realtime AI products used by hundreds of millions of people.\nOur client is a well-funded, venture-backed AI research lab and realtime inference provider with a small, senior engineering team.Team\nInference: The team owns how our client’s models run in production – inference engines, GPU efficiency, model acceleration and the distributed serving infrastructure behind realtime voice and LLM products.\nThis is an opportunity for senior engineers who want to work deep inside modern inference engines on problems at real consumer scale.Responsibilities\n\n Own inference optimization end-to-end, from research models to production deployment;\n Optimize latency and throughput of realtime voice and LLM inference at consumer scale;\n Work inside inference engines such as vLLM, TRT-LLM and SGLang to improve performance;\n Apply model acceleration techniques – quantization, distillation, speculative decoding, caching, continuous batching and paged attention;\n Write high-performance code in C++, CUDA, Rust or optimized Python for GPU workloads;\n Build and scale distributed multi-GPU and multi-node serving with Kubernetes, Ray and custom load balancing for high concurrency;\n Collaborate with research and product teams to bring new models into production.\nRequirements\n\n 5+ years of experience as an ML inference or systems engineer, at senior level (Google L5 / Meta E5 or equivalent);\n Hands-on ML inference optimization inside vLLM or TRT-LLM (engine-level work, not only deployment);\n Experience building backend/ML systems and serving models in production;\n Systems programming and GPU optimization skills: C++, CUDA, Rust or optimized Python;\n Experience with model acceleration: quantization, distillation, speculative decoding, caching, continuous batching, paged attention;\n Distributed systems experience: Kubernetes, Ray, load balancing, multi-GPU/multi-node inference, high concurrency;\n Based in the US, Canada, UK, Germany, Switzerland or Serbia;\n Excellent communication skills in English.\nNice to have\n\n A track record of fast promotions;\n Public technical work – open-source inference engine contributions or technical write-ups;\n PhD in Computer Science, Physics or Mathematics, or a degree from a top CS program;\n Ability to commute to Mountain View, CA.\nThe offer\n\n Project/Client: Fast-growing AI company (realtime voice and LLM)\n Location: Onsite in Mountain View, CA (preferred), or remote in the US, Canada, UK, Germany, Switzerland or Serbia\n Language: English\n Engagement: Full-time\n Contract: Permanent employment\n Salary: $250K–$300K base + competitive equity\n Visa and relocation: H-1B / OPT transfers supported; relocation assistance to the San Francisco Bay Area\nSelection Process Stage 1–3: AIDA Recruitment pre-selection\n\n Stage 1: CV Screening. Your application will be reviewed within 24 hours of submission.\n Stage 2: Pre-Screening. A short Q/A session to assess your experience and technical background. You can choose between an automated Q/A video session (recommended for faster feedback) or a recruiter interview.\n Stage 3: Shortlisting. Candidates whose experience best matches the role will be shortlisted and presented to the hiring manager.\nClient interview process\n\n Stage 4: Recruiter interview. A 30-minute conversation with the client’s talent team.\n Stage 5: Technical interview – ML exercise. 90 minutes, based on a real production problem; onsite in Mountain View preferred for local candidates, remote otherwise.\n Stage 6: Hiring manager interview. 30 minutes.\n Stage 7: ML system design interview. 45 minutes.\n Stage 8: CTO interview. 45 minutes, mostly behavioural.\n Stage 9: CEO interview. 30 minutes, culture and vision fit.\n\nOffer and onboarding\nSuccessful candidates will receive an offer and begin the onboarding process.About Employer\nAIDA Recruitment – a partner for technology-sector companies. We recruit IT specialists from all around the world for our clients. We use digital technology to work faster, be more efficient, and provide the best solutions for both clients and candidates.Additional Information\n\n We aim to keep candidates informed throughout the process and provide updates after each completed stage.\n\nInformation about the processing of your personal data is provided in our Privacy Policy.
yes
Send Us Your Feedback
Sign
In
Please check your email. We have sent you a password reset link.
This link will expire in one hour.
Please input your account's email
Apply to Senior Machine Learning Engineer, Inference
AIDA Recruitment • Mountain View, California
✓
Application Started!
Redirecting you to complete your application...
Get $5 added to your wallet for registering an account. Refer others and get $1 for each successful referral. Earn while you search for jobs and redeem in gift cards!Register to search from millions of jobs across the United States. Upload your resume and get matched with top employers today!
Welcome to SnapRecruit! Your account has been created via Google.
Get $5.00 Added to Your Wallet!
Upload your resume below and apply to this job to have $5.00 added directly to your wallet, activate your account, and qualify for high-priority employer matches.
Perks & Rewards You Receive with SnapRecruit:
$5.00 Resume Bonus
Added automatically to your wallet when you apply with your resume.
$1.00 Per Referral
Earn $1.00 cash rewards for every friend who joins SnapRecruit in the US.
Earn While You Search
Get credited $0.02 - $0.05 every time you explore sponsored job listings.
Amazon eGift Cards
Redeem your earned wallet funds for Amazon eGift Cards delivered to your email.
Get $5 added to your wallet for registering anRegister to search from millions of jobs across the United States. Upload your resume and get matched with top employers today!
account.
Refers others and get $1 for each successful referral.
Earn while you search for jobs and redeem in
gift cards!
Upload your resume for a free professional assessment
Loading, Please wait..!!
Send this job to my email
Please wait..!!
Confirmation
Are you sure?
List of resumes
Confirmation
It is working for Chrome Mozilla only for now
We use essential cookies to keep SnapRecruit secure and reliable. With your permission, we also use optional analytics, AI support chat, and push-alert cookies to improve your job search experience. You can change or withdraw your choice anytime.
Privacy Policy •
Cookie Policy •
Your Privacy Rights