Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Senior Machine Learning Engineer (Inference)

  • Senior Machine Learning Engineer (Inference) job type Posted on: Nov 05, 2026
  • Senior Machine Learning Engineer (Inference) experience level Fintal Partners
  • Senior Machine Learning Engineer (Inference) employment type New York, New York
  • Senior Machine Learning Engineer (Inference) employment type Onsite
  • Senior Machine Learning Engineer (Inference) salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Senior Machine Learning Engineer (Inference) roles in New York.

View Salary Guide →

Job Title :

Senior Machine Learning Engineer (Inference)

Job Type :

Full-Time

Job Location :

New York New York United States

Remote :

No

Jobcon Logo Job Description :

We are a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. For decades, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back.From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed. As a Machine Learning Engineer, you will play a pivotal role in building systems that drive the training and deployment of large-scale ML models across our global operations. You'll collaborate with leading researchers, hardware experts, and software engineers to build robust solutions that maximize the potential of GPU acceleration, distributed computing, and the latest open-source tools. Your work will influence our trading strategies by accelerating experimentation cycles that foster continuous innovation and refinement.This is a unique opportunity to solve problems at the intersection of advanced machine learning and trading . where your contributions will shape the future of our technology and trading capabilities.Your Core Responsibilities:Develop large-scale distributed training pipelines to manage datasets and complex modelsBuild and optimize low-latency inference pipelines, ensuring models deliver real-time predictions in production systemsDevelop libraries to improve the performance of machine learning frameworksMaximize performance in training and inference using GPU hardware and acceleration librariesDesign scalable model frameworks capable of handling high-volume trading data and delivering realtime, high-accuracy predictionsCollaborate with quantitative researchers to automate ML experiments, hyperparameter tuning, and model retrainingPartner with HPC specialists to optimize workflows, improve training speed, and reduce costsEvaluate and roll out third-party tools to enhance model development, training, and inferencecapabilitiesDig into the internals of open-source ML tools to extend their capabilities and improve performanceYour Skills and Experience:5+ years of experience in machine learning with a focus on training or inference systemsHands-on experience with real-time, low-latency ML pipelines in high-performanceenvironments is a strong plusStrong engineering skills, including Python, CUDA, or C++Knowledge of machine learning frameworks such as PyTorch, TensorFlow, or JAXProficiency in GPU programming for training and inference acceleration (e.g., CuDNN, TensorRT)Experience with distributed training for scaling ML workloads (e.g., Horovod, NCCL)Exposure to cloud platforms and orchestration toolsA track record of contributing to open-source projects in machine learning, data science, ordistributed systems is a plus

Jobcon Logo Position Details

Posted:

Nov 05, 2026

Reference Number:

10440_4486550288

Employment:

Full-time

City:

New York

Job Origin:

APPCAST_CPC

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Senior Machine Learning Engineer (Inference)    Apply

Click on the below icons to share this job to Linkedin, Twitter!

We are a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. For decades, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back.From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed. As a Machine Learning Engineer, you will play a pivotal role in building systems that drive the training and deployment of large-scale ML models across our global operations. You'll collaborate with leading researchers, hardware experts, and software engineers to build robust solutions that maximize the potential of GPU acceleration, distributed computing, and the latest open-source tools. Your work will influence our trading strategies by accelerating experimentation cycles that foster continuous innovation and refinement.This is a unique opportunity to solve problems at the intersection of advanced machine learning and trading . where your contributions will shape the future of our technology and trading capabilities.Your Core Responsibilities:Develop large-scale distributed training pipelines to manage datasets and complex modelsBuild and optimize low-latency inference pipelines, ensuring models deliver real-time predictions in production systemsDevelop libraries to improve the performance of machine learning frameworksMaximize performance in training and inference using GPU hardware and acceleration librariesDesign scalable model frameworks capable of handling high-volume trading data and delivering realtime, high-accuracy predictionsCollaborate with quantitative researchers to automate ML experiments, hyperparameter tuning, and model retrainingPartner with HPC specialists to optimize workflows, improve training speed, and reduce costsEvaluate and roll out third-party tools to enhance model development, training, and inferencecapabilitiesDig into the internals of open-source ML tools to extend their capabilities and improve performanceYour Skills and Experience:5+ years of experience in machine learning with a focus on training or inference systemsHands-on experience with real-time, low-latency ML pipelines in high-performanceenvironments is a strong plusStrong engineering skills, including Python, CUDA, or C++Knowledge of machine learning frameworks such as PyTorch, TensorFlow, or JAXProficiency in GPU programming for training and inference acceleration (e.g., CuDNN, TensorRT)Experience with distributed training for scaling ML workloads (e.g., Horovod, NCCL)Exposure to cloud platforms and orchestration toolsA track record of contributing to open-source projects in machine learning, data science, ordistributed systems is a plus

Loading
Please wait..!!