Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Cortex Real Time Inference Engineering Lead

  • Cortex Real Time Inference Engineering Lead job type Posted on: Oct 30, 2026
  • Cortex Real Time Inference Engineering Lead experience level Conch Technologies Inc
  • Cortex Real Time Inference Engineering Lead employment type Concord, California
  • Cortex Real Time Inference Engineering Lead employment type Onsite
  • Cortex Real Time Inference Engineering Lead salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Cortex Real Time Inference Engineering Lead roles in California.

View Salary Guide →

Job Title :

Cortex Real Time Inference Engineering Lead

Job Type :

Full-Time

Job Location :

Concord California United States

Remote :

No

Jobcon Logo Job Description :

Hi
Title: Cortex Real-Time Inference Engineering Lead
Location: Concord, CA (Onsite)
Duration: 12 Months Contract

The Real-Time Inference Engineering Lead is responsible for designing, building, and operationalizing scalable, low-latency model serving platforms that power real-time AI and predictive decisioning use cases. This role leads the architecture, deployment, performance optimization, resiliency, and operational governance of online inference services across cloud and on-premises environments.

* Design and implement highly available, low-latency model serving architectures for real-time inference workloads.
* Develop and standardize deployment patterns for scalable AI/ML services across Kubernetes-based platforms.
* Lead API-based inference service design, integration, and lifecycle management.
* Optimize model serving performance through latency tuning, caching strategies, autoscaling, and resource management.
* Establish monitoring, observability, SLOs/SLAs, alerting, and operational runbooks for production services.
* Drive load testing, capacity planning, resiliency engineering, and disaster recovery readiness.
* Integrate inference platforms with CI/CD pipelines to enable automated deployments and controlled releases.
* Partner with Data Science, Platform Engineering, MLOps, and Infrastructure teams to ensure reliable production model operations.
* Govern operational best practices, security, reliability, and performance standards for enterprise AI deployments.

* Online inference and model-serving architectures
* Real-time APIs and distributed systems design
* Kubernetes, container orchestration, and service mesh technologies
* Autoscaling, capacity management, and workload optimization
* Performance engineering, load testing, and latency optimization
* Monitoring, observability, logging, tracing, and SLO management
* CI/CD, DevOps, and Infrastructure-as-Code practices
* Reliability engineering, fault tolerance, and resiliency patterns
* Cloud and on-premises platform operations
* Python, Java, Go, or similar backend development experience

* Experience with MLOps platforms and enterprise AI deployment frameworks.
* Hands-on experience with real-time recommendation, fraud, risk, personalization, or predictive analytics platforms.
* Familiarity with GPU-based inference, model optimization, and multi-cloud deployments.

A successful candidate combines AI platform engineering, distributed systems expertise, and operational excellence to deliver resilient, high-performance inference platforms that enable enterprise-scale real-time AI solutions.

With

Jobcon Logo Position Details

Posted:

Oct 30, 2026

Reference Number:

15276-25909

Employment:

Full-time

City:

Concord

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Cortex Real Time Inference Engineering Lead    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Hi
Title: Cortex Real-Time Inference Engineering Lead
Location: Concord, CA (Onsite)
Duration: 12 Months Contract

The Real-Time Inference Engineering Lead is responsible for designing, building, and operationalizing scalable, low-latency model serving platforms that power real-time AI and predictive decisioning use cases. This role leads the architecture, deployment, performance optimization, resiliency, and operational governance of online inference services across cloud and on-premises environments.

* Design and implement highly available, low-latency model serving architectures for real-time inference workloads.
* Develop and standardize deployment patterns for scalable AI/ML services across Kubernetes-based platforms.
* Lead API-based inference service design, integration, and lifecycle management.
* Optimize model serving performance through latency tuning, caching strategies, autoscaling, and resource management.
* Establish monitoring, observability, SLOs/SLAs, alerting, and operational runbooks for production services.
* Drive load testing, capacity planning, resiliency engineering, and disaster recovery readiness.
* Integrate inference platforms with CI/CD pipelines to enable automated deployments and controlled releases.
* Partner with Data Science, Platform Engineering, MLOps, and Infrastructure teams to ensure reliable production model operations.
* Govern operational best practices, security, reliability, and performance standards for enterprise AI deployments.

* Online inference and model-serving architectures
* Real-time APIs and distributed systems design
* Kubernetes, container orchestration, and service mesh technologies
* Autoscaling, capacity management, and workload optimization
* Performance engineering, load testing, and latency optimization
* Monitoring, observability, logging, tracing, and SLO management
* CI/CD, DevOps, and Infrastructure-as-Code practices
* Reliability engineering, fault tolerance, and resiliency patterns
* Cloud and on-premises platform operations
* Python, Java, Go, or similar backend development experience

* Experience with MLOps platforms and enterprise AI deployment frameworks.
* Hands-on experience with real-time recommendation, fraud, risk, personalization, or predictive analytics platforms.
* Familiarity with GPU-based inference, model optimization, and multi-cloud deployments.

A successful candidate combines AI platform engineering, distributed systems expertise, and operational excellence to deliver resilient, high-performance inference platforms that enable enterprise-scale real-time AI solutions.

With

Loading
Please wait..!!