Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Distinguished AI Engineer

  • Distinguished AI Engineer job type Posted on: Nov 19, 2026
  • Distinguished AI Engineer experience level SFE
  • Distinguished AI Engineer employment type Tempe, Arizona
  • Distinguished AI Engineer employment type Onsite
  • Distinguished AI Engineer salary CTC

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Distinguished AI Engineer roles in Arizona.

View Salary Guide →

Job Title :

Distinguished AI Engineer

Job Type :

Contract

Job Location :

Tempe Arizona United States

Remote :

No

Jobcon Logo Job Description :

Role : Distinguished AI Engineer
Location : NY / NJ, Tempe, AZ, Brea, CA, Tampa, FL (Onsite Role)
Duration : Long Term Contract

Interview Mode : Online Test + Video

Job Description & Role Purpose

Provide top-tier individual-contributor technical leadership for AIRP. The role solves complex AI platform engineering problems and drives reusable, secure, reliable, observable, and cost-efficient capabilities that enable teams to deliver enterprise AI and GenAI solutions at scale. The role leads through deep technical judgment, working engineering assets, and influence-not direct people management.

Primary ownership

  • Technical evolution and adoption of shared AIRP capabilities: AI gateways, model access and serving, RAG, agent/tool execution, orchestration, evaluation, observability, and LLMOps/MLOps.
  • Engineering outcomes for critical platform capabilities: reliability, performance, scalability, security, cost efficiency, operational readiness, and developer experience.
  • Reusable engineering "paved roads," including reference implementations, infrastructure templates, CI/CD patterns, evaluation harnesses, and operational tooling.
  • Technical leadership for complex, high-impact AI initiatives where deep design, prototype validation, performance analysis, or production troubleshooting is required.

Key responsibilities

  • Lead the design and engineering evolution of AIRP services for model access, routing, serving, RAG, agents, orchestration, evaluation, and observability.
  • Solve difficult engineering trade-offs across capability, latency, throughput, resiliency, security, data isolation, portability, and cost.
  • Lead critical technical spikes, prototypes, reference implementations, deep design reviews, and resolution of major platform or production issues.
  • Establish measurable engineering expectations for availability, recovery, performance, capacity, telemetry, release safety, evaluation coverage, and inference cost.
  • Build or sponsor reusable engineering assets: APIs, SDKs, Terraform/IaC modules, deployment patterns, CI/CD templates, dashboards, evaluation tooling, and developer guidance.
  • Drive production excellence through observability, traceability, controlled releases, rollback, incident learning, capacity planning, and cost optimization.
  • Engineer security and AI controls into platform capabilities, including identity and access controls, authorization-aware retrieval, secure tool execution, prompt-injection defenses, data protection, logging, and audit evidence.
  • Partner with cybersecurity, risk, compliance, legal, audit, architecture, product, and business teams to translate enterprise requirements into usable technical controls and delivery patterns.
  • Assess emerging AI technologies through practical technical evaluation and recommend adoption based on value, maturity, risk, operational fit, and total cost of ownership.
  • Mentor senior engineers and drive adoption of AIRP patterns across teams that do not report directly to the role.

Required candidate profile

  • 10+ years of progressive experience in software engineering, distributed systems, cloud/platform engineering, AI/ML infrastructure, or related technical domains, with substantial experience leading complex systems across multiple teams.
  • Demonstrated record of building, scaling, transforming, or rescuing production platforms or critical technical systems used by multiple engineering teams, products, or business domains.
  • Deep hands-on expertise in several of the following: LLM platforms, model serving, inference optimization, AI gateways, model routing, RAG, embeddings/vector search, agent frameworks, tool execution, AI orchestration, LLMOps/MLOps, evaluation systems, AI observability, or AI security controls.\
  • Strong engineering foundation in distributed systems, API/platform design, cloud-native architecture, containers/Kubernetes, networking, IAM, secrets management, high availability, disaster recovery, CI/CD, infrastructure as code, and production operations.
  • Proven ability to analyze and resolve hard trade-offs involving system design, quality, resiliency, latency, throughput, cost, security, usability, and time to market.
  • Evidence of producing reusable engineering assets-platform services, frameworks, templates, libraries, SDKs, developer tooling, reference implementations, or deployment patterns-that were adopted broadly.
  • Strong AWS experience or equivalent deep cloud-native expertise, including managed services, compute, storage, networking, IAM, security, observability, and cost-management considerations.
  • Strong understanding of Terraform or equivalent infrastructure-as-code practices; automated environment provisioning; Git-based engineering workflows; CI/CD; and policy-as-code concepts.
  • Demonstrated ability to influence senior engineers, architects, executives, product leaders, and risk/control stakeholders without relying on direct reporting authority.
  • Exceptional written and verbal communication skills, including the ability to explain implementation-level technical detail to engineers and decision-level trade-offs to executives and nontechnical stakeholders.

Preferred experience

  • Experience building enterprise AI platforms or shared AI developer platforms supporting multiple teams, products, business domains, or regulated use cases.
  • Experience in global banking, financial services, fintech, insurance, payments, capital markets, or another highly regulated enterprise environment.
  • Experience with private, hybrid, containerized, or controlled deployments of LLMs and AI workloads.
  • Experience optimizing AI infrastructure and inference economics, including model selection/routing, batching, caching, quantization, GPU utilization, capacity planning, and consumption-cost allocation.
  • Experience with AWS-first design and thoughtful portability strategies across hybrid, private, and multi-cloud environments.
  • Experience implementing AI-specific security protections, including prompt-injection defense, authorization-aware RAG, secure agent/tool execution, data-loss prevention, content controls, and AI-specific threat modeling.
  • Familiarity with Responsible AI, model risk management, audit evidence, technology risk controls, data privacy, and operational resilience requirements.
  • A record of technical publications, patents, open-source contributions, industry presentations, or recognized internal technical leadership is desirable but not required.

Success measures

  • Growing adoption of AIRP shared capabilities and reduced duplication of unsupported AI infrastructure.
  • Improved reliability, observability, release safety, evaluation coverage, performance, and cost efficiency for platform-enabled AI services.
  • Faster delivery through reusable approved patterns, automation, and a stronger developer experience.
  • Measurable technical uplift across teams through reusable assets, mentoring, and engineering standards.

Jobcon Logo Position Details

Posted:

Nov 19, 2026

Reference Number:

87391-7542

Employment:

CTC

City:

Tempe

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Distinguished AI Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Role : Distinguished AI Engineer
Location : NY / NJ, Tempe, AZ, Brea, CA, Tampa, FL (Onsite Role)
Duration : Long Term Contract

Interview Mode : Online Test + Video

Job Description & Role Purpose

Provide top-tier individual-contributor technical leadership for AIRP. The role solves complex AI platform engineering problems and drives reusable, secure, reliable, observable, and cost-efficient capabilities that enable teams to deliver enterprise AI and GenAI solutions at scale. The role leads through deep technical judgment, working engineering assets, and influence-not direct people management.

Primary ownership

  • Technical evolution and adoption of shared AIRP capabilities: AI gateways, model access and serving, RAG, agent/tool execution, orchestration, evaluation, observability, and LLMOps/MLOps.
  • Engineering outcomes for critical platform capabilities: reliability, performance, scalability, security, cost efficiency, operational readiness, and developer experience.
  • Reusable engineering "paved roads," including reference implementations, infrastructure templates, CI/CD patterns, evaluation harnesses, and operational tooling.
  • Technical leadership for complex, high-impact AI initiatives where deep design, prototype validation, performance analysis, or production troubleshooting is required.

Key responsibilities

  • Lead the design and engineering evolution of AIRP services for model access, routing, serving, RAG, agents, orchestration, evaluation, and observability.
  • Solve difficult engineering trade-offs across capability, latency, throughput, resiliency, security, data isolation, portability, and cost.
  • Lead critical technical spikes, prototypes, reference implementations, deep design reviews, and resolution of major platform or production issues.
  • Establish measurable engineering expectations for availability, recovery, performance, capacity, telemetry, release safety, evaluation coverage, and inference cost.
  • Build or sponsor reusable engineering assets: APIs, SDKs, Terraform/IaC modules, deployment patterns, CI/CD templates, dashboards, evaluation tooling, and developer guidance.
  • Drive production excellence through observability, traceability, controlled releases, rollback, incident learning, capacity planning, and cost optimization.
  • Engineer security and AI controls into platform capabilities, including identity and access controls, authorization-aware retrieval, secure tool execution, prompt-injection defenses, data protection, logging, and audit evidence.
  • Partner with cybersecurity, risk, compliance, legal, audit, architecture, product, and business teams to translate enterprise requirements into usable technical controls and delivery patterns.
  • Assess emerging AI technologies through practical technical evaluation and recommend adoption based on value, maturity, risk, operational fit, and total cost of ownership.
  • Mentor senior engineers and drive adoption of AIRP patterns across teams that do not report directly to the role.

Required candidate profile

  • 10+ years of progressive experience in software engineering, distributed systems, cloud/platform engineering, AI/ML infrastructure, or related technical domains, with substantial experience leading complex systems across multiple teams.
  • Demonstrated record of building, scaling, transforming, or rescuing production platforms or critical technical systems used by multiple engineering teams, products, or business domains.
  • Deep hands-on expertise in several of the following: LLM platforms, model serving, inference optimization, AI gateways, model routing, RAG, embeddings/vector search, agent frameworks, tool execution, AI orchestration, LLMOps/MLOps, evaluation systems, AI observability, or AI security controls.\
  • Strong engineering foundation in distributed systems, API/platform design, cloud-native architecture, containers/Kubernetes, networking, IAM, secrets management, high availability, disaster recovery, CI/CD, infrastructure as code, and production operations.
  • Proven ability to analyze and resolve hard trade-offs involving system design, quality, resiliency, latency, throughput, cost, security, usability, and time to market.
  • Evidence of producing reusable engineering assets-platform services, frameworks, templates, libraries, SDKs, developer tooling, reference implementations, or deployment patterns-that were adopted broadly.
  • Strong AWS experience or equivalent deep cloud-native expertise, including managed services, compute, storage, networking, IAM, security, observability, and cost-management considerations.
  • Strong understanding of Terraform or equivalent infrastructure-as-code practices; automated environment provisioning; Git-based engineering workflows; CI/CD; and policy-as-code concepts.
  • Demonstrated ability to influence senior engineers, architects, executives, product leaders, and risk/control stakeholders without relying on direct reporting authority.
  • Exceptional written and verbal communication skills, including the ability to explain implementation-level technical detail to engineers and decision-level trade-offs to executives and nontechnical stakeholders.

Preferred experience

  • Experience building enterprise AI platforms or shared AI developer platforms supporting multiple teams, products, business domains, or regulated use cases.
  • Experience in global banking, financial services, fintech, insurance, payments, capital markets, or another highly regulated enterprise environment.
  • Experience with private, hybrid, containerized, or controlled deployments of LLMs and AI workloads.
  • Experience optimizing AI infrastructure and inference economics, including model selection/routing, batching, caching, quantization, GPU utilization, capacity planning, and consumption-cost allocation.
  • Experience with AWS-first design and thoughtful portability strategies across hybrid, private, and multi-cloud environments.
  • Experience implementing AI-specific security protections, including prompt-injection defense, authorization-aware RAG, secure agent/tool execution, data-loss prevention, content controls, and AI-specific threat modeling.
  • Familiarity with Responsible AI, model risk management, audit evidence, technology risk controls, data privacy, and operational resilience requirements.
  • A record of technical publications, patents, open-source contributions, industry presentations, or recognized internal technical leadership is desirable but not required.

Success measures

  • Growing adoption of AIRP shared capabilities and reduced duplication of unsupported AI infrastructure.
  • Improved reliability, observability, release safety, evaluation coverage, performance, and cost efficiency for platform-enabled AI services.
  • Faster delivery through reusable approved patterns, automation, and a stronger developer experience.
  • Measurable technical uplift across teams through reusable assets, mentoring, and engineering standards.

Loading
Please wait..!!