Loading, Please wait..!!
Distinguished AI Engineer
-
Posted on: Nov 19, 2026
-
Tempe, Arizona
-
Onsite
-
CTC
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Distinguished AI Engineer roles in Arizona.
View Salary Guide →Find your match !
Job Title :
Distinguished AI Engineer
Job Type :
Contract
Job Location :
Tempe Arizona United States
Remote :
No
Job Description :
Role : Distinguished AI Engineer
Location : NY / NJ, Tempe, AZ, Brea, CA, Tampa, FL (Onsite Role)
Duration : Long Term Contract
Interview Mode : Online Test + Video
Job Description & Role Purpose
Provide top-tier individual-contributor technical leadership for AIRP. The role solves complex AI platform engineering problems and drives reusable, secure, reliable, observable, and cost-efficient capabilities that enable teams to deliver enterprise AI and GenAI solutions at scale. The role leads through deep technical judgment, working engineering assets, and influence-not direct people management.
Primary ownership
- Technical evolution and adoption of shared AIRP capabilities: AI gateways, model access and serving, RAG, agent/tool execution, orchestration, evaluation, observability, and LLMOps/MLOps.
- Engineering outcomes for critical platform capabilities: reliability, performance, scalability, security, cost efficiency, operational readiness, and developer experience.
- Reusable engineering "paved roads," including reference implementations, infrastructure templates, CI/CD patterns, evaluation harnesses, and operational tooling.
- Technical leadership for complex, high-impact AI initiatives where deep design, prototype validation, performance analysis, or production troubleshooting is required.
Key responsibilities
- Lead the design and engineering evolution of AIRP services for model access, routing, serving, RAG, agents, orchestration, evaluation, and observability.
- Solve difficult engineering trade-offs across capability, latency, throughput, resiliency, security, data isolation, portability, and cost.
- Lead critical technical spikes, prototypes, reference implementations, deep design reviews, and resolution of major platform or production issues.
- Establish measurable engineering expectations for availability, recovery, performance, capacity, telemetry, release safety, evaluation coverage, and inference cost.
- Build or sponsor reusable engineering assets: APIs, SDKs, Terraform/IaC modules, deployment patterns, CI/CD templates, dashboards, evaluation tooling, and developer guidance.
- Drive production excellence through observability, traceability, controlled releases, rollback, incident learning, capacity planning, and cost optimization.
- Engineer security and AI controls into platform capabilities, including identity and access controls, authorization-aware retrieval, secure tool execution, prompt-injection defenses, data protection, logging, and audit evidence.
- Partner with cybersecurity, risk, compliance, legal, audit, architecture, product, and business teams to translate enterprise requirements into usable technical controls and delivery patterns.
- Assess emerging AI technologies through practical technical evaluation and recommend adoption based on value, maturity, risk, operational fit, and total cost of ownership.
- Mentor senior engineers and drive adoption of AIRP patterns across teams that do not report directly to the role.
Required candidate profile
- 10+ years of progressive experience in software engineering, distributed systems, cloud/platform engineering, AI/ML infrastructure, or related technical domains, with substantial experience leading complex systems across multiple teams.
- Demonstrated record of building, scaling, transforming, or rescuing production platforms or critical technical systems used by multiple engineering teams, products, or business domains.
- Deep hands-on expertise in several of the following: LLM platforms, model serving, inference optimization, AI gateways, model routing, RAG, embeddings/vector search, agent frameworks, tool execution, AI orchestration, LLMOps/MLOps, evaluation systems, AI observability, or AI security controls.\
- Strong engineering foundation in distributed systems, API/platform design, cloud-native architecture, containers/Kubernetes, networking, IAM, secrets management, high availability, disaster recovery, CI/CD, infrastructure as code, and production operations.
- Proven ability to analyze and resolve hard trade-offs involving system design, quality, resiliency, latency, throughput, cost, security, usability, and time to market.
- Evidence of producing reusable engineering assets-platform services, frameworks, templates, libraries, SDKs, developer tooling, reference implementations, or deployment patterns-that were adopted broadly.
- Strong AWS experience or equivalent deep cloud-native expertise, including managed services, compute, storage, networking, IAM, security, observability, and cost-management considerations.
- Strong understanding of Terraform or equivalent infrastructure-as-code practices; automated environment provisioning; Git-based engineering workflows; CI/CD; and policy-as-code concepts.
- Demonstrated ability to influence senior engineers, architects, executives, product leaders, and risk/control stakeholders without relying on direct reporting authority.
- Exceptional written and verbal communication skills, including the ability to explain implementation-level technical detail to engineers and decision-level trade-offs to executives and nontechnical stakeholders.
Preferred experience
- Experience building enterprise AI platforms or shared AI developer platforms supporting multiple teams, products, business domains, or regulated use cases.
- Experience in global banking, financial services, fintech, insurance, payments, capital markets, or another highly regulated enterprise environment.
- Experience with private, hybrid, containerized, or controlled deployments of LLMs and AI workloads.
- Experience optimizing AI infrastructure and inference economics, including model selection/routing, batching, caching, quantization, GPU utilization, capacity planning, and consumption-cost allocation.
- Experience with AWS-first design and thoughtful portability strategies across hybrid, private, and multi-cloud environments.
- Experience implementing AI-specific security protections, including prompt-injection defense, authorization-aware RAG, secure agent/tool execution, data-loss prevention, content controls, and AI-specific threat modeling.
- Familiarity with Responsible AI, model risk management, audit evidence, technology risk controls, data privacy, and operational resilience requirements.
- A record of technical publications, patents, open-source contributions, industry presentations, or recognized internal technical leadership is desirable but not required.
Success measures
- Growing adoption of AIRP shared capabilities and reduced duplication of unsupported AI infrastructure.
- Improved reliability, observability, release safety, evaluation coverage, performance, and cost efficiency for platform-enabled AI services.
- Faster delivery through reusable approved patterns, automation, and a stronger developer experience.
- Measurable technical uplift across teams through reusable assets, mentoring, and engineering standards.
Position Details
Posted:
Nov 19, 2026
Reference Number:
87391-7542
Employment:
CTC
City:
Tempe
Job Origin:
CIEPAL_ORGANIC_FEED
Share this job:
Please wait..!!

