Skip to main content
Loading
loadingbar
Loading, Please wait..!!

AI Platform Engineer

  • AI Platform Engineer job type Posted on: Nov 20, 2026
  • AI Platform Engineer experience level Donato Technologies, Inc
  • AI Platform Engineer employment type , Texas
  • AI Platform Engineer salary Salary: $56 per hour
  • AI Platform Engineer employment type Remote
  • AI Platform Engineer salary CTC

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for AI Platform Engineer roles in Texas.

View Salary Guide →

Job Title :

AI Platform Engineer

Job Type :

Contract

Job Location :

Texas United States

Remote :

Yes

Jobcon Logo Job Description :

CVS 100% REMOTE
USC or GC only

Job Description
AI Platform Engineer

Role summary
Build and operate a production agentic AI platform: orchestration, model gateway, agent registry,
retrieval, guardrails, evaluation and observability. You build the layer other engineers build on, and you
own its reliability, security and cost.
Core technical skills
LLM and agent orchestration: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or the Google
Agent Development Kit (ADK), with production multi-agent orchestration, state management and
retry/fallback design.
Model serving and gateway: LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model
Garden; routing, fallback, rate limiting and token/usage capture. Serving open-weight models (Llama,
Mistral, Gemma, Qwen) via vLLM, TGI, Ollama or Vertex endpoints; fine-tuning and adapter
techniques (LoRA/QLoRA).
Retrieval-augmented generation: vector stores (Vertex Vector Search, Pinecone, Weaviate, pgvector,
Elasticsearch), embedding models, chunking, hybrid and semantic search, reranking, and grounding-
quality evaluation.
Agent infrastructure: Model Context Protocol (MCP) and tool/function-calling contracts, agent
registries, permission enforcement, and the separation of reasoning from acting agents.
Evaluation and LLMOps: eval harness design with RAGAS, DeepEval, Promptfoo, or OpenAI Evals;
offline and online evaluation, regression suites, drift and hallucination detection; experiment tracking
with MLflow, LangSmith, Langfuse, Arize Phoenix or Braintrust.
Guardrails and AI security: NeMo Guardrails, Guardrails AI, Model Armor, Lakera; prompt-injection,
jailbreak and data-leakage defense; PII detection and redaction in prompt and response.
Observability: OpenTelemetry-based tracing for LLM and agent calls, token and latency and cost
telemetry, quality-signal monitoring feeding alerting.
Cloud and runtime: Kubernetes and containers, GCP preferred (GKE, Vertex AI, Cloud Run),
infrastructure-as-code (Terraform), CI/CD, and SRE practice for production AI services.
Languages: strong Python; Go or Java useful for platform services.

Experience
Typically 8+ years in software or platform engineering, with hands-on production ownership of AI or ML
infrastructure. Has personally built and operated agentic or LLM systems in production, not only
prototyped them.

Donato Technologies Inc. is a trusted IT staffing, consulting, and software development partner headquartered in Dallas, Texas. We support clients across industries by understanding their unique business needs and delivering tailored technology and workforce solutions. Our focus is on connecting the right talent with the right opportunity-ensuring clients receive dependable, skilled professionals and candidates receive meaningful career growth and support. We work closely with small to mid-sized organizations to provide flexible, high-quality services that drive performance, innovation, and long-term success.

Jobcon Logo Position Details

Posted:

Nov 20, 2026

Reference Number:

4828-13517

Employment:

CTC

Salary:

$56 per hour

City:

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

AI Platform Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

CVS 100% REMOTE
USC or GC only

Job Description
AI Platform Engineer

Role summary
Build and operate a production agentic AI platform: orchestration, model gateway, agent registry,
retrieval, guardrails, evaluation and observability. You build the layer other engineers build on, and you
own its reliability, security and cost.
Core technical skills
LLM and agent orchestration: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or the Google
Agent Development Kit (ADK), with production multi-agent orchestration, state management and
retry/fallback design.
Model serving and gateway: LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model
Garden; routing, fallback, rate limiting and token/usage capture. Serving open-weight models (Llama,
Mistral, Gemma, Qwen) via vLLM, TGI, Ollama or Vertex endpoints; fine-tuning and adapter
techniques (LoRA/QLoRA).
Retrieval-augmented generation: vector stores (Vertex Vector Search, Pinecone, Weaviate, pgvector,
Elasticsearch), embedding models, chunking, hybrid and semantic search, reranking, and grounding-
quality evaluation.
Agent infrastructure: Model Context Protocol (MCP) and tool/function-calling contracts, agent
registries, permission enforcement, and the separation of reasoning from acting agents.
Evaluation and LLMOps: eval harness design with RAGAS, DeepEval, Promptfoo, or OpenAI Evals;
offline and online evaluation, regression suites, drift and hallucination detection; experiment tracking
with MLflow, LangSmith, Langfuse, Arize Phoenix or Braintrust.
Guardrails and AI security: NeMo Guardrails, Guardrails AI, Model Armor, Lakera; prompt-injection,
jailbreak and data-leakage defense; PII detection and redaction in prompt and response.
Observability: OpenTelemetry-based tracing for LLM and agent calls, token and latency and cost
telemetry, quality-signal monitoring feeding alerting.
Cloud and runtime: Kubernetes and containers, GCP preferred (GKE, Vertex AI, Cloud Run),
infrastructure-as-code (Terraform), CI/CD, and SRE practice for production AI services.
Languages: strong Python; Go or Java useful for platform services.

Experience
Typically 8+ years in software or platform engineering, with hands-on production ownership of AI or ML
infrastructure. Has personally built and operated agentic or LLM systems in production, not only
prototyped them.

Donato Technologies Inc. is a trusted IT staffing, consulting, and software development partner headquartered in Dallas, Texas. We support clients across industries by understanding their unique business needs and delivering tailored technology and workforce solutions. Our focus is on connecting the right talent with the right opportunity-ensuring clients receive dependable, skilled professionals and candidates receive meaningful career growth and support. We work closely with small to mid-sized organizations to provide flexible, high-quality services that drive performance, innovation, and long-term success.

Loading
Please wait..!!