Skip to main content
Loading
loadingbar
Loading, Please wait..!!

AI/ML & RAG Platform Developer

  • AI/ML & RAG Platform Developer job type Posted on: Nov 20, 2026
  • AI/ML & RAG Platform Developer experience level Stellar Professionals
  • AI/ML & RAG Platform Developer employment type Raleigh, North Carolina
  • AI/ML & RAG Platform Developer salary Salary: $80 per hour
  • AI/ML & RAG Platform Developer employment type Onsite
  • AI/ML & RAG Platform Developer salary CTC

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for AI/ML & RAG Platform Developer roles in North Carolina.

View Salary Guide →

Job Title :

AI/ML & RAG Platform Developer

Job Type :

Contract

Job Location :

Raleigh North Carolina United States

Remote :

No

Jobcon Logo Job Description :

Position Title: Senior Generative AI & LLM Engineer

Location: Raleigh, NC

Work Arrangement: Hybrid (2 days onsite per week required-non-negotiable)

Interview Process: Both Phone and In-Person Interviews (Candidate must be able to attend an in-person interview)

Role Summary

Seeking a Senior Generative AI Developer to design, build, and deploy production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and secure enterprise data systems. Collaborating across engineering, data, security, and governance teams, this role builds scalable AI microservices while enforcing strict privacy, compliance, and Responsible AI standards.

Key Responsibilities
  • LLM & Agent Development: Build and deploy production LLM-driven features, prompts, and agentic workflows, customizing models through fine-tuning and adapter techniques.

  • RAG Pipelines & Data Integration: Develop RAG pipelines backed by vector, relational (SQL), and NoSQL databases, managing secure enterprise content ingestion with metadata tagging and PII protection.

  • Microservices & MLOps: Build secure, scalable microservices to integrate AI capabilities into enterprise applications, maintaining CI/CD pipelines and monitoring system performance, cost, and model drift.

  • AI Security & Responsible AI: Implement AI safety controls, encryption, RBAC, and API security while conducting bias, fairness, hallucination, and privacy reviews to support audit readiness.

Required Skills & Qualifications
  • Generative AI & Python Frameworks: 3+ years of hands-on experience in applied machine learning or Generative AI development, including 3+ years of Python development with LLM frameworks (LangChain, Semantic Kernel, or LangGraph) and 3+ years on a major cloud platform (Azure, AWS, or GCP).

  • RAG & Vector Databases: 2+ years of experience building RAG pipelines or LLM-driven applications, alongside 2+ years working with vector databases (Pinecone, Weaviate, Milvus, or FAISS) and retrieval optimization.

  • Microservices & Databases: 5+ years of experience building/integrating microservices (FastAPI, Node.js, or Azure Functions), 5+ years of SQL experience (data modeling, transformations, performance tuning), and 2+ years with NoSQL/document databases (MongoDB, Cosmos DB, or DynamoDB).

  • AI Security & Responsible AI: 2+ years implementing AI security controls (encryption, RBAC, API security, secret management) and 2+ years applying Responsible AI practices (bias testing, hallucination mitigation, privacy safeguards).

  • Agile & Execution: 3+ years of experience in Agile environments (Scrum, Kanban, or SAFe) with strong organizational skills for following complex technical procedures.

Preferred Qualifications
  • 2+ years of experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace, as well as automated evaluation tools (Promptflow, Ragas).

  • 2+ years of experience designing supervised fine-tuning workflows or LoRA-based training pipelines.

  • 2+ years of familiarity with enterprise governance platforms (such as Microsoft Purview) and relevant AI/Cloud certifications (Azure AI-102, AWS ML Specialty, GCP ML Engineer, SC-100, or Responsible AI coursework)

Jobcon Logo Position Details

Posted:

Nov 20, 2026

Reference Number:

12570-13875

Employment:

CTC

Salary:

$80 per hour

City:

Raleigh

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

AI/ML & RAG Platform Developer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Position Title: Senior Generative AI & LLM Engineer

Location: Raleigh, NC

Work Arrangement: Hybrid (2 days onsite per week required-non-negotiable)

Interview Process: Both Phone and In-Person Interviews (Candidate must be able to attend an in-person interview)

Role Summary

Seeking a Senior Generative AI Developer to design, build, and deploy production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and secure enterprise data systems. Collaborating across engineering, data, security, and governance teams, this role builds scalable AI microservices while enforcing strict privacy, compliance, and Responsible AI standards.

Key Responsibilities
  • LLM & Agent Development: Build and deploy production LLM-driven features, prompts, and agentic workflows, customizing models through fine-tuning and adapter techniques.

  • RAG Pipelines & Data Integration: Develop RAG pipelines backed by vector, relational (SQL), and NoSQL databases, managing secure enterprise content ingestion with metadata tagging and PII protection.

  • Microservices & MLOps: Build secure, scalable microservices to integrate AI capabilities into enterprise applications, maintaining CI/CD pipelines and monitoring system performance, cost, and model drift.

  • AI Security & Responsible AI: Implement AI safety controls, encryption, RBAC, and API security while conducting bias, fairness, hallucination, and privacy reviews to support audit readiness.

Required Skills & Qualifications
  • Generative AI & Python Frameworks: 3+ years of hands-on experience in applied machine learning or Generative AI development, including 3+ years of Python development with LLM frameworks (LangChain, Semantic Kernel, or LangGraph) and 3+ years on a major cloud platform (Azure, AWS, or GCP).

  • RAG & Vector Databases: 2+ years of experience building RAG pipelines or LLM-driven applications, alongside 2+ years working with vector databases (Pinecone, Weaviate, Milvus, or FAISS) and retrieval optimization.

  • Microservices & Databases: 5+ years of experience building/integrating microservices (FastAPI, Node.js, or Azure Functions), 5+ years of SQL experience (data modeling, transformations, performance tuning), and 2+ years with NoSQL/document databases (MongoDB, Cosmos DB, or DynamoDB).

  • AI Security & Responsible AI: 2+ years implementing AI security controls (encryption, RBAC, API security, secret management) and 2+ years applying Responsible AI practices (bias testing, hallucination mitigation, privacy safeguards).

  • Agile & Execution: 3+ years of experience in Agile environments (Scrum, Kanban, or SAFe) with strong organizational skills for following complex technical procedures.

Preferred Qualifications
  • 2+ years of experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace, as well as automated evaluation tools (Promptflow, Ragas).

  • 2+ years of experience designing supervised fine-tuning workflows or LoRA-based training pipelines.

  • 2+ years of familiarity with enterprise governance platforms (such as Microsoft Purview) and relevant AI/Cloud certifications (Azure AI-102, AWS ML Specialty, GCP ML Engineer, SC-100, or Responsible AI coursework)

Loading
Please wait..!!