Skip to main content
Loading
loadingbar
Loading, Please wait..!!

NCDHHS - Senior Generative AI Developer

  • NCDHHS - Senior Generative AI Developer job type Posted on: Nov 20, 2026
  • NCDHHS - Senior Generative AI Developer experience level Expert Technology Services
  • NCDHHS - Senior Generative AI Developer employment type Raleigh, North Carolina
  • NCDHHS - Senior Generative AI Developer employment type Onsite
  • NCDHHS - Senior Generative AI Developer salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for NCDHHS - Senior Generative AI Developer roles in North Carolina.

View Salary Guide →

Job Title :

NCDHHS - Senior Generative AI Developer

Job Type :

Full-Time

Job Location :

Raleigh North Carolina United States

Remote :

No

Jobcon Logo Job Description :

NC DHHS requires the services of a Senior Generative AI Developer responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging LLMs, RAG, fine-tuning techniques, and secure enterprise data systems.

NC DHHS requires the services of a Senior Generative AI Developer who is responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems. The role requires strong technical skills in Python, cloud-native development, data engineering, and the integration of structured and unstructured databases into AI systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles. This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization. The key responsibilities for this position will include the following:

Build and deploy LLM-driven features, prompts, and agent workflows.

Customize models using fine-tuning and adapter techniques.

Develop RAG pipelines using vector, SQL, and NoSQL databases.

Manage secure ingestion of enterprise content with proper metadata and PII protection.

Use relational, NoSQL, and vector databases to support AI workloads.

Apply performance tuning, access control, encryption, and compliant data handling.

Implement AI safety controls and secure model access.

Ensure Responsible AI practices include bias, fairness, and privacy reviews.

Build secure, scalable microservices to integrate AI features into applications.

Implement best practices for reliability, error handling, and observability.

Maintain CI/CD pipelines for models and AI services.

Monitor performance, cost, and drift.

Support documentation and audit readiness. Required/Desired Skills
Skill Required /Desired Amount of Experience
Hands-on experience in applied machine learning or Generative AI development. Required 3 Years
Experience working with a major cloud platform (Azure, AWS, or GCP). Required 3 Years
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph). Required 3 Years
Experience building RAG pipelines or LLM-driven applications. Required 2 Years
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization. Required 2 Years
SQL experience including data modeling, transformations, and performance tuning Required 5 Years
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB). Required 2 Years
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management. Required 2 Years
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards. Required 2 Years
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions. Required 5 Years
Experience with Agile (Scrum, Kanban, or SAFe) development. Required 3 Years
Ability to organize, prioritize, and follow complex and/or detailed technical procedures. Required 3 Years
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace. Desired 2 Years
Familiarity with Promptflow, Ragas, or similar automated evaluation tools. Desired 2 Years
Experience designing supervised finetuning workflows or LoRA-based training pipelines. Desired 2 Years
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms. Desired 2 Years
Certifications such as Azure AI-102, AWS ML Specialty, GCP ML Engineer, SC-100, or Responsible AI coursework. Desired 2 Years

Jobcon Logo Position Details

Posted:

Nov 20, 2026

Reference Number:

16119-37283

Employment:

Full-time

City:

Raleigh

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

NCDHHS - Senior Generative AI Developer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

NC DHHS requires the services of a Senior Generative AI Developer responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging LLMs, RAG, fine-tuning techniques, and secure enterprise data systems.

NC DHHS requires the services of a Senior Generative AI Developer who is responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems. The role requires strong technical skills in Python, cloud-native development, data engineering, and the integration of structured and unstructured databases into AI systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles. This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization. The key responsibilities for this position will include the following:

Build and deploy LLM-driven features, prompts, and agent workflows.

Customize models using fine-tuning and adapter techniques.

Develop RAG pipelines using vector, SQL, and NoSQL databases.

Manage secure ingestion of enterprise content with proper metadata and PII protection.

Use relational, NoSQL, and vector databases to support AI workloads.

Apply performance tuning, access control, encryption, and compliant data handling.

Implement AI safety controls and secure model access.

Ensure Responsible AI practices include bias, fairness, and privacy reviews.

Build secure, scalable microservices to integrate AI features into applications.

Implement best practices for reliability, error handling, and observability.

Maintain CI/CD pipelines for models and AI services.

Monitor performance, cost, and drift.

Support documentation and audit readiness. Required/Desired Skills
Skill Required /Desired Amount of Experience
Hands-on experience in applied machine learning or Generative AI development. Required 3 Years
Experience working with a major cloud platform (Azure, AWS, or GCP). Required 3 Years
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph). Required 3 Years
Experience building RAG pipelines or LLM-driven applications. Required 2 Years
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization. Required 2 Years
SQL experience including data modeling, transformations, and performance tuning Required 5 Years
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB). Required 2 Years
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management. Required 2 Years
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards. Required 2 Years
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions. Required 5 Years
Experience with Agile (Scrum, Kanban, or SAFe) development. Required 3 Years
Ability to organize, prioritize, and follow complex and/or detailed technical procedures. Required 3 Years
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace. Desired 2 Years
Familiarity with Promptflow, Ragas, or similar automated evaluation tools. Desired 2 Years
Experience designing supervised finetuning workflows or LoRA-based training pipelines. Desired 2 Years
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms. Desired 2 Years
Certifications such as Azure AI-102, AWS ML Specialty, GCP ML Engineer, SC-100, or Responsible AI coursework. Desired 2 Years

Loading
Please wait..!!