Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Sr. AI Engineer - NYC NY

  • Sr. AI Engineer - NYC NY job type Posted on: Nov 17, 2026
  • Sr. AI Engineer - NYC NY experience level SharpAtoms
  • Sr. AI Engineer - NYC NY employment type Mundelein, Illinois
  • Sr. AI Engineer - NYC NY employment type Onsite
  • Sr. AI Engineer - NYC NY salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Sr. AI Engineer - NYC NY roles in Illinois.

View Salary Guide →

Job Title :

Sr. AI Engineer - NYC NY

Job Type :

Full-Time

Job Location :

Mundelein Illinois United States

Remote :

No

Jobcon Logo Job Description :

Job Description

W2 Role | Healthcare experience is preferred.

\n


\n

Sr. AI Engineer

\n

NYC, NY (Full Onsite)

\n


\n

AI Engineer with strong hands-on experience in prompt engineering, LLM response optimization, and AI application development. The ideal candidate can design prompts, improve model output quality, help LLMs understand user input, and build reliable, context-aware AI solutions.

\n

Key Responsibilities:

\n
    \n
  • Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
  • \n
  • Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
  • \n
  • Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
  • \n
  • Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
  • \n
  • Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
  • \n
  • Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
  • \n
  • Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
  • \n
  • Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
  • \n
  • Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
  • \n
  • Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.
  • \n
\n

Required Skills:

\n
    \n
  • Hands-on experience with LLMs such as GPT, Claude, Gemini, Llama, or similar models.
  • \n
  • Strong prompt engineering skills, including prompt templates, system prompts, few-shot prompting, and response tuning.
  • \n
  • Develop AI-powered applications using LLM APIs, RAG workflows, enterprise data sources, and backend services.
  • \n
  • Experience with LLM APIs and application integration using Python, Java, JavaScript, or similar programming languages.
  • \n
  • Knowledge of RAG, embeddings, vector databases, semantic search, and knowledge retrieval workflows.
  • \n
  • Ability to evaluate and improve AI responses for accuracy, relevance, completeness, tone, and instruction following.
  • \n
  • Understanding of NLP concepts, hallucination mitigation, prompt injection risks, guardrails, and responsible AI practices.
  • \n
  • Knowledge of healthcare data privacy and secure sensitive-data handling, including HIPAA-aligned PHI/PII practices, data minimization, de-identification, masking, access controls, auditability, and responsible use of healthcare data in AI workflows.
  • \n
  • Experience with MCP servers, cloud platforms, APIs, backend services, and production deployment is preferred.
  • \n
  • Experience integrating AI agents with healthcare, health records, or regulated industry systems.
  • \n
\n


Jobcon Logo Position Details

Posted:

Nov 17, 2026

Reference Number:

4d8cc0e05e4a2367

Employment:

Full-time

City:

Mundelein

Job Origin:

ziprecruiter

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Sr. AI Engineer - NYC NY    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Job Description

W2 Role | Healthcare experience is preferred.

\n


\n

Sr. AI Engineer

\n

NYC, NY (Full Onsite)

\n


\n

AI Engineer with strong hands-on experience in prompt engineering, LLM response optimization, and AI application development. The ideal candidate can design prompts, improve model output quality, help LLMs understand user input, and build reliable, context-aware AI solutions.

\n

Key Responsibilities:

\n
    \n
  • Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
  • \n
  • Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
  • \n
  • Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
  • \n
  • Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
  • \n
  • Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
  • \n
  • Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
  • \n
  • Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
  • \n
  • Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
  • \n
  • Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
  • \n
  • Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.
  • \n
\n

Required Skills:

\n
    \n
  • Hands-on experience with LLMs such as GPT, Claude, Gemini, Llama, or similar models.
  • \n
  • Strong prompt engineering skills, including prompt templates, system prompts, few-shot prompting, and response tuning.
  • \n
  • Develop AI-powered applications using LLM APIs, RAG workflows, enterprise data sources, and backend services.
  • \n
  • Experience with LLM APIs and application integration using Python, Java, JavaScript, or similar programming languages.
  • \n
  • Knowledge of RAG, embeddings, vector databases, semantic search, and knowledge retrieval workflows.
  • \n
  • Ability to evaluate and improve AI responses for accuracy, relevance, completeness, tone, and instruction following.
  • \n
  • Understanding of NLP concepts, hallucination mitigation, prompt injection risks, guardrails, and responsible AI practices.
  • \n
  • Knowledge of healthcare data privacy and secure sensitive-data handling, including HIPAA-aligned PHI/PII practices, data minimization, de-identification, masking, access controls, auditability, and responsible use of healthcare data in AI workflows.
  • \n
  • Experience with MCP servers, cloud platforms, APIs, backend services, and production deployment is preferred.
  • \n
  • Experience integrating AI agents with healthcare, health records, or regulated industry systems.
  • \n
\n


Loading
Please wait..!!