Skip to main content
Loading
loadingbar
Loading, Please wait..!!

Senior Backend AI Engineer

  • Senior Backend AI Engineer job type Posted on: Nov 18, 2026
  • Senior Backend AI Engineer experience level Northern Base
  • Senior Backend AI Engineer employment type New York City, New York
  • Senior Backend AI Engineer salary Salary: $120,000 per year
  • Senior Backend AI Engineer employment type Onsite
  • Senior Backend AI Engineer salary Full-time

Point Apply Here APPLY LATER

Curious about compensation?

Explore the historical salary trends, average pay, and estimated compensation for Senior Backend AI Engineer roles in New York.

View Salary Guide →

Job Title :

Senior Backend AI Engineer

Job Type :

Full-Time

Job Location :

New York City New York United States

Remote :

No

Jobcon Logo Job Description :

Role: Senior Backend AI Engineer

Location: New York, NY / Phoenix, AZ

Experience: 7 14 Years

Job Summary:

We are looking for a talented and experienced Senior Backend Engineer to join our growing team. The Senior Backend Engineer will be responsible for designing, developing, and maintaining scalable and efficient backend systems that power our applications.

The ideal candidate will have a strong background in backend development, a solid understanding of distributed systems, LLM systems, agentic workflows, and experience with cloud technologies.

Core Engineering Stack:
  • Languages: Node.js, TypeScript, Go

  • APIs and Services: REST, Microservices

  • Cloud and Infrastructure: AWS and/or GCP, Kubernetes

  • Distributed Systems: Event-driven architectures, including Kafka

  • Orchestration Frameworks: LangGraph, LangChain, Airflow, etc.

Must-Have Technical/Functional Skills:
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.

  • 10+ years of experience building large-scale distributed systems with strong proficiency in Node.js/JavaScript/TypeScript and/or Golang.

  • Strong experience with LLM systems, agentic workflows, or advanced ML infrastructure.

  • Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products.

  • Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure.

  • Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation.

  • Fluency with AI-assisted and agentic development workflows.

  • Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems.

  • Ability to influence technical direction and align teams without formal authority.

  • Experience in workflow engines, async processing, queues, and streaming systems.

  • Experience with cloud platforms, services, and containerization technologies such as Docker and Kubernetes.

  • Proficiency in database technologies such as SQL (PostgreSQL) and NoSQL (MongoDB, Redis).

  • Strong problem-solving skills, with the ability to analyze complex technical challenges and propose effective solutions.

  • Experience with version control systems such as Git and CI/CD pipelines.

  • Excellent communication skills and ability to collaborate effectively with cross-functional teams and stakeholders.

Preferred Qualifications:
  • Experience building agentic systems in fintech or other regulated industries.

  • Experience as a founding engineer or early technical leader in AI-driven products.

  • Demonstrated success delivering technically complex autonomous systems.

  • Meaningful contributions to open-source AI or agentic frameworks.

  • Familiarity with fine-tuning, model optimization, and inference pipelines is a plus.

Roles & Responsibilities:
  • Design, develop, and maintain high-performance backend services and APIs.

  • Collaborate with cross-functional teams to gather requirements, architect solutions, and implement features that meet business needs.

  • Optimize backend systems for performance, scalability, and reliability, ensuring smooth operation under high load.

  • Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.

  • Design, build, and operate production-grade agentic AI systems used across multiple products.

  • Own and evolve shared agentic AI capabilities, including:

    • Agent frameworks and orchestration layers.

    • Planning, tool use, and memory strategies.

    • Retrieval and grounding (RAG) pipelines.

    • LLM infrastructure, inference, and model gateways.

    • Evaluation, observability, and safety tooling for autonomous systems.

  • Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.

  • Implement best practices for code quality, testing, and deployment automation.

  • Work closely with DevOps teams to deploy and manage backend services in cloud environments such as AWS, Azure, and Google Cloud.

  • Collaborate with frontend engineers to define API contracts and ensure seamless integration between frontend and backend systems.

  • Communicate effectively with team members, stakeholders, and management to provide project updates, status reports, and technical recommendations.

Jobcon Logo Position Details

Posted:

Nov 18, 2026

Reference Number:

2131-42103

Employment:

Full-time

Salary:

$120,000 per year

City:

New York City

Job Origin:

CIEPAL_ORGANIC_FEED

Share this job:

  • linkedin

Jobcon Logo
A job sourcing event
In Dallas Fort Worth
Aug 19, 2017 9am-6pm
All job seekers welcome!

Senior Backend AI Engineer    Apply

Click on the below icons to share this job to Linkedin, Twitter!

Role: Senior Backend AI Engineer

Location: New York, NY / Phoenix, AZ

Experience: 7 14 Years

Job Summary:

We are looking for a talented and experienced Senior Backend Engineer to join our growing team. The Senior Backend Engineer will be responsible for designing, developing, and maintaining scalable and efficient backend systems that power our applications.

The ideal candidate will have a strong background in backend development, a solid understanding of distributed systems, LLM systems, agentic workflows, and experience with cloud technologies.

Core Engineering Stack:
  • Languages: Node.js, TypeScript, Go

  • APIs and Services: REST, Microservices

  • Cloud and Infrastructure: AWS and/or GCP, Kubernetes

  • Distributed Systems: Event-driven architectures, including Kafka

  • Orchestration Frameworks: LangGraph, LangChain, Airflow, etc.

Must-Have Technical/Functional Skills:
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.

  • 10+ years of experience building large-scale distributed systems with strong proficiency in Node.js/JavaScript/TypeScript and/or Golang.

  • Strong experience with LLM systems, agentic workflows, or advanced ML infrastructure.

  • Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products.

  • Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure.

  • Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation.

  • Fluency with AI-assisted and agentic development workflows.

  • Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems.

  • Ability to influence technical direction and align teams without formal authority.

  • Experience in workflow engines, async processing, queues, and streaming systems.

  • Experience with cloud platforms, services, and containerization technologies such as Docker and Kubernetes.

  • Proficiency in database technologies such as SQL (PostgreSQL) and NoSQL (MongoDB, Redis).

  • Strong problem-solving skills, with the ability to analyze complex technical challenges and propose effective solutions.

  • Experience with version control systems such as Git and CI/CD pipelines.

  • Excellent communication skills and ability to collaborate effectively with cross-functional teams and stakeholders.

Preferred Qualifications:
  • Experience building agentic systems in fintech or other regulated industries.

  • Experience as a founding engineer or early technical leader in AI-driven products.

  • Demonstrated success delivering technically complex autonomous systems.

  • Meaningful contributions to open-source AI or agentic frameworks.

  • Familiarity with fine-tuning, model optimization, and inference pipelines is a plus.

Roles & Responsibilities:
  • Design, develop, and maintain high-performance backend services and APIs.

  • Collaborate with cross-functional teams to gather requirements, architect solutions, and implement features that meet business needs.

  • Optimize backend systems for performance, scalability, and reliability, ensuring smooth operation under high load.

  • Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.

  • Design, build, and operate production-grade agentic AI systems used across multiple products.

  • Own and evolve shared agentic AI capabilities, including:

    • Agent frameworks and orchestration layers.

    • Planning, tool use, and memory strategies.

    • Retrieval and grounding (RAG) pipelines.

    • LLM infrastructure, inference, and model gateways.

    • Evaluation, observability, and safety tooling for autonomous systems.

  • Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.

  • Implement best practices for code quality, testing, and deployment automation.

  • Work closely with DevOps teams to deploy and manage backend services in cloud environments such as AWS, Azure, and Google Cloud.

  • Collaborate with frontend engineers to define API contracts and ensure seamless integration between frontend and backend systems.

  • Communicate effectively with team members, stakeholders, and management to provide project updates, status reports, and technical recommendations.

Loading
Please wait..!!