Loading, Please wait..!!
Senior AI Software Engineer (Java/Python + LLMs)
-
Posted on: Jun 25, 2026
-
San Jose, California
-
Salary: $156,000 per year
-
Onsite
-
Full-time
Curious about compensation?
Explore the historical salary trends, average pay, and estimated compensation for Senior AI Software Engineer (Java/Python + LLMs) roles in California.
View Salary Guide →Find your match !
Job Title :
Senior AI Software Engineer (Java/Python + LLMs)
Job Type :
Full-time
Job Location :
San Jose California United States
Remote :
No
Job Description :
Job Description
Job Title: Senior AI Software Engineer (Java/Python + LLMs)
Location: San Jose, CA (Hybrid)
Employment Type: Contract to hire
Rate: $75/hr W2
Interview Mode: Face to Face
What you'll do:
- Design, build, and own backend microservices in Java and Python running on AWS.
- Architect scalable, fault-tolerant distributed systems with clean service boundaries and well-designed APIs.
- Build and maintain robust CI/CD pipelines — automated testing, deployment, observability, rollback strategies.
- Integrate AI/ML capabilities (LLMs, model APIs, RAG, embeddings, etc.) into product features and backend services.
- Operate services end-to-end on AWS — compute, networking, storage, IAM, monitoring, cost management.
- Stay current on the rapidly evolving AI landscape and bring relevant advances into the stack.
- Collaborate cross-functionally with product, ML, and platform teams during ramp-up.
Required qualifications:
- 6–9 years of professional software engineering experience.
- Strong production experience in both Java and Python (Spring Boot, FastAPI/Flask, or equivalent).
- Proven track record designing and operating microservices architectures in production.
- Deep AWS expertise — EKS/ECS, Lambda, API Gateway, RDS/DynamoDB, S3, SQS/SNS, CloudWatch, IAM.
- Hands-on CI/CD experience — Jenkins, GitHub Actions, GitLab CI, AWS CodePipeline, or similar; IaC with Terraform or CloudFormation.
- Practical AI/ML integration experience — working with LLM APIs (OpenAI, Anthropic, Bedrock), RAG pipelines, vector databases, or embedding-based features in production.
- Strong fundamentals: distributed systems, API design, testing strategy, observability, security.
- Working knowledge of current AI/LLM trends — you can speak fluently to what's changed in the last 6 months.
Position Details
Posted:
Jun 25, 2026
Reference Number:
7e37dbf239f74829
Employment:
Full-time
Salary:
Not Available
City:
San Jose
Job Origin:
ziprecruiter
Share this job:
Please wait..!!
