SEI is looking for a Senior DevOps Engineer to join our Enterprise AI team. This role is about building and operating reliable cloud‑based systems by writing code, automating infrastructure and delivery workflows, and reducing friction for developers and users. You will work closely with InfoSec, Cloud engineers and business stakeholders to design, deploy, and operate systems with clear ownership and practical engineering judgment. We expect you to use modern tooling, including AI‑assisted tools where appropriate, to speed up automation, troubleshooting, and operations while remaining accountable for correctness, security, and reliability.
What you will do:
Design AI architectures end-to-end : RAG pipelines, agentic orchestration (multi‑agent, tool use, MCP), retrieval strategies, grounding, and structured outputs.
Architect Document Intelligence as a Service : ingestion, OCR/vision, extraction, verification, multitenant design, and sensitive‑data handling.
Define enterprise patterns : prompt governance, model routing, security envelopes, HITL gates, plugin/MCP integration, fallback/verification flows.
Prototype fast : build rapid POCs in Python to validate architecture, derisk decisions, and accelerate delivery.
Drive TrustAI : hallucination testing, bias/fairness evaluations, lineage, scoring, drift monitoring, and compliance alignment.
Design robust telemetry : retrieval/prompt tracing, eval feedback loops, guardrail instrumentation (OpenTelemetry, Langfuse, App Insights).
Interface with InfoSec & Cloud Enablement : private networking, identity boundaries, policy as code, DLP, model‑risk governance.
Publish reference architectures , reusable modules, decision playbooks; lead design reviews and mentor engineers.
What we need from you:
BA/BS in a related technical field or equivalent in education and work experience.
Minimum of 7 years prior work experience with software/ML engineering; strong Python (APIs, services, production).
Deep RAG expertise: embeddings, hybrid search, chunking, reranking, evaluations, guardrails.
Agentic AI: multistep agents, tool calling, orchestration frameworks (LangChain/LlamaIndex or custom).
MCP / plugin patterns, tool server integration, context protocol design.
Azure: OpenAI/Models, AI Search, ML, AKS, Functions, Key Vault, VNET/private endpoints.
Solid grasp of LLM lifecycle: prompting, structured outputs, token/cost management, fine‑tuning concepts.
Ability to design for regulated industries: PII handling, isolation, audit, governance readiness.
What we would like from you:
LLM fine‑tuning (LoRA/QLoRA), evaluation frameworks (RAGAS, pairwise).
Vector databases (Milvus, Pinecone, Weaviate).
TrustAI implementation: safety evaluations, governance dashboards, drift monitoring.
TypeScript/Node for plugins or frontend integrations.
Clear verbal and written communication with clients and team members, including documentation and presentation experience.
Excellent analytical, organizational, and problem‑solving skills.
Self‑starter who works efficiently in a fast‑paced environment with changing priorities and a geographically distributed team.
Creative thinking and ability to seek optimum solutions.
Ability to grasp loosely defined concepts and transform them into tangible results and key deliverables.
Diagnostic skills to analyze technical, business, and financial issues and options.
Inference from previous examples, willingness to understand application structure.
Action‑oriented, quickly adapting to change.
This team follows a hybrid schedule and works 3 days in the office.
Benefits:
To help you stay energized, engaged and inspired, we offer a wide range of benefits including comprehensive care for your physical and mental well‑being, a strong retirement plan, tuition reimbursement, a hybrid working environment for most roles, support for working parents and flexible paid time off (PTO) so you can relax, recharge and be there for the people you care about.
Benefits include healthcare (medical, dental, vision, prescription, wellness, EAP, FSA), life and disability insurance (premiums paid for base coverage), 401(k) match, education assistance, commuter benefits, up to 11 paid holidays per year, 21 days PTO per year pro‑rated for new hires (increasing over time), paid parental leave, backup childcare arrangements, paid volunteer days, a discounted stock purchase plan, investment options, access to thriving employee networks and more.
SEI is an Equal Opportunity Employer and so much more... SEI is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability status, protected veteran status, or any other characteristic protected by law.
#J-18808-Ljbffr