
< session />
Wed, December 9Production AI SystemsInfrastructure, Platforms & Scale
Production AI agent systems can appear healthy by every traditional operational measure while delivering a steadily degrading user experience. Latency remains low, tool execution succeeds, databases remain healthy, and dashboards stay green. Yet users report responses becoming increasingly vague, hesitant, and less useful over time.
The problem is not operational failure. It is behavioural degradation.
Traditional reliability patterns such as circuit breakers, caching, retries, and distributed tracing were designed to detect systems that stop working. They are far less effective at detecting systems that continue functioning while their behaviour deteriorates.
This session examines five production incidents from LangGraph-based agent systems that exposed a gap between infrastructure health and user experience. Attendees will see how unbounded memory injection reduced response quality over multi-turn conversations without triggering alerts, how semantic caching served confidently incorrect answers, why OAuth refresh races emerged under concurrent streaming workloads, how conventional circuit-breaker strategies increased cloud costs, and how observability broke down once requests crossed into Server-Sent Events (SSE).
Rather than treating these as isolated incidents, the session extracts a set of production patterns for operating AI agents. These patterns address concerns that rarely appear in tutorials or benchmarks, including memory lifecycle management, cache correctness, streaming-safe authentication, latency-aware failure handling, and observability across protocol boundaries.
Throughout the session, attendees will work directly from production artifacts, including incident logs, quality metrics, traces, latency distributions, authentication failures, dashboards, and code. Every lesson is grounded in a real failure, the investigation that followed, and the engineering changes required to prevent recurrence.
Attendees will leave with practical patterns, operational metrics, and architectural guardrails that can be applied across agent platforms, including LangGraph, CrewAI, AutoGen, and custom orchestration systems. The focus is on the production realities of keeping AI agents reliable when infrastructure health and user experience no longer tell the same story.
What You Will Learn:
Who Should Attend:
< speaker_info />
Tuhin Sharma is Senior Principal Data Scientist at Redhat in the Data & AI team. Prior to that, he worked at Hypersonix as an AI architect and at IBM Watson as Data Scientist. He also co-founded and has been CEO of Binaize (backed by Techstars), a website conversion intelligence product for e-commerce SMBs. He received a master's degree from IIT Roorkee and a bachelor's degree from IIEST Shibpur in Computer Science. He loves to code and collaborate on open-source projects. He is one of the top 20 contributors of pandas. He has 4 research papers and 5 patents in the fields of AI and NLP. He is a reviewer of the IEEE MASS conference, Springer nature and Packt publication in the AI track. He writes deep learning articles for O'Reilly in collaboration with the AWS MXNET team. He is a regular speaker at prominent AI conferences like O'Reilly Strata & AI, PyCon, PyData, ODSC, GIDS, Devconf, Datahack Summit etc.
Soham is a Principal Engineer at Red Hat, where he builds agentic AI systems that survive the jump from demo to production. Based in Bangalore, he owns the full stack, from React front-ends through vLLM serving on Kubernetes, with reliability, observability, and security built in from day one.
Soham's production work, from enabling AI for multi-tenant data infrastructure to open-source agentic templates now running across Red Hat's Data & AI organization, reflects a rare cross-domain fluency across backend, security, and AI/ML. A published author and speaker, Soham cuts through the hype on what it actually takes to run AI at scale: closing the demo-to-production gap, taming cascading failures in multi-agent systems, and the engineering discipline that turns fragile prototypes into systems you can trust.