Loading…
5 August, 2025
Hyderabad, India
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit India 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.
← Back to schedule
Testing, Evaluation and Debugging Generative AI and Agentic Applications - Kalyan Kolachala, Intuit & Vaishali Shetty, Mycom
Tuesday August 5, 2025 2:15pm - 2:40pm IST
Hall 6
Generative AI has been very powerful in providing a natural language understanding and reasoning abilities to products and applications using approaches and technologies such as LLMs, RAG, vector databases and knowledge graphs. These capabilities have been significantly enhanced using orchestration and autonomous agents with frameworks such as LangChain and LangGraph. These powerful capabilities however bring in additional challenges when testing and evaluating the resulting products and applications because of natural language interface, non-deterministic output and additional complexity with the use of a hierarchy of autonomous agents.
Speakers
avatar for Kalyan Kolachala

Kalyan Kolachala

India SIte head for developer platform, Intuit
Kalyan is a senior engineering leader with experience in delivering world class, enterprise products and platforms involving AI/ML, genAI, SaaS, Kubernetes, Cloud, big data and observability. At the current job at Intuit and previously at Hitachi Vantara, he has been responsible for... Read More →
avatar for Vaishali Shetty

Vaishali Shetty

Test Architect, Mycom
Vaishali is a seasoned architect specialising in QA, performance, observability and generative AI. She has been architect currently at Mycom and previously at Hitachi Vantara and lead at Oracle and Altisource Labs. She has played a key role in designing and implementing robust testing... Read More →
Tuesday August 5, 2025 2:15pm - 2:40pm IST
Hall 6
  Open AI + Data

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link