Aditya Palnitkar

You wouldn’t dream of deploying software without monitoring or unit testing. However, this is what regularly happens with LLM applications, even though their fickleness and fragility are well known problems. While testing is often seen as a drag on a software team’s productivity, especially in fast moving organisations, the exact opposite is true for LLMs and AI agents. Great monitoring and eval can supercharge your development velocity. A good eval system can help you find the best ROI items to work on, and put together positive feedback loops in your iteration cycle, and help you find the most impactful items to work on- in the next week, month, half or year. Join me as I talk about how to put a world class eval system to work towards your LLM application.