GENAI AND INTELLIGENT AGENTS
IN THE ENTERPRISE
San Francisco | November 6, 2025
David Talby
Chief Executive Officer at John Snow Labs
David Talby is the Chief Technology Officer at John Snow Labs, helping companies apply artificial intelligence to solve real-world problems in healthcare and life science. David is the creator of Spark NLP – the world’s most widely used natural language processing library in the enterprise. He has extensive experience building and running web-scale software platforms and teams – in startups, for Microsoft’s Bing in the US and Europe, and to scale Amazon’s financial systems in Seattle and the UK. David holds a Ph.D. in Computer Science and Master’s degrees in both Computer Science and Business Administration. He was named USA CTO of the Year by the Global 100 Awards and Game Changers Awards in 2022.PREVIOUS VIDEOS
Watch in-person: November 6
Evaluating and Governing Agentic AI in HealthcareAs agentic AI systems transition from prototypes to real-world clinical use, data scientists must balance autonomy with trust, safety, and compliance. This talk highlights the unique evaluation and monitoring challenges of agentic AI in healthcare:
- Evaluation gaps: why conventional benchmarks miss multi-step reasoning, tool use, and localized workflows—and how contamination and fragile metrics distort results.
- Bias and safety: demographic bias and other risks that trigger regulatory, legal, and contractual obligations for safety and fairness assessments.
- Continuous monitoring: practical MLOps strategies for detecting drift, unsafe autonomy, and compliance issues in deployed systems.
- Tools and standards: open-source libraries like LangTest and MedHELM, new stress-test datasets such as MedSafetyBench and MedAgentBench, and emerging guidance from NIST and CHAI.
The lessons shared here will not only help teams working on clinical AI, but also anyone building agentic systems in highly regulated industries where safety, fairness, and compliance are paramount.