From Ideation to Creation: Building Intelligent Products with GenAI

In the last edition, we created a chatbot for understanding diabetes; you are encouraged to check out the chapter. Despite the chatbot now being achievable with Agent Bricks’ Knowledge Assistant, it’s still critical to understand the end-to-end workflow. In this second edition, we will walk through a practical healthcare case study in which we will attempt to fine-tune a vision language model (VLM), a.k.a. Qwen3-VL-2B-Instruct, to watch real surgery videos and generate post-surgical reports to train new surgeons. It’s an ambitious and advanced attempt that will demonstrate the full capabilities of the Databricks Data Intelligence Platform.