In this paper, we report three upgrades to our Interactive Video Search system. (i) A unified vector-database backend enables hybrid dense-sparse retrieval with in-engine filtering and late-fusion re-ranking, improving responsiveness under mixed embedding search and text-based search. (ii) A self-similarity-matrix (SSM) shot segmentation pipeline adapts to both short and long videos, yielding more coherent units for retrieval and browsing. (iii) We generalize the VIREO grid-sketch from colors to an object-sketch: object-by-cell atoms are precomputed offline and combined interactively with the same recommendation shading as the original interface. Across the Vimeo Creative Commons Collection (V3C), Marine Video Kit (MVK), and Laparoscopic Hysterectomies (LHE75) datasets, these updates increase search quality while preserving the system’s interactive workflow.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

VIREO @ Video Browser Showdown 2026

  • Yu-Tong Cheng,
  • Phuong-Anh Nguyen,
  • Kim-Thuy Kha,
  • Chong-Wah Ngo

摘要

In this paper, we report three upgrades to our Interactive Video Search system. (i) A unified vector-database backend enables hybrid dense-sparse retrieval with in-engine filtering and late-fusion re-ranking, improving responsiveness under mixed embedding search and text-based search. (ii) A self-similarity-matrix (SSM) shot segmentation pipeline adapts to both short and long videos, yielding more coherent units for retrieval and browsing. (iii) We generalize the VIREO grid-sketch from colors to an object-sketch: object-by-cell atoms are precomputed offline and combined interactively with the same recommendation shading as the original interface. Across the Vimeo Creative Commons Collection (V3C), Marine Video Kit (MVK), and Laparoscopic Hysterectomies (LHE75) datasets, these updates increase search quality while preserving the system’s interactive workflow.