The paper introduces an intelligent product search system that combines the CLIP model with large language models (LLMs) to efficiently handle and enhance multimodal query processing based on both text and images. The research proposes four main approaches: (1) applying fuzzy clustering techniques to optimize the search space over large-scale datasets, thereby accelerating retrieval speed; (2) integrating a fine-tuned LLM capable of understanding user query context and automatically routing it to appropriate query-processing modules; (3) mapping both images and text into a shared embedding space using the CLIP model to improve retrieval and matching accuracy; (4) building a recommender system based on fuzzy logic and fuzzy inference system. Experimental results demonstrate that the proposed methods significantly improve response time, query precision, and adaptability to complex real-world queries.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Fuzzy Multimodal Product Retrieval and Recommendation in Vietnamese E-Commerce with LLMs and CLIP

  • Quynh Do Mai Nhu,
  • Thuc Nguyen Huy,
  • Nhut Nguyen Minh,
  • Thuan Nguyen Dinh

摘要

The paper introduces an intelligent product search system that combines the CLIP model with large language models (LLMs) to efficiently handle and enhance multimodal query processing based on both text and images. The research proposes four main approaches: (1) applying fuzzy clustering techniques to optimize the search space over large-scale datasets, thereby accelerating retrieval speed; (2) integrating a fine-tuned LLM capable of understanding user query context and automatically routing it to appropriate query-processing modules; (3) mapping both images and text into a shared embedding space using the CLIP model to improve retrieval and matching accuracy; (4) building a recommender system based on fuzzy logic and fuzzy inference system. Experimental results demonstrate that the proposed methods significantly improve response time, query precision, and adaptability to complex real-world queries.