Data collection is a critical technique that involves extracting, organizing, and storing raw data from various sources, whether manual or automated. This article presents a state-of-the-art review along with a case study on the use of web scraping for competitive intelligence. In this study, we collected and merged data from different sources, performed cross-analyses, and visualized the results in informative dashboards to support decision-making. This information was then leveraged to formulate business recommendations aimed at enhancing the competitiveness of the companies studied. The study demonstrated that integrating web scraping into business strategies can improve market understanding and provide valuable insights to outcompete rivals. Additionally, we discuss the challenges associated with the use of web scraping for economic intelligence, while highlighting the potential contribution of artificial intelligence to enhance these systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Web Scraping for Competitive Intelligence: State of the Art and Case Study

  • Edouard Ngor Sarr,
  • Oumar Diagne,
  • Abel Diatta,
  • Lamine Faty

摘要

Data collection is a critical technique that involves extracting, organizing, and storing raw data from various sources, whether manual or automated. This article presents a state-of-the-art review along with a case study on the use of web scraping for competitive intelligence. In this study, we collected and merged data from different sources, performed cross-analyses, and visualized the results in informative dashboards to support decision-making. This information was then leveraged to formulate business recommendations aimed at enhancing the competitiveness of the companies studied. The study demonstrated that integrating web scraping into business strategies can improve market understanding and provide valuable insights to outcompete rivals. Additionally, we discuss the challenges associated with the use of web scraping for economic intelligence, while highlighting the potential contribution of artificial intelligence to enhance these systems.