Scholarlink

<p>Web page segmentation is a fundamental technique applied in information retrieval systems to enhance Web crawling tasks and information extraction. Its objectives are to gain deep insights from crawling results and to extract the main content of a Web page by disregarding the irrelevant regions. Over time, several solutions have been proposed to address the segmentation problem using different approaches and learning strategies. Among these, the structural cue, which is a characteristic of the DOM tree, is widely utilized as a primary factor in segmentation models. In this paper, we propose a novel technique for Web page segmentation using DOM-structural cohesion analysis. Our approach involves generating blocks that represent groups of DOM subtrees with similar tag structures. By analyzing the cohesion within each generated block and comparing detailed information such as types, attributes, and visual cues of Web page elements, the approach can effectively maintain or reconstruct the segmentation layout. Additionally, we employ the Canny algorithm to optimize the segmentation result by reducing redundant spaces, resulting in a more accurate segmentation. We evaluate the effectiveness of our approach using a dataset of 1,969 Web pages. The approach achieves 64% on the <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11280_2025_1333_Article_IEq1.gif" Format="GIF" Height="18" Rendition="HTML" Resolution="72" Type="Linedraw" Width="27" /> </InlineMediaObject> <EquationSource Format="TEX">\( F_{B^{3}}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>F</mi> <msup> <mi>B</mi> <mn>3</mn> </msup> </msub> </math></EquationSource> </InlineEquation> score, surpassing existing state-of-the-art methods. The proposed DOM-structural cohesion analysis has the potential to improve Web page segmentation and its various applications.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A DOM-structural cohesion analysis approach for segmentation of modern web pages

  • 期刊论文

  • 发表日期：

    2025年2月26日

查看全文
  • Hieu Huynh,
  • Quoc-Tri Le,
  • Vu Nguyen,
  • Tien Nguyen

摘要

Web page segmentation is a fundamental technique applied in information retrieval systems to enhance Web crawling tasks and information extraction. Its objectives are to gain deep insights from crawling results and to extract the main content of a Web page by disregarding the irrelevant regions. Over time, several solutions have been proposed to address the segmentation problem using different approaches and learning strategies. Among these, the structural cue, which is a characteristic of the DOM tree, is widely utilized as a primary factor in segmentation models. In this paper, we propose a novel technique for Web page segmentation using DOM-structural cohesion analysis. Our approach involves generating blocks that represent groups of DOM subtrees with similar tag structures. By analyzing the cohesion within each generated block and comparing detailed information such as types, attributes, and visual cues of Web page elements, the approach can effectively maintain or reconstruct the segmentation layout. Additionally, we employ the Canny algorithm to optimize the segmentation result by reducing redundant spaces, resulting in a more accurate segmentation. We evaluate the effectiveness of our approach using a dataset of 1,969 Web pages. The approach achieves 64% on the \( F_{B^{3}}\) F B 3 score, surpassing existing state-of-the-art methods. The proposed DOM-structural cohesion analysis has the potential to improve Web page segmentation and its various applications.