Text Extraction from the Web via Text-to-Tag Ratio
by
Tim Weninger
,
William H. Hsu
| Citations: | 2 - 2 self |
BibTeX
@MISC{Weninger_textextraction,
author = {Tim Weninger and William H. Hsu},
title = {Text Extraction from the Web via Text-to-Tag Ratio},
year = {}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We describe a method to extract content text from diverse Web pages by using the HTML document’s Text-To-Tag Ratio rather than specific HTML cues that may not be constant across various Web pages. We describe how to compute the Text-To-Tag Ratio on a line-by-line basis and then cluster the results into content and non-content areas. With this approach we then show surprisingly high levels of recall for all levels of precision, and a large space savings. 1.
