UbiCrawler: a scalable fully distributed web crawler

UbiCrawler: a scalable fully distributed web crawler (2003)

by Paolo Boldi , Bruno Codenotti , Massimo Santini , Sebastiano Vigna

Venue:	Software: Practice & Experience
Citations:	75 - 22 self

User correction supplied by SystemCorrections

Datum	Value	Source
TITLE	UbiCrawler: a scalable fully distributed web crawler	user correction - Legacy Corrections
AUTHOR NAME	Paolo Boldi	user correction - Legacy Corrections
AUTHOR NAME	Bruno Codenotti	user correction - Legacy Corrections
AUTHOR NAME	Massimo Santini	user correction - Legacy Corrections
AUTHOR NAME	Sebastiano Vigna	user correction - Legacy Corrections
ABSTRACT	We report our experience in implementing UbiCrawler, a scalable distributed web crawler, using the Java programming language. The main features of UbiCrawler are platform independence, fault tolerance, a very effective assignment function for partitioning the domain to crawl, and more in general the complete decentralization of every task. The necessity of handling very large sets of data has highlighted some limitation of the Java APIs, which prompted the authors to partially reimplement them.	user correction - Legacy Corrections
YEAR	2003	user correction - Legacy Corrections
VENUE	Software: Practice & Experience	INFERENCE
VENUE TYPE	JOURNAL	INFERENCE
PAGES	2004	INFERENCE
VOLUME	34	INFERENCE
CITATIONS	10 found	ParsCit 1.0