MySpiders : Evolve your own intelligent Web crawlers

MySpiders : Evolve your own intelligent Web crawlers (2002)

by Gautam Pant , Filippo Menczer

Citations:

24 - 8 self

User correction supplied by SystemCorrections

Datum	Value	Source
TITLE	MySpiders : Evolve your own intelligent Web crawlers	user correction - Legacy Corrections
AUTHOR NAME	Gautam Pant	user correction - Legacy Corrections
AUTHOR AFFIL	Department of Management Sciences; The University of Iowa	user correction - Legacy Corrections
AUTHOR ADDR	Iowa City, IA 52242	user correction - Legacy Corrections
AUTHOR NAME	Filippo Menczer	user correction - Legacy Corrections
ABSTRACT	The dynamic nature of the World Wide Web makes it a challenge to find information that is both relevant and recent. Intelligent agents can complement the power of search engines to meet this challenge. We present a Web tool called MySpiders, which implements an evolutionary algorithms managing a population of adaptive crawlers who browse the Web autonomously. Each agent acts as an intelligent client on behalf of the user, driven by a user query and by textual and linkage clues in the crawled pages. Agents autonomously decide which links to follow, which clues to internalize, when to spawn o#spring to focus the search near a relevant source, and when to starve. The tool is available to the public as a threaded Java applet. We discuss the development and deployment of such a system. 1	user correction - Legacy Corrections
YEAR	2002	user correction - Legacy Corrections
CITATIONS	16 found	ParsCit 1.0