MySpiders : Evolve your own intelligent Web crawlers (2002)

by Gautam Pant , Filippo Menczer
Citations:27 - 8 self

Documents Related by Co-Citation

485 Focused crawling: a new approach to topic-specific Web resource discovery – Soumen Chakrabarti, Martin van den Berg, Byron Dom - 1999
2719 Authoritative Sources in a Hyperlinked Environment – Jon M. Kleinberg - 1999
79 Evaluating Topic-Driven Web Crawlers – Filippo Menczer, Gautam Pant, Padmini Srinivasan, Miguel E. Ruiz - 2001
82 Intelligent Crawling on the World Wide Web with Arbitrary – Predicates Charu Aggarwal, Charu C. Aggarwal, Ibm T. J. Watson, Ibm T. J. Watson, Resch Ctr, Resch Ctr, Philip S. Yu - 2001
191 Focused crawling using context graphs – M. Diligenti, F. M. Coetzee, S. Lawrence, C. L. Giles, M. Gori - 2000
85 Adaptive Retrieval Agents: Internalizing Local Context and Scaling up to the Web – Filippo Menczer, Richard K. Belew, Jaime Carbonell, Yiming Yang, William Cohen - 1999
3262 The Anatomy of a Large-Scale Hypertextual Web Search Engine – Sergey Brin, Lawrence Page - 1998
291 Efficient Crawling Through URL Ordering – Junghoo Cho, Hector Garcia-molina, Lawrence Page - 1998
1807 An algorithm for suffix stripping – Martin F Porter - 1980
101 Breadth-first search crawling yields high-quality pages – Marc Najork - 2001
12 Topical Crawling for Business Intelligence – Gautam Pant, Filippo Menczer
59 The sharksearch algorithm – an application: Tailored web site mapping – M Hersovici, M Jacovi, Y S Maarek, D Pelleg, M Shtalhaim, S Ur - 1998
33 A General Evaluation Framework for Topical Crawlers – P. Srinivasan, F. Menczer, G. Pant - 2005
34 Information retrieval in the World Wide Web: Making clientbased searching feasible – P De Bra, R Post - 1994
15 Exploration versus Exploitation in Topic Driven Crawlers – Gautam Pant, Padmini Srinivasan, Filippo Menczer - 2002
404 Improved algorithms for topic distillation in a hyperlinked environment – Krishna Bharat, Monika R. Henzinger - 1998
107 Using reinforcement learning to spider the Web efficiently – Jason Rennie, Andrew Kachites McCallum - 1999
48 ARACHNID: Adaptive Retrieval Agents Choosing Heuristic Neighborhoods for Information Discovery – Filippo Menczer - 1997
47 Topical web crawlers: Evaluating adaptive algorithms – Filippo Menczer, Gautam Pant, Padmini Srinivasan - 2004