MySpiders : Evolve your own intelligent Web crawlers (2002)

by Gautam Pant , Filippo Menczer
Citations:26 - 8 self

Documents Related by Co-Citation

482 Focused crawling: a new approach to topic-specific Web resource discovery – Soumen Chakrabarti, Martin van den Berg, Byron Dom - 1999
84 Adaptive Retrieval Agents: Internalizing Local Context and Scaling up to the Web – Filippo Menczer, Richard K. Belew, Jaime Carbonell, Yiming Yang, William Cohen - 1999
2702 Authoritative Sources in a Hyperlinked Environment – Jon M. Kleinberg - 1999
79 Evaluating Topic-Driven Web Crawlers – Filippo Menczer, Gautam Pant, Padmini Srinivasan, Miguel E. Ruiz - 2001
290 Efficient Crawling Through URL Ordering – Junghoo Cho, Hector Garcia-molina, Lawrence Page - 1998
189 Focused crawling using context graphs – M. Diligenti, F. M. Coetzee, S. Lawrence, C. L. Giles, M. Gori - 2000
3234 The Anatomy of a Large-Scale Hypertextual Web Search Engine – Sergey Brin, Lawrence Page - 1998
82 Intelligent Crawling on the World Wide Web with Arbitrary – Predicates Charu Aggarwal, Charu C. Aggarwal, Ibm T. J. Watson, Ibm T. J. Watson, Resch Ctr, Resch Ctr, Philip S. Yu - 2001
59 The sharksearch algorithm – an application: Tailored web site mapping – M Hersovici, M Jacovi, Y S Maarek, D Pelleg, M Shtalhaim, S Ur - 1998
15 Exploration versus Exploitation in Topic Driven Crawlers – Gautam Pant, Padmini Srinivasan, Filippo Menczer - 2002
101 Breadth-first search crawling yields high-quality pages – Marc Najork - 2001
403 Improved algorithms for topic distillation in a hyperlinked environment – Krishna Bharat, Monika R. Henzinger - 1998
34 Information retrieval in the World Wide Web: Making clientbased searching feasible – P De Bra, R Post - 1994
1795 An algorithm for suffix stripping – M F Porter - 1980
48 ARACHNID: Adaptive Retrieval Agents Choosing Heuristic Neighborhoods for Information Discovery – Filippo Menczer - 1997
107 Using reinforcement learning to spider the Web efficiently – Jason Rennie, Andrew Kachites McCallum - 1999
12 Topical Crawling for Business Intelligence – Gautam Pant, Filippo Menczer
22 Scalable web search by adaptive online agents: An infospiders case study – F Menczer, A Monge - 1999
22 Complementing Search Engines with Online Web Mining Agents – Filippo Menczer - 2002