A Survey of Web Crawler Algorithms
Due to availability of abundant data on web, searching has a significant impact. On-going researches place emphasis on the relevancy and robustness of the data found, as the discovered patterns proximity is far from the explored. Inspite of their relevance pages for any search topic, the results are huge to be explored. Also the users perspective differs from time to time from topic to topic. Usually ones want is others unnecessary. Crawling algorithms are thus crucial in selecting the pages that satisfies the users needs. This paper reviews the researches on web crawling algorithms used on searching.
Keywords: web crawling algorithms, crawling algorithm survey, search algorithms
Download Full-Text
ABOUT THE AUTHORS
Pavalam S M
Pavalam is currently working at National University of Rwanda and also doing her Ph.D in Computer Science and Engineering at SRM University, INDIA. Her research interest includes Data Mining, Information Retrieval, Web crawling, Mobile Technology, E-Learning/M-Learning.
S V Kashmir Raja
Dr. S.V. Kashmir Raja is currently the Dean Research at SRM University, India. He received his Ph.D from Indian Institute of Science, Bangalore in 1986. His research interest includes computer networks and software engineering. He has more than 60 publications in International/National Journals and conferences. He has guided several Ph.D students. He has received several awards such as “The Man of Year – 1999” by American Bibliographical Institute - USA, and “2000 Outstanding Scholar of 20th Century” by International Bibliographical Centre, Cambridge - England
Felix K Akorli
Dr. Felix K Akorli is currently coordinator of M.Sc ICT at National University of Rwanda. He has many International Publications in Journals and conferences. His research interests include Electronics, Mobile communications
Jawahar M
Jawahar is currently the Director of ICT at the National University of Rwanda. His research interest includes E-Learning/M-Learning, Networking. He has keen interest in Software development and Implementation.
Pavalam S M
Pavalam is currently working at National University of Rwanda and also doing her Ph.D in Computer Science and Engineering at SRM University, INDIA. Her research interest includes Data Mining, Information Retrieval, Web crawling, Mobile Technology, E-Learning/M-Learning.
S V Kashmir Raja
Dr. S.V. Kashmir Raja is currently the Dean Research at SRM University, India. He received his Ph.D from Indian Institute of Science, Bangalore in 1986. His research interest includes computer networks and software engineering. He has more than 60 publications in International/National Journals and conferences. He has guided several Ph.D students. He has received several awards such as “The Man of Year – 1999” by American Bibliographical Institute - USA, and “2000 Outstanding Scholar of 20th Century” by International Bibliographical Centre, Cambridge - England
Felix K Akorli
Dr. Felix K Akorli is currently coordinator of M.Sc ICT at National University of Rwanda. He has many International Publications in Journals and conferences. His research interests include Electronics, Mobile communications
Jawahar M
Jawahar is currently the Director of ICT at the National University of Rwanda. His research interest includes E-Learning/M-Learning, Networking. He has keen interest in Software development and Implementation.
