Can search engines be used as tools for web-link analysis? A critical view

• Published in: Journal of documentation Vol. 55; no. 4; pp. 375 - 384
• Main Authors: Snyder, Herbert, Rosenbaum, Howard
• Format: Journal Article
• Language: English
• Published: Bradford MCB UP Ltd 01-10-1999; Emerald; Aslib, etc
• Subjects: Evaluation; Exact sciences and technology; Information and communication sciences; Information processing and retrieval; Information retrieval. Man machine relationship; Information science. Documentation; Links; Links (Indexing); Research Methodology; Research Problems; Research process. Evaluation; Sciences and techniques of general use; Search Engines; Search Strategies; World Wide Web; Search consultants; World Wide Web; Journal publishing; Evaluation; Hypertext link; Search engine; World wide web; Information retrieval; Citation; Failures
• ISSN: 0022-0418; 1758-7379
• DOI: 10.1108/EUM0000000007151

The paper investigates the problems of using commercial search engines for web-link research and attempts to clarify the nature of the problems involved in the use of these engines. The research finds that search engines are highly variable in the results they produce, are limited in the search functions they offer, have poorly and or incorrectly documented functions, use search logics that are opaque, and change the search functions they offer over time. The limitations which are inherent in commercial search engines should cause researchers to have reservations about any conclusions that rely on these tools as primary data-gathering instruments. The short-comings are market-driven rather than inherent properties of the web or of web-searching technologies. Improved functionalities are within the technical capabilities of search engine programmers and could be made available to the research community. The findings also offer mild support for the validity of the connection between web links and citations as analogues of intellectual linkage.