Skip to main content

Beyond Google: The Invisible Web: Tools

Sample Suggestions for Mining or Harvesting the Invisible Web

1. Directories:

Open Directory Project - "...largest human-edited directory of the Web"

Infomine: Scholarly Internet Research Collection from the University of California-Riverside - (Went offline 12/15/14)

Digital Librarian maintained by Margaret Vail Anderson, a librarian - (Last updated 4/20/13)

Internet Public Library (ipl2) - - (Ceased operations 6/30/15)

WWW Virtual Library - Started by Tim Berners-Lee in 1991, oldest Web directory.

2. Guides:

Boswell, Wendy. The Invisible Web: How To Find and Search the Invisible Web. 2009.

A tutorial from the UC Berkeley Library. Invisible or Deep Web: What It Is, How to Find It, And Its Inherent Ambiguity. 2012.

3. Search Tools: - BASE - Bielefeld Academic Search Engine - Closer Look Search - Example of a vertical search engine - Deep Web Search - A How-To Site - deeper web (powered by Google) -(Beta 2010) - Mednar - Million Short will remove from a hundred to a million top websites from search results to reach new and original resources. - (in public beta 2014) - "is a web search engine for students and researchers that aims to make academic information easily accessible to everyone." - Internet Archive Wayback Machine - archive of websites - Wolfram Alpha - Computational knowledge engine - Deep.Dot.Web - "provides the public with information about the dark net." - Vocativ - a "new type of media company, bringing audiences hidden perspectives, unheard voices and original ideas from around the world via the Deep Web."

4.  Specialized Databases: - Directory of Open Access Journals - Digital library of education research and information - Information on federal and state laws, lawsuits, etc. - Library of Congress - People search - PubMed: U.S. National Library of Medicine portal to government-funded medical research - Gateway to U.S. Federal Science - A free Web portal to science journals and science databases - Searches the social web   (Closed December 2015) - The official Web portal to the U. S. government - "The global science gateway". Available now in 10 languages.

5. Weblogs:

The Invisible Web Revisited -
Maintained by Francine Egger-Sider

Going Beyond Google Again -
Maintained by Francine Egger-Sider

Invisible Web Weblog -
Maintained by Yazdan Mansourian.

6. LibGuides: - LibGuide created by the University of Kentucky Libraries in which the Invisible Web is depicted as a venn diagram - St. Louis Community College Library LibGuide, "Deep Web: Welcome"


Library Media Resources Center
LaGuardia Community College
31-10 Thomson Avenue, room E101
Long Island City, NY 11101
Email the Library