Skip to Main Content
It looks like you're using Internet Explorer 11 or older. This website works best with modern browsers such as the latest versions of Chrome, Firefox, Safari, and Edge. If you continue with this browser, you may see unexpected results.

Beyond Google: The Invisible Web: Tools

Sample Suggestions for Mining or Harvesting the Invisible Web

1. Directories:

Open Directory Project - "...largest human-edited directory of the Web"

Infomine: Scholarly Internet Research Collection from the University of California-Riverside - (Went offline 12/15/14)

Digital Librarian maintained by Margaret Vail Anderson, a librarian - (Last updated 4/20/13)

Internet Public Library (ipl2) - - (Ceased operations 6/30/15)

WWW Virtual Library - Started by Tim Berners-Lee in 1991, oldest Web directory.

2. Guides:

Boswell, Wendy. The Invisible Web: How To Find and Search the Invisible Web. 2009.

A tutorial from the UC Berkeley Library. Invisible or Deep Web: What It Is, How to Find It, And Its Inherent Ambiguity. 2012.

3. Search Tools: - BASE - Bielefeld Academic Search Engine - Closer Look Search - Example of a vertical search engine - Deep Web Search - A How-To Site - deeper web (powered by Google) -(Beta 2010) - Mednar - Million Short will remove from a hundred to a million top websites from search results to reach new and original resources. - (in public beta 2014) - "is a web search engine for students and researchers that aims to make academic information easily accessible to everyone." - Internet Archive Wayback Machine - archive of websites - Wolfram Alpha - Computational knowledge engine - Deep.Dot.Web - "provides the public with information about the dark net." - Vocativ - a "new type of media company, bringing audiences hidden perspectives, unheard voices and original ideas from around the world via the Deep Web."

4.  Specialized Databases: - Directory of Open Access Journals - Digital library of education research and information - Information on federal and state laws, lawsuits, etc. - Library of Congress - People search - PubMed: U.S. National Library of Medicine portal to government-funded medical research - Gateway to U.S. Federal Science - A free Web portal to science journals and science databases - Searches the social web   (Closed December 2015) - The official Web portal to the U. S. government - "The global science gateway". Available now in 10 languages.

5. Weblogs:

The Invisible Web Revisited -
Maintained by Francine Egger-Sider

Going Beyond Google Again -
Maintained by Francine Egger-Sider

Invisible Web Weblog -
Maintained by Yazdan Mansourian.

6. LibGuides: - LibGuide created by the University of Kentucky Libraries in which the Invisible Web is depicted as a venn diagram - St. Louis Community College Library LibGuide, "Deep Web: Welcome"


Library Media Resources Center
LaGuardia Community College
31-10 Thomson Avenue, room E101
Long Island City, NY 11101
Email the Library