Deep Web Wiki

Just came across this volunteer-coordinated project, Deep Web Wiki. Here’s the mission of the project:

“Deep Web Wiki is a volunteer-led search organization that maintains a database containing detailed descriptions of so-called ‘Deep Web’ sites that are either ignored or poorly indexed by the major search engines.“

It’s also probably worth reviewing a definition of the “Deep Web” (AKA “Hidden Web,” “Invisible Web,” etc.; the following excerpt is taken from Deep Web Wiki as well:

“. . . the majority of Web-accessible information is not indexed by any of the major search engines. Despite increasing power and scope, these engines experience great difficulty accessing information contained in databases and dynamically generated sites. Rather than a minor shortcoming, this is actually a significant blind spot in our collective view of available information; these so-called ‘hidden’ sites contain information that is many orders of magnitude greater in size than that found in the part of the Web indexed by Google, Bing, and other search engines.”

Users can search the wiki or browse for “Deep Web” resources by navigating the site’s directory of resources.

Keep an eye on this project.

A reminder, too, to revisit the well-known Deep Web directory called Complete Planet. It claims to catalog more than 70,000 databases and niche search tools.