Google aims to penetrate the Deep Web
Posted by comartslibrarian on April 11, 2008
READ: Google aims to penetrate the Deep Web with HTML forms crawling – ComputerWorld
“This experiment is part of Google’s broader effort to increase its coverage of the Web,” Google noted. “In fact, HTML forms have long been thought to be the gateway to large volumes of data beyond the normal scope of search engines. The terms Deep Web, Hidden Web or Invisible Web have been used collectively to refer to such content that has so far been invisible to search engine users. By crawling using HTML forms … we are able to lead search-engine users to documents that would otherwise not be easily found in search engines, and provide Web masters and users alike with a better and more comprehensive search experience.”
Whoa… even attempting this is huge.
