According to a white paper hosted on the University of Michigan’s website, the size of the Surface Web (Visible or Indexable Web) was estimated to be around 19 terabytes, whereas the size of the Invisible Web was estimated to be around 7,500 terabytes – and this was back in 2001. Mind boggling.
Because search engines only explore a very small proportion of the World Wide Web, the Invisible Web seems like a very tempting resource, especially if you are searching for something abstract or ambiguous. Google alone covers around 8 billion pages, but this pales into insignificance when one includes all this unseen information.
There are many tools and resources you can use to search the Deep Web, for example The WWW Virtual Library (started by Tim Berners-Lee, the creator of the web). Another great resource is Complete Planet, which calls itself “the front door to the invisible web”.
Searching the Deep Web can be fun and interesting for any extreme searchers out there. In reality, however, most businesses do not want their website to be stuck in the invisible web or for any of their pages to be inaccessible – even temporarily! To ensure that this doesn’t happen, it’s important to optimise your site and to ensure that it is visible to search engines and the public.
For more information regarding Search Engine Optimisation, Link Building, and ways to ensure your content is visible contact us today!