get in touch

The Invisible Web

The Invisible Web

The Invisible Web (Deep Web) refers to the expanse of information on the World Wide Web which is not indexed by Search Engines. Many people think search engines such as Google and Bing are the internet’s wisest oracles; the reality is that their web spiders follow hyperlinks and index pages… but are not omniscient! There are many places web spiders and crawlers can’t yet access – for example library databases, private networks and script-based pages… also known as “The Invisible Web”.

According to a white paper hosted on the University of Michigan’s website, the size of the Surface Web (Visible or Indexable Web) was estimated to be around 19 terabytes, whereas the size of the Invisible Web was estimated to be around 7,500 terabytes – and this was back in 2001. Mind boggling.

Because search engines only explore a very small proportion of the World Wide Web, the Invisible Web seems like a very tempting resource, especially if you are searching for something abstract or ambiguous. Google alone covers around 8 billion pages, but this pales into insignificance when one includes all this unseen information.

There are many tools and resources you can use to search the Deep Web, for example The WWW Virtual Library (started by Tim Berners-Lee, the creator of the web). Another great resource is Complete Planet, which calls itself “the front door to the invisible web”.

Searching the Deep Web can be fun and interesting for any extreme searchers out there. In reality, however, most businesses do not want their website to be stuck in the invisible web or for any of their pages to be inaccessible – even temporarily! To ensure that this doesn’t happen, it’s important to optimise your site and to ensure that it is visible to search engines and the public.

For more information regarding Search Engine Optimisation, Link Building, and ways to ensure your content is visible contact us today!


who are we?

Hex Digital is a full-service digital agency based in London Bridge. We build beautiful, scalable, functional websites and mobile applications. We also provide strategic marketing consultancy and fulfilment.

Categories

feel free to leave a comment...

latest news

thumb-hex

Over the past few months I have been trying to work on improving my time management. As an SEO, where time is spent creating value for the client, time management is an important skill to learn.

Well thought out timelines for each client can certainly help with project management, but … Read More »

...
read more
blogthumb-ides

Below is a simple and awesome way to look back on the progress of the race for the current US Presidential Election, using Google Trends, mixed with news headlines.
The graphs show – quite simply – a normalized representation of worldwide data for the search queries “barack obama” and “mitt romney” … Read More »

...
read more
thumb

The Invisible Web (Deep Web) refers to the expanse of information on the World Wide Web which is not indexed by Search Engines. Many people think search engines such as Google and Bing are the internet’s wisest oracles; the reality is that their web spiders follow hyperlinks and index pages… … Read More »

...
read more

get in touch today...

or give us a call, we're nice :)
0800 689 9250