How to browse the web as GoogleBot or YahooBot

How to Browse the web as GoogleBot or YahooBotIn an earlier article we showed you How you can disguise yourself as the GoogleBot. Following the same lines, in this article today we will show you how you can very easily make your browsing session appear as if it was a GoogleBot or YahooBot. You might ask why you ever want to do this, strictly not to do anything illegal. Most websites do not block Search Engine bots to crawl their pages and for indexing purposes they definitely allow GoogleBot and YahooBot. Hence, if you are in a fix sometimes and you need to get to page where you have forgotten your user credentials, or if the particular web page needs you to register first etc, you can use this method to get to it in a jiffy.

In our example, we are including a proof of concept to demonstrate that the website does see you as GoogleBot or YahooBot. Note that for doing this exercise, you do not need to install any third party software or make any changes to your machine or browser settings. Here are the steps:

 1. Go to  the user agents website to check what your user agent and web browser is being reported by clicking here.Check for your user agent,  in this example, it clearly shows my browser information (FireFox) as well as my Operating System Platform (Windows 7)

Go to  the user agents website to check what your user agent and web browser is

2. Go to Be the Bot website here and punch in the following url to check what the user_agents finds your web browser as:
http://user-agents.my-addr.com/http_user_agent_info/what_is_my_user_agent_information/my_browser_user_agent_analyze.php

Go to Be the Bot website and punch in this URL

3. Notice it shows in results that your browser is now being detected as Googlebot!

Notice it shows in results that your browser is now being detected as Googlebot!

Similarly, you can choose the YahooBot option to disguise yourself as YahooBot