Join us at IRC!
Society leans ever heavily on computers, if you have the power to take out computers you can take out society. - cubeman372
Thursday, May 17, 2012
Navigation
Members Online
Total Online: 29
Web Spiders: 14
Guests Online: 27
Members Online: 2

Registered Members: 70043
Newest Member: nixium
Latest Articles

Look, I'm the google bot.



FLV Blaster - Download Music and Videos Faster

website security A short description of how appearing to be the google bot can grant you access to forums and such without needing to register.



What you'll need:
Firefox,
The Modify Headers extension for firefox.

What you can do:
Many sites allow google to look into their forums, in order to get more traffic by getting more google search results. By pretending to be the google search indexer (aka spider, bot) we can access parts of these sites off limits to guests.

Example URL:
http://www.tuts4you.com/forum/index.php?showtopic=9959
I found this address today doing a google search, and noticed that although I didn't have access, google had a cached version. Head over to this url, and you should get the same error as me.

First, head over to google and type in 'browser headers'. The first link should take you to a page which gives you all the information your browser sends to web servers. This information, specifically the User-Agent field, is how the google bot tells web servers what it is. Go back to the google search, and click on the 'cached' link.

Notice in the 'User-Agent' field, where it once showed your browser info, now it says:
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Download the Modify Headers extension.
(http://modifyheaders.mozdev.org/)
And open it up. Next you need to make a rule, modifying the 'User-Agent' header to say 'Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)'
Once you're done, make sure it's enabled, and browse over to the example url. Even though you're not logged in, you should be able to browse their forums.

Let me know what you think.

Digitalchameleon

Comments

DarkMessiah on January 14 2008 - 23:49:39
There's also a way to do it with registry editing, HKCU\Software\Microsoft\Windows\CurrentVersion\Internet Settings
Hephaestus on January 15 2008 - 00:17:30
haha, fun stuff B)
What_A_Legend on January 15 2008 - 01:37:45
Access other sort of sites to if you know what I mean :p
korg on January 15 2008 - 09:43:28
Been using this for quite awhile, Sites that block you from viewing anything unless you join or Fuckin' pay (IE:Experts-exchange) Is bullshit. Works great. Also works on download sites that limit you also. @DarkMessiah You need to change these values in IE for this to work: HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet Settings\User Agent\Post Platform HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet Settings\5.0\User Agent HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Internet Explorer\Version Vector Change these reg. keys to the value you want to apply. Just remember to save your original (as always) to change them back. Great article for people who didn't know this.
korg on January 15 2008 - 09:44:25
^Nice line breaks guys thanks^
Uber0n on January 15 2008 - 12:29:26
It's not a new trick but it's definately a good one :)
root_op on January 15 2008 - 15:21:34
Awesome :D I had no clue about this, tested it a minute ago and works great :D Thanks for this article:happy:
digitalchameleon on January 15 2008 - 19:12:33
Didn't know about the registry hack. Have to remember that, for situations in which I am away from my computer.:D
mido on January 17 2008 - 16:53:40
I loved that article. Very good (rating).
DarkMessiah on January 18 2008 - 19:12:56
@korg yeah i thought there was more than one key but i've been using the ff extension
Uber0n on January 22 2008 - 11:56:45
User Agent Switcher ftw ^^ https://addons.mozilla.org/en-US/firefox/addon/59
Zephyr_Pure on January 25 2008 - 03:00:48
@korg, it's real easy to view Experts Exchange using the Noscblockedript extension... just scroll to the bottom of the page, and all the answers are there after the b.s. "you must join to see the answer" messages. Javascblockedript for the loss! :p @DC... cute trick. Might have to give it a whirl to see what I can make of it. Article actually covered material that wasn't already covered on here, so I have to give it an 'Awesome' for originality.
digitalchameleon on January 26 2008 - 06:04:03
It is true that the worst content here receives the most attention. I have many better articles.
digitalchameleon on January 29 2008 - 21:46:44
The downside of being the google bot: http://acronyms.thefreedictionary.com/
korg on January 30 2008 - 15:04:45
@Zephyr I'm on IE most of the time but thanks for the tip I'll have to try it.:D
alldatizholy on February 07 2008 - 12:29:11
i tried it on alot of sites and it dont work....http://www.gigposters.com/forums/premium-opportunities/61653-radio-publicity.html
alldatizholy on February 07 2008 - 12:32:00
i tried it on alot of sites and it dont work....http://www.gigposters.com/forums/premium-opportunities/61653-radio-publicity.html
alldatizholy on February 07 2008 - 12:37:58
lol nvm...it only works on very few websites...lolz
pino on February 20 2008 - 23:06:37
Most sites have noticed the googlebot uses only a limited amount of ip addresses. They filter on that now. Maybe yahoo or altavista or some other search engine spider still works. That would be interesting to find out.
Danjun on June 19 2008 - 09:27:29
Nice dude. yeah maybe this is my first comment on any article lol? :D
waxor on August 27 2008 - 18:53:58
nice trick:D
rohitashdhacker on May 17 2009 - 22:02:22
nice man ,too helpful
Post Comment

Sorry.

You must have completed the challenge Basic 1 and have 100 points or more, to be able to post.
Ratings
Rating is available to members only.

Please login or register to vote.

Awesome! 28% [5 Votes]
Very Good 56% [10 Votes]
Good 11% [2 Votes]
Average 0% [No Votes]
Poor 6% [1 Vote]
Guest
Username

Password

Remember Me


Bookmark This Page
Affiliates
Adverts

 

 

Links
By using, viewing or obtaining any information contained on this site, you agree to the disclaimer.

© HellBound Hackers 2008- 2009. Since 3rd December 2004.