Donate to us via Paypal!
Capitalism is an Island of wealth in a sea of poverty
Saturday, July 04, 2020
Navigation
Home
 Find:
 Information:
Learn
Communicate
Submit
Shop
Challenges
 Exploit:
 Programming:
 Think:
 Track:
 Patch:
 Other:
 Need Help?
Other
Members Online
Total Online: 54
Guests Online: 51
Members Online: 3

Registered Members: 127015
Newest Member: FOUr
Latest Articles

View Thread

HellBound Hackers | Computer General | Web hacking

Author

robots.txt

CroMonster
Member



Posts: 12
Location:
Joined: 28.05.14
Rank:
Mad User
Posted on 19-12-14 19:38
Hello, how can I exploit a robots.txt directory? For example: www.randomwebsite.com/robots.txt
All I see is Useragent: * and then Disallow and whatever is after that.
So, how can I use this to my advantage?


www.danasoft.com/sig/151772485114.jpg
2 O
Author

RE: robots.txt

Huitzilopochtli
Member



Posts: 1639
Location:
Joined: 19.02.13
Rank:
God
Posted on 20-12-14 00:44
Robots.txt is just information gathering, it contains directories that it's telling google not to index when it's crawling the Web , and they're not always linked correctly, so can sometimes be accessed.

You can also sometimes access content normally meant for logged in users only, by swapping your useragent for one of the allowed ones.

Edited by Huitzilopochtli on 20-12-14 02:38
Author

RE: robots.txt

CroMonster
Member



Posts: 12
Location:
Joined: 28.05.14
Rank:
Mad User
Posted on 20-12-14 15:36
Thanks for the infoThumbs Up


www.danasoft.com/sig/151772485114.jpg
2 O