Join us on Slack!
Imagination is more valuable than knowledge - Albert Einstein
Tuesday, June 18, 2019
Navigation
Home
 Find:
 Information:
Learn
Communicate
Submit
Shop
Challenges
 Exploit:
 Programming:
 Think:
 Track:
 Patch:
 Other:
 Need Help?
Other
Members Online
Total Online: 76
Guests Online: 73
Members Online: 3

Registered Members: 115197
Newest Member: piterJady
Latest Articles
View Thread

HellBound Hackers | Computer General | Web hacking

Author

robots.txt

CroMonster
Member



Posts: 12
Location:
Joined: 28.05.14
Rank:
Mad User
Posted on 19-12-14 19:38
Hello, how can I exploit a robots.txt directory? For example: www.randomwebsite.com/robots.txt
All I see is Useragent: * and then Disallow and whatever is after that.
So, how can I use this to my advantage?


www.danasoft.com/sig/151772485114.jpg
2 O
Author

RE: robots.txt

Huitzilopochtli
Member



Posts: 1618
Location:
Joined: 19.02.13
Rank:
God
Posted on 20-12-14 00:44
Robots.txt is just information gathering, it contains directories that it's telling google not to index when it's crawling the Web , and they're not always linked correctly, so can sometimes be accessed.

You can also sometimes access content normally meant for logged in users only, by swapping your useragent for one of the allowed ones.

Edited by Huitzilopochtli on 20-12-14 02:38
Author

RE: robots.txt

CroMonster
Member



Posts: 12
Location:
Joined: 28.05.14
Rank:
Mad User
Posted on 20-12-14 15:36
Thanks for the infoThumbs Up


www.danasoft.com/sig/151772485114.jpg
2 O