Join us on Slack!
I'd prefer to die standing, than to live on my knees - Che Guevara
Thursday, December 12, 2019
Navigation
Home
 Find:
 Information:
Learn
Communicate
Submit
Shop
Challenges
 Exploit:
 Programming:
 Think:
 Track:
 Patch:
 Other:
 Need Help?
Other
Members Online
Total Online: 47
Guests Online: 46
Members Online: 1

Registered Members: 120846
Newest Member: robynio11
Latest Articles
View Thread

HellBound Hackers | Computer General | Web hacking

Author

robots.txt

CroMonster
Member



Posts: 12
Location:
Joined: 28.05.14
Rank:
Mad User
Posted on 19-12-14 19:38
Hello, how can I exploit a robots.txt directory? For example: www.randomwebsite.com/robots.txt
All I see is Useragent: * and then Disallow and whatever is after that.
So, how can I use this to my advantage?


www.danasoft.com/sig/151772485114.jpg
2 O
Author

RE: robots.txt

Huitzilopochtli
Member



Posts: 1624
Location:
Joined: 19.02.13
Rank:
God
Posted on 20-12-14 00:44
Robots.txt is just information gathering, it contains directories that it's telling google not to index when it's crawling the Web , and they're not always linked correctly, so can sometimes be accessed.

You can also sometimes access content normally meant for logged in users only, by swapping your useragent for one of the allowed ones.

Edited by Huitzilopochtli on 20-12-14 02:38
Author

RE: robots.txt

CroMonster
Member



Posts: 12
Location:
Joined: 28.05.14
Rank:
Mad User
Posted on 20-12-14 15:36
Thanks for the infoThumbs Up


www.danasoft.com/sig/151772485114.jpg
2 O