How to grab robots.txt file with Curl
Twitter: @webpwnized
Thank you for watching. Please help! Up vote, subscribe or even support this channel at https://www.youtube.com/user/webpwnized (Click Support).
This video shows how to use the command line utility CURL to download robots.txt. Because CURL runs on Linux command line and is pre-installed on Kali, it is great for scripting commands with bash.
How to grab robots.txt file with Curl
Reviewed by Anonymous
on
February 03, 2018
Rating: