How to grab robots.txt file with Curl

fqKjLrdxrJ0/default.jpg

Twitter: @webpwnized

Thank you for watching. Please help! Up vote, subscribe or even support this channel at https://www.youtube.com/user/webpwnized (Click Support).

This video shows how to use the command line utility CURL to download robots.txt. Because CURL runs on Linux command line and is pre-installed on Kali, it is great for scripting commands with bash.

fqKjLrdxrJ0/default.jpg
How to grab robots.txt file with Curl How to grab robots.txt file with Curl Reviewed by Anonymous on February 03, 2018 Rating: 5