Instructables
Picture of Web page scraping via Linux.

On of the most interesting things to do with linux is use the command line to do page scraping. You can hunt the web for the information you need without spending a a lot of time on-line. I also show you the pages where the data comes from.


 
Remove these adsRemove these ads by Signing Up

Step 1: Getting the terror level.

Picture of Getting the terror level.

Getting the threat level can be important to many people in the security business, You should not have to check a web page every time you need to know what it is.

lynx -dump "http://www.usasecure.org/threat.php" > threatlevel
cat threatlevel | grep "Current Threat Level:" > tl

cat tl

To send to twitter add:

twidge update < tl

$ ./gtl.sh
Current Threat Level: ELEVATED CONDITION

$