With the web crawler you will be able to:
- Extract data from a site that is constantly updating its data ( like CNN News or Yahoo News )
- Build a search engine
- Download a huge amount of files from web pages like MP3 files, code ( zip files ) etc
- Build a monitoring bot that will alert you when specific conditions are met. For instance,
let me know when Nasdac is below a specific value.