Wednesday, April 25, 2007

Using A Webcrawler To Grab Images And Mp3's

A web crawler (also known as a web spider or web robot) is a program or automated script which browses the in a methodical, automated manner. Other less frequently used names for web crawlers are ants,automatic indexers, bots, and worms

With the web crawler you will be able to:

  • Extract data from a site that is constantly updating its data ( like CNN News or Yahoo News )
  • Build a search engine
  • Download a huge amount of files from web pages like MP3 files, code ( zip files ) etc
  • Build a monitoring bot that will alert you when specific conditions are met. For instance,
    let me know when Nasdac is below a specific value.
Check it out here.


No comments: