Classified Crawler or Scraper

I need a custom crawler setup to automatically search up to 15 URLs at different times during the day for different keywords. Please email for a list of the websites. Websites include major classified sites but also some other smaller newspapers and online forums. This project could be longer term since this might need troubleshooting and I am adding new URLs periodically.

I am only interested in the most recent postings and ads, def. nothing older than 2 or 3 days.

If you have experience with this or can point me to a service that already exists I would appreciate it. Please include your past experience or sample of your work with your bid.

Currently, I use RSS feeds to retrieve data from some websites but I am open on how it is delivered to me or the user interface.

If you can create a custom scraper for each website that works as well since some of my queries are pretty broad and simple keyword search doesn't work for some websites. Your suggestions are welcome.

In the long run, I am also interested in applying the above to social networking sites (automated keyword search).

Thanks !

MySQL PHP ソフトウェアアーキテクチャ

プロジェクトID: #1623852

プロジェクトについて