We're looking for a team that can build a scraping program for different websites. Its based on the following ideas:
- It has to run 24/7
- The program should be able to monitor all websites simultaneously (around 5)
- As soon as there are any website changes (new product, sizes restocked,..) the program should send a notification to a discord channel
- It should be able to support proxies
- It should be able to filter website changes with keywords (the program should only send a notification when there's a reliable product restocking. The notification should display: Link, Image of Product, Add to Cart Links, Sizes in Stock)
- preferably written in python with the scrapy module.
- It should be as fast as possible
- I must be able to configure the program to certain sites as well as certain keywords.
- The program will check against keywords in the product titles as well description/title.
- The product should be licensed to me and you should be able to give me further support.
- I will most likely be looking to scale this program into bigger as soon as there are more websites i want to scrape
Please reach out to me, if you're interested in my project. This is a big project and I want a experienced developer team.
ready to make a free sample for this work. i have good experience as a scrapper and you can check out my profile and reviews. we can discuss more if you want to. thank you.