Magento Scrape products from Aliexpress Using PHPQuery & Cron
I need a scraper/crawler that can scrape specific aliexpress store. All products need to be scraped and all paginated pages.
The scraper will run using crontab every x minutes depending how we set the crontab.
It needs to save products in magento databases and images to specific folder. It can be done as a standalone system or a Magento extension, depends what you are most familiar with.
By default all products status must be set as disable until we manually review and enable them in magento.
I have the exact scraper working on Opencart. However I need one for magento.
It has to scrape all the following:
(i) Product title
(ii) Product Description
(iii) Product ID
(iv) Product URL
(vi) Shipping Cost
(vii) All images
It also has to check the product URL/ID at least every couple of hours. In case the product is no longer available, it should disable the product on Magneto in the database.
Also we should be able to set a margin profit that the scraper will add to the cost price. This new price will be our selling price.
For example, if we are scraping store1. We can set a profit margin on the price for this specific store.
The scraper must be able to run different instances/task to scrape multiple store and sync all the time to check price and availability.
An example here all products here has been scraped from aliexpress:
http://locean-indien.com/[url removed, login to view];category&path=17 ( scraped from http://www.aliexpress.com/store/all-wholesale-products/[url removed, login to view] )
http://locean-indien.com/desktops (scraped from http://www.aliexpress.com/store/all-wholesale-products/[url removed, login to view] )
The current scraper I have for opencart is using PHP query and crontab running 2 scripts every 5 minutes.
I’ll contact you via private message (REMOVED BY [url removed, login to view] ADMIN) and we can discuss. I can also provide access to the admin panel for the current opencart scraper for you to get a better understanding.
I've attached couple of screenshots of the current scraper.
Payment will be made upon completing of project.
Hello, Your project seems a perfect for me as I have all the skills to meet your requirement. I have some questions to ask you. Kindly message so we can discuss your project in details. Regards, Shahbaz