I need you to write a web scraper that will be used to scrape 3 different websites for electronic components. The websites are [login to view URL], [login to view URL] and www.digikey.com. Later we will add more websites to the list.
Frontend: Lightweight Bootstrap website where the user can input the 'quantity' and the 'part number'. While scraping shows it is working and displays the results when done.
Backend: Scaleable scraper that communicates with frontend through REST API (JSON). Preferably something really scalable like Amazon lambda function etc. Must return error messages when unable to scrape and terminate after given time while communicating this back to the frontend. Proper API implementation!
The information returned and displayed must be:
1) Manufacturer
2) Manufacturer Part Number
3) Distributor Part Number (Farnell, Mouser, Digikey)
4) Description
5) Stocked Quantity
6) Datasheet URL
7) Product URL (link of the detail page)
8) Image URL
9) Price Breaks (quantity, price, currency)
You can test this by searching for "MAX810LEUR+T" on the 3 websites I listed above.
Hi there! I have read what you exactly need, however I would like to ask you a few questions. I would call myself a master of what I do, I do work smart and do not rest until I get the job done. Please feel free to ping me anytime so we can have a detailed discussion. If I can deliver I will deliver in best possible way. Thanks
Hi sir,
I am scraping expert, I have did too many similar projects, please check my feedback then you will know.
Can you tell me more details? then I will provide demo data for you.
Thanks,
Kimi
Hello
I am a full-time freelancer with much experience and high skills in Python / PHP / Bootstrap / Javascript / CSS / HTML5 / .. programming.
I understood your project requirements.
I am sure i can complete your project successfully.
No problem.
Can we talk about your project detail ?
Regards.
Hello,
I have 5 years experience in Web development and can do develop and designing work perfectly and professionally
I am ready to start the work right now.
Thanks,
Ankit
Good day I am a full time python programmer, I have done this type of job before and can have a sample done for you within an hour or two and the entire project complete within the specified time. You will only need to pay once I am done with the project and you are fully satisfied with my results. I am looking forward to working with you.
So you a web application that scrap and display data in the application, a forms to set parametres, after that we can send an AJAX request (REST API) to the websites sources to get and display data
I have implemented numerous web scrapers in Python. The bulk of the work lies in interpreting the web services provided by the target websites. I will accomplish this by interacting with the target sites while observing the behind-the-scenes web traffic. I will record numerous search sessions and replicate the web service calls using Python standard libraries.
I have created several REST API's using Python. This portion of the project will be accomplished using Flask; a lightweight Python web framework. The Flask application will need to be configured on a web server. I have experience with IIS, Apache, and Nginx and will be able to configure the scraper application.
A major component of the work will be the scalability requirement. To the best of my ability I will implement the scraper in a generic fashion such that a configuration file will describe the target site's api thus allowing additional sites to be added at a later date. This may be a difficult milestone as the target sites will not have homogeneous apis and deciphering a new target's api will require manual investigation.
