Please ask questions before bidding, if you do not ask any question but bid, you probably will not get the project :) Because it is complicated and I am not sure I can explain myself clearly in one page. I will update this description as necessary as the need arises.
The first bid will be for the Pilot Project only. But my intention in the whole project is laid out here. Most probably I will have 2 bidders if not 3 do the pilot project and again most probably the developer who delivers the best outcome (quality of work / time / budget / value for money) will get the rest of the project.
Be reachable and responsive with good command of English, be communicative.
Good level of PHP or Pyhton knowledge.
Has had experience in crawling projects and be able to show the expertise in previous projects.
The system will be built on AWS infrastructure, should have a good experience on how to use and maintain AWS infrastructure.
The database will be MariaDB.
This is a continuous data extraction (daily) project from [login to view URL]
The pilot project will involve data extraction from only one property.
Every day, the crawler will visit the designated Airbnb property and will check the availability and prices (this rate will be the basic rate for the property without any additional persons) for the next 366 days.
Compare the availabilities with the previous day, in case blocked days are found will record these days as the reservation with the most recent rate for that day.
Will also keep the most recent 3 rate changes on a particular day.
Rate Change will trigger an email with a message of Previous Rate and Current Rate.
Reservation will trigger an email with a message of Days with nightly rates + cleaning fee for that property.
The testing of the pilot project will last 21-30 days.
The database design should consider the upcoming phases of the project and should be very efficient in storing and displaying the data.
Thorough documentation will be required.
Once the pilot project is up an running we will go the phases of the project:
Phase 1: Add 1000 properties and get the data for these properties for 21-30 days. The bugs or problems (like banning from Airbnb or providing false results) will be fixed and move on to the next Phase.
Phase 2: Add 10,000 properties. Check the daily crawling times, expansion of AWS infrastructure and similar issues will be fixed.
Phase 3: All Airbnb properties will be covered.
Build a user-friendly reporting platform for paid users to access information that will be limited to their package.
A paid user can, for example select 5-10-20 or 50 properties (competitor properties) and will check their historical and future reservations and price changes.
Once all the properties on Airbnb is covered:
- the check of new properties / deleted properties
- Maintain the project throughout its life.
The whole project from the pilot to the end should be very well documented in English. Please foresee a budget for this phase without the proper documentation no funds will be released. In case, a new developer joins the project by reading the documentation and checking the code, s/he should figure out everything without asking any questions.
Dear I am an expert in web scraping. In before, I developed many spiders using python, scrapy. For example, I scraped data for CEOs(ebay, welivv, [login to view URL], [login to view URL] and so on). Thanks.
Hi sir what is your name ? i have understood your project description i am expert in php please message me so that we can start work i am waiting for response Thanks