Find Jobs
Hire Freelancers

DATA-SCRAPING SEARCH ENGINE - data scraping expert needed

$250-750 USD

処理中
投稿日: 9年以上前

$250-750 USD

完了時にお支払い
This is my website: [login to view URL] which was build by a freelancer.com member who has since been BANNED for being a scammer. [login to view URL] is a SEARCH ENGINE which scrapes data from a list of 150-200 websites selling watches. I need a data scraping expert to complete the search engine - which scrapes data from over 150-200 websites. These things are incomplete: a. DATA is not fetched from all 150-200 websites b. existing websites scraped is not consistently fetched data c. email alert function is not working d. email alert function admin panel to approve signups e. social media interface incomplete These are the comments from a data-scraping expert, which u need to fix: " Current setup is not flexible, we have to add a scrapping script for each of the URL we need to scrap for data, even if they are similar and just a pagination of the same website. So 2 scrips for [login to view URL] and [login to view URL] This needs to improve so it can autoscrap the other pages of the same URL, even if they do not exist now but will be added later There are about 35 files suppose to be executed to scrap all of the URL you have in the list. Have not confirmed if they have covered all of the URL as need to match them in each of the file. It is difficult to execute all of these 35 files manually and/or as cron jobs. It should be just one process which should scrap all of the pages. Database details are being defined in each of these files, and need to be updated in each of them in case later on you decide to change the password or want to setup on different host. Tiring :) Current setup is not suitable to run as cron jobs, as they are scrapping over 20 web pages within the single script, failure of one of them, will result failure of all. Current setup of scrapping is very slow, as it is done sequentially. So the next webpage can only be scrapped once the previous one completes successfully. Not all of the scrapping scripts are complete, as I can see for some Web URL they have incomplete codes inside. This means you are currently not getting the data from these web pages. For ex. [login to view URL] Jobs are being executed manually on browser, with a fixed page refresh limit. This is causing the pages to reload after the specified time and start from the start again. Due to that, the pages schedule to be scrapped down the page might not be executed in case the one above take longer then the reload time." If you wish to be hired, you must a. PROVE THAT you can make this website 100% functional b. SPEAK GOOD ENGLISH and can LISTEN well c ANTICIPATE client needs well. DO NOT only WAIT TO BE TOLD. d. be PROFESSIONAL and do what is needed to get the search engine up and running e. advise what hosting requirements are needed. this is the current plan: VPS 1180 [login to view URL] f. you must be the TECHNICAL PERSON - I DO NOT wish to speak to the BUSINESS DEVELOPMENT PERSON. g. Advise how FUTURE WEBSITES can be uploaded and data fetched from them. Thank you.
プロジェクト ID: 6279553

プロジェクトについて

19個の提案
リモートプロジェクト
アクティブ 10年前

お金を稼ぎたいですか?

Freelancerで入札する利点

予算と期間を設定してください
仕事で報酬を得る
提案をご説明ください
登録して仕事に入札するのは無料です
アワード者:
ユーザーアバター
Hi Shing, I am Sandeep. We spoke about your website on Skype. We have checked your requirements and we will surely be able to complete these tasks for you. We have done some research prior to sending this proposal to you. We have done similar project which you checked already. We can help you fetch data from all the websites unless there is a restriction. We will consult you on page load speed too. About consistency in html we have checked it at our end. We need to know how you wish to place things. It will need some evaluation. If you are taking data from 200 odd sites it may reduce speed and we therefore need to manage it well. Let me know your thoughts. We are keen to start.
$421 USD 21日以内
5.0 (2 レビュー)
3.6
3.6
この仕事に19人のフリーランサーが、平均$736 USDで入札しています
ユーザーアバター
Hi I have gone through the details of your project and we find it well within our capabilities. I offer a wide range of services, including Web design, PHP/MySQL web application development, Open sources like Joomla, Os-commerce, Zen cart-Drupal I can create and deliver the project as per the information.I have skilled, expert programmers I'm very excited to assist you in making your Sites successful – please feel free to contact me directly to discuss this position further. Thanks
$670 USD 20日以内
4.8 (270 レビュー)
7.4
7.4
ユーザーアバター
Hello, First of all, I am available for your project to start immediately. I am good in data scraping form other web pages. I can complete this task within 20 days for sure. I have experience of developing huge sites. Please message me if you wish to see my past work. I can give you great online store done. I will also available to you after completion of project for technical help/support. we can discuss price/time further here on chat. Here are some reasons to select my programming service. 1. I have 100% project completion rate, please read my reviews. 2. I have experience of developing huge and successful projects 3. I have strong team of web developers (size of 12 programmers) 4. I will give you daily work updates and you can see the development progress on my server regularly 5. I have experience of working with overseas clients from USA, SA, UK, Nederland, Australia. I am looking forward to work with you. thank you.
$833 USD 20日以内
4.8 (89 レビュー)
7.3
7.3
ユーザーアバター
I am an expert in delivering custom scripts and willing to discuss further about the project details/
$736 USD 10日以内
4.8 (102 レビュー)
7.1
7.1
ユーザーアバター
Hi, I have done a similar assignment before and would anticipate this would take me around 8 hours to complete. Im an EXPERT in scraping. Please send me a message if interested. Thank you.
$736 USD 0日以内
4.9 (39 レビュー)
6.3
6.3
ユーザーアバター
Hi, Thanks for alerting me for this project. We can handle it. Don't be worried. If you need more clarifications. Please be online on the Skype and let us have a chat too. we are also looking for more jobs from you. please keep on doing us your favor. Thanks & Regards
$631 USD 20日以内
4.9 (15 レビュー)
6.1
6.1
ユーザーアバター
Hello i have done a very similar project for another satisfied client which can be recalled here https://www.freelancer.com/projects/PHP-Javascript/Mid-sized-poker-portal-Javascript.4787356.html. The project was similar to this one with the changes that data type was xml instead of html and instead of watches the project was scrapping poker tournaments. The system we decide was a GUI solution on which with no code changes you can integrate any url which provides XML, and with drag and drop configuration configure the url for data, once configured you can set a duration to refresh data and the system automatically pulls data and removes duplicates and all stuff. Everything is done in GUI and no code changes for new feeds, and u also get alerts if a url data format(HTML in our case) changes so that scrapping cannot proceed without reconfiguration. The budget is higher than what you posted, but this solution would be a clean high level for u once done you wont have to work on it to add new links. If you are interested i can demo old system and discuss how we can proceed as well as provide you more technical information. Thanks and Regards, Jiby Jose
$2,222 USD 20日以内
4.9 (7 レビュー)
5.4
5.4
ユーザーアバター
Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Thanks, Priyanka
$789 USD 20日以内
5.0 (14 レビュー)
5.1
5.1
ユーザーアバター
I've expertise in web-scraping as my regular expression skills is quite high especially when working with PHP, i can do all the task with preg_match or preg_match_all to fetch all necessary data.
$500 USD 10日以内
4.9 (4 レビュー)
2.4
2.4
ユーザーアバター
A proposal has not yet been provided
$500 USD 10日以内
5.0 (3 レビュー)
1.9
1.9
ユーザーアバター
Hello, I am a new programmer here. I need some job examples, so it is the best I can offer - cheap price and nice quality. Waiting for your approvement and can't stand to start the job! I have an experience in data scrapping, can understand what you are looking for. I have also experience in VPS management and can handle all the stuff. If you want quality - message me up and approve :)
$488 USD 5日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
Hi, Thanks for your interests. Well, I will try my best to do the website functional as much as possible, hope to do 100%. I am able to do maximum automation via programming. I have good English spoken and listen ability. I am the technical person. Let me know, to move on your project. Regards! JS
$720 USD 15日以内
0.0 (0 レビュー)
0.0
0.0

クライアントについて

HONG KONGのフラグ
Hong Kong, Hong Kong
5.0
4
お支払い方法確認済み
メンバー登録日:6月 2, 2014

クライアント確認

ありがとうございます!無料クレジットを受け取るリンクをメールしました。
メールを送信中に問題が発生しました。もう一度お試しください。
登録ユーザー 投稿された仕事の合計
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
プレビューを読み込み中
位置情報へのアクセスが許可されました。
あなたのログインセッションの有効期限がきれ、ログアウトされました。もう一度ログインしてください。