Find Jobs
Hire Freelancers

PHP / cURL Programming Guru needed for Data Scraping Project New or Update Old

$15-25 USD / hour

クローズ
投稿日: 5年以上前

$15-25 USD / hour

PHP / cURL Programmer needed for Data Scraping Project Update Several years ago, I hired someone from here to develop a data scraper for me. The scraper worked perfect for what we needed, then we got our IP blocked by the site we were scraping. The original writer was able to incorporate proxy IPs for the requests and it worked again. Then everything sat for a few years. So, we have all the original code sitting on the original site, and it doesn’t work today. Could be that the server was updated to higher level PHP (my guess is it was written in 5.x?), could be the db. is corrupted. I really don’t know. I have been tasked to get this back up and running. Ultimately, I need a data scraper that will pull multiple levels of information from [login to view URL] The result page will look like [login to view URL] We will need most of the variable information on this page. Additionally, On the bottom of the page is a link with personnel that needs to be followed. Following this link may produce multiple names and position information. In the case of the above it produces [login to view URL] which has only a single name. But in other examples it could potentially produce something like [login to view URL] Where it shows multiple names and positions with the company. The scraper will need to capture all this information and associate it with the appropriate license number. This data source changes daily (as new people get a license, as licenses expire, or become suspended because they did something wrong, or have a law suit brought against them). The most important will be the new additions to the db (which will be easy to find by just increasing the license number up one until you find the next license). These need to be found daily or every other day. But every record will need to be updated verified and updated once a week. We will need a way of pulling any recorded to which there was a change in the last week, even if it was as simple as correcting the spelling of a name. Maybe a field for last changed. SOOOO… I ether need someone to work with what we have OR create something new. With either option, you will need to create or provide complete documentation in such a manner that if you disappeared, the next developer could easily see what you did, why you did it, and how to correct it should we have problems in the future. This is the first of 10 sites that will need to be scrapped. It would be great if we could use the same engine on each one with minor location tweaks. If this goes well, we would ideally like to work with the same person ongoing for years to come.
プロジェクト ID: 17899877

プロジェクトについて

21個の提案
リモートプロジェクト
アクティブ 5年前

お金を稼ぎたいですか?

Freelancerで入札する利点

予算と期間を設定してください
仕事で報酬を得る
提案をご説明ください
登録して仕事に入札するのは無料です

クライアントについて

UNITED STATESのフラグ
Corona, United States
5.0
1
お支払い方法確認済み
メンバー登録日:10月 17, 2007

クライアント確認

ありがとうございます!無料クレジットを受け取るリンクをメールしました。
メールを送信中に問題が発生しました。もう一度お試しください。
登録ユーザー 投稿された仕事の合計
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
プレビューを読み込み中
位置情報へのアクセスが許可されました。
あなたのログインセッションの有効期限がきれ、ログアウトされました。もう一度ログインしてください。