Crawler for expired domains

$30-250 USD

クローズ

投稿日:

約10年前

$30-250 USD

完了時にお支払い

I am looking for a guy who can create a polite python crawler to find expired domains. Following functionality: (1) Indexing domains - Crawler crawls through the web and saves domainnames in a database - There shall be the setting opportunity just to crawl domains with a certain ending (2) Checking website status - Another crawler regularly and automatically visits the domainnames saved in database - By using HTTP-Header-Status or other ways, it shall be checked whether is domain is indexed in the nameservers (3) Displayment of domains - In case the domain is not in the DNS entries anymore, the pagerank of the domain is checked - Furthermore, the validity of the pagerank is checked These two parameters are then set in a list. PLEASE JUST BID IF YOU CAN COMPLETE FULFILL THE REQUIREMENTS!

MySQL

PHP

Python

Software Architecture

プロジェクト ID: 5469240

プロジェクトについて

4個の提案

リモートプロジェクト

アクティブ 10年前

お金を稼ぎたいですか？

メールアドレス

Freelancerで入札する利点

予算と期間を設定してください

仕事で報酬を得る

提案をご説明ください

登録して仕事に入札するのは無料です

この仕事に4人のフリーランサーが、平均$264 USDで入札しています

@suraj99p

I have made web crawlers in past. I have very good understanding of requests and https communication. I have more than 4 years of professional experience. I can do this job

$250 USD 5日以内

4.8

(11 レビュー)

4.7

@smellyfinger

I have a lot of experience in Python scraping and MySQL. I think we can obtain the pagerank through some online service that doesn't employ bot-protection, or some other way. I am really interested and I'll do my best to get it done. Thanks

$222 USD 3日以内

5.0

(1 レビュー)

2.2

@ardhendusaha

We are working for last 5 years in this field. Many best Web Developers are working as a team. We will delivered the best quality product on time. If you want see our work we will send you the sample. Please give us a chance to work with you

$222 USD 7日以内