Find Jobs
Hire Freelancers

AWS , Google Cloud, Azure Expert please help. (100$) -- 4

$30-250 USD

クローズ
投稿日: 5年近く前

$30-250 USD

完了時にお支払い
Hello. thank you for having interest in this topic. *Please read description first thoroughly, if you're copy-pasting meaningless words I will instantly dump the proposal. Thank you * If you have experience in scraping/cralwing work, You know there's a capacity which one scraper one thread can be running. And in order to compensate this problem , we often adopt multi-threaded system inside of the script, But even when adopting this, We could be still having the same problem. This is why most of crawlers end up with using Cloud computer/servers , setting multiple virtual computer(server,cloud), setting multi-threaded script inside. Not necessarily to explain long about this, If you have experience, You'd definitely understand what I'm saying. I'm here to find decent future co-worker who has related skills to setup such environment and have experience to setup and build such models. Project price 100$ is related with the right next project we're going to jump on, that I will inform you through DM. (Direct message) or sending official offer. but beforehand, let me ask you questions. 1) Do you have experience multiple server/cloud/VM based scraping work? 2) If you have answers yes to 1), Could you show me a simple demonstration video about how it gets to be run? (No need to show script or inside-tricks, just on surface, simply the scenes that should be enough to prove it's working) 3) Did you also have experience with proxy-rotation adoptation? Please fill in the form with sending proposal. If our communication is not in exact form, We can not proceed any further. and I will kindly reject it all once it's not in the question form. Thank you.
プロジェクト ID: 20328456

プロジェクトについて

2個の提案
リモートプロジェクト
アクティブ 5年前

お金を稼ぎたいですか?

Freelancerで入札する利点

予算と期間を設定してください
仕事で報酬を得る
提案をご説明ください
登録して仕事に入札するのは無料です
この仕事に2人のフリーランサーが、平均$120 USDで入札しています
ユーザーアバター
1) Do you have experience multiple server/cloud/VM based scraping work? - Yes. I'm a certified Google Cloud Engineer having experience with web scraping (BeautifulSoup, Scrappy, Selenium in Python) and cloud orchestration through Ansible. 2) Could you show me a simple demonstration video about how it gets to be run? (No need to show script or inside-tricks, just on surface, simply the scenes that should be enough to prove it's working) - Yes. Make parametrized scripts that divide and conquer the work load. Especially on a multi VM worload. We wouldn't want VMs to be doing the same thing and in the event of a VM failure, the rest of the workload should continue processing. 3) Did you also have experience with proxy-rotation adoptation? No. But I am familiar with other methods of bypassing blockages that web scrapers may face. Can pick up this skill if necessary.
$100 USD 10日以内
0.0 (0 レビュー)
0.0
0.0
ユーザーアバター
Hello All, I like the requirement, I used to work such development before. I used to work with one product with multi-thread concept (HPC) with Clustering (Head Node and compute node) on on Premise Windows environment. It is similar to Kubernate container -orchestration. I like to share the details with discussion before selection my profile for the project. I have good understanding & experience on Azure environment and it working process. I have 13+ yrs of exp in .NET C# with Azure. Thanks you!!
$140 USD 7日以内
0.0 (0 レビュー)
0.0
0.0

クライアントについて

KOREA, REPUBLIC OFのフラグ
Incheon, Korea, Republic of
5.0
13
お支払い方法確認済み
メンバー登録日:2月 9, 2019

クライアント確認

ありがとうございます!無料クレジットを受け取るリンクをメールしました。
メールを送信中に問題が発生しました。もう一度お試しください。
登録ユーザー 投稿された仕事の合計
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
プレビューを読み込み中
位置情報へのアクセスが許可されました。
あなたのログインセッションの有効期限がきれ、ログアウトされました。もう一度ログインしてください。