build scraper for [login to view URL]

完了済み 投稿 Mar 27, 2011 着払い
完了済み 着払い

This project will require you to use Perl/mechanize to scrape [url removed, login to view], which is an ASP.NET site.

Deliverable is a perl script.

You may use outside libraries like mechanize and your favorite html parser. I use mechanize but you can also use selenium if that works too (though I'd prefer mechanize, which would require you to sift through the javascript functions)

The script should basically continue what I've begun below. It should be able to plug in cities and dates from the home page, submit that form, then be able to extract the dates/times/prices. ( I will add code to insert that data into a database)

-----

Here's what I have so far... it doesn't work at all. I think the big thing is knowing the form elements, but there is also what appears to be a session id or something that changes each time you load the page.

#!/usr/bin/perl

use WWW::Mechanize;

use HTTP::Cookies;

use LWP::Simple;

my $url = '[url removed, login to view]';

$outpath = 'C:\Documents and Settings\My Documents';

my $mech = WWW::Mechanize->new();

$mech->cookie_jar(HTTP::Cookies->new());

$mech->get($url);

$mech->submit_form(

form_name => 'ctl01',

fields => {

'SearchAndBuy1_txtPassengers' => 1,

'SearchAndBuy1_ddlLeavingFrom' => 37,

'SearchAndBuy1_ddlTravellingTo' => 41,

'SearchAndBuy1_txtOutboundDate' => 4305

}

);

sleep 1;

$html = $mech->content();

$out = ">" . $outpath . '\\' . '[url removed, login to view]';

open(OUT, $out);

print OUT $html;

close(OUT);

print "done";

ASP パール ウェブ記事のスクラップ

プロジェクトID: #1000549

プロジェクトについて

9個の提案 リモートプロジェクト アクティブ Mar 29, 2011

アワード:

garygoog

HI ,I am data scraping expert .Please check PM.

$100 USD 15日以内
(25レビュー)
5.8

9人のフリーランサーが、平均$133 で、この仕事に入札しています。

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$100 USD 3日以内
(47件のレビュー)
6.5
srinichal

I am an expert in perl and I can deliver the code with perl

$100 USD 4日以内
(46件のレビュー)
6.3
gangabass

I can do this job for you. See PM for details.

$100 USD 3日以内
(165件のレビュー)
6.0
freelance4hire80

Hi, please check your PMB. Thanks.

$200 USD 3日以内
(26件のレビュー)
5.3
gocean

Hi jeffrono, please see our offer in the PM. Thanks.

$200 USD 5日以内
(9件のレビュー)
4.2
softwarevamp

Hello, glad to help you!

$150 USD 1日以内
(4件のレビュー)
3.5
PrestaWord

please see pm

$100 USD 0日以内
(0件のレビュー)
0.0
rajeevglobus

Please check PMB

$150 USD 7日以内
(0件のレビュー)
0.0