Need the following site scraped: [login to view URL] Select state from the dropdown and you will be taken to 20 random records. After scraping these records, you will need to refresh the page and scrape the new 20 random records that will appear. A refresh for each state/province needs to be done a minimum of 10 thousand times. After all states are completed, duplicates need to be removed. A sample needs to be delivered within 3 days of acceptance of bid. Site should not block, but a FAST INTERNET CONNECTION is needed for all the refreshes. Possibility of more work in the future.
## Deliverables
Sample file is attached. All fields need to be in the final data set. Please pay attention to how each record can have a different number of lines. Notes about fields: Searched_State: what was selected in the dropdown on the search page Full_Name: this line will be bold and is usually the first line of a record block First_Name: first name of full name Last_Name: last name of full name Title: this line will be italicized if there Company: will be right above address if there Address: this could be on two lines. if so, put into one line with a space in between City: same line as the abbreviation of the Searched_State State: abbreviation of the Searched_State Zip: could be longer than 5 characters Work_Phone: will be labeled Fax: will be labeled Chapter: will be labeled E-mail: will be labeled Practice_Area: will be labeled