Create an Amazon Mechanical Turk qualification test using C#

Create a qualification and qualification test for Amazon Mechanical Turk

We have a spoken language testing product that rates user's speech on the following seven point scale:

1: Only some words are obviously recognizable. (Consistent pronunciation difficulties. Choppy, unnatural, many proficiency-related pauses.)

2: Some sentences are recognizable. (Some consistent pronunciation difficulties. Choppy, unnatural, many proficiency-related pauses.)

3: You are uncertain about some major points. (Unclear pronunciation. Awkward intonation.)

4: You understand major points, but miss some of the detail. (Unclear pronunciation. Not fluid.)

5: Comprehensible, but requires noticeable effort, and you may have missed some minor details. (Minor difficulties with pronunciation which may affect intelligibility. Not fluid.)

6: Comprehensible but with some effort. (Minor difficulties with pronunciation which do not affect intelligibility. Well-paced.)

7: Effortlessly comprehensible. There may still be a slight accent, but it requires no obvious mental effort.

We have posted some HIT's like this where the audio file is at an external link and the Turker must rate the file. Some Turkers are much better than others so we need a qualifiction test to find the best ones. The test consists of examples of speech sounds with correct scores so Turkers can see what is expected, then test sounds that they must score. The qualification test is to give a score, then mapped to a pass/fail.

Please provide AMT templates as per the documentation and C# .net code that call the Amazon API to post the qualification test. You will probably need an AMT sandbox account to test it.

I should be able to take your code and test data and run it to make the qualification test on my account by just changing account credentials.

The project must be completed within 5 days, please don't post longer than that.

Here is the data that should be in "freelancerdata.zip"
Here are the training samples, with example scores
Pool for Training:
app.fluentiq.com/recordings/audio_253117353__1443707726606.mp3
acceptable scores: 1,2
app.fluentiq.com/recordings/audio_334397112__1445833028220.mp3
acceptable scores: 2
app.fluentiq.com/recordings/audio_634016569__1443814400579.mp3
acceptable scores: 2,3
app.fluentiq.com/recordings/audio_495397468__1446749999017.mp3
acceptable scores: 3,4
app.fluentiq.com/recordings/audio_280526757__1445675789058.mp3
acceptable scores: 4
app.fluentiq.com/recordings/audio_0__1442773269728.mp3
acceptable scores: 4,5
app.fluentiq.com/recordings/audio_164612799__1445625231085.mp3
acceptable scores: 5
app.fluentiq.com/recordings/audio_370395043__1443221861522.mp3
acceptable scores: 6
app.fluentiq.com/recordings/audio_347750246__1446734334624.mp3
acceptable scores: 6

Pool for testing:
app.fluentiq.com/recordings/audio_330821839__1443192108863.mp3
acceptable scores 7
app.fluentiq.com/recordings/audio_0__1442807838490.mp3
acceptable scores 5
app.fluentiq.com/recordings/audio_0__1442682877773.mp3
acceptable scores 3
app.fluentiq.com/recordings/audio_665286786__1444154736619.mp3
acceptable scores 2,3
app.fluentiq.com/recordings/audio_17293453__1444324536740.mp3
acceptable scores 2,3
The qualification score for each test is 7-(how far their score was from the acceptable score)
For example for #2 where 5 was an acceptable score, if a Turker rated teh file as 7, then they would get a score of 7-(7-5) which is 5
and if they rated it as 2, then their score would be 7- (5-2) which is 4.
A score of 30 or above is a pass and the Turker would get the qualification.


Sample C# AMT connection code:
https://requester.mturk.com/developer/tools/net
Other documentation that may be of help:
http://docs.aws.amazon.com/AWSMechTurk/latest/AWSMechanicalTurkRequester/Concepts_QualificationsArticle.html
http://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkAPI/ApiReference_QuestionFormDataStructureArticle.html#ApiReference_QuestionFormDataStructureArticle-example
http://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkAPI/ApiReference_AnswerKeyDataStructureArticle.html#ApiReference_AnswerKeyDataStructureArticle-example
http://docs.aws.amazon.com/AWSMechTurk/latest/AWSMechanicalTurkRequester/Concepts_QualificationsArticle.html#qualification-tests

.NET C＃プログラミング ソフトウェアアーキテクチャ

プロジェクトID: #9544623

プロジェクトについて