07/18 - Tantalizing Tuesday!

Title: Cyber Hygiene Knowledge and Behaviors of End Users | PANDA Worker: Preview | Accept | Requester Requester: pod [A24ALMLUW71BTM] (Contact) TO 1: Not Available TO 2: Not Available Description: A 15-20 minute survey measuring cyber hygiene knowledge and behaviors. Time: 1 hour HITs Available: 1 Reward: $1.40 Qualifications: Age - 30 - 35 EqualTo 1;

 

Spoiler: Mildly NSFW

 

Woohooo - the Constantinos G. V. Coutifaris rejections were overturned.

 

I'm not saying people will slow down necessarily, but good pay most likely means they won't speed up. Perhaps that's a distinction that not everyone will make but it certainly applies to me.

For example let's say there's an objective 1-10 scale measuring survey speed and inattentiveness. Let's say I measure a 6 on that scale on average. I'm doing a $1 survey and I just crossed the 10 minute mark. I'm now going at a rate of 8 or 9 on the speed / inattentiveness scale.

Alternatively, if theres a $5 survey with an estimated time of 15 minutes, I'm going to slow down a bit. Certainly that doesn't apply to everyone. Or even me at all times; I may be on a short timer or have a full queue.

I don't think they want those people, but I also think most requesters don't particularly care. Even if we discount the aspect of survey familiarity with turkers I'm not sure that you can count Mturk as a valid sample for a lot of research. There are several ways I can think of off hand where Mturk probably isn't a representative sample.

I think a lot of academic requesters are fine with collecting data as cheaply and efficiently as possible, even if that data is less than ideal on occasion.

For part 2, see above.

 

Title: Public Opinion Survey(~ 15 minutes) | PANDA Requester: Erin Cikanek [A3IRJYQCN98HEY] (TO) TO Ratings: ☢☢☢☢☢ 5.00 Communicativity ☢☢☢☢☢ 3.57 Generosity ☢☢☢☢☢ 5.00 Fairness ☢☢☢☢☢ 5.00 Promptness Number of Reviews: 14 (Submit a new TO rating for this requester) Description: Complete a survey about politics. Time: 45 minutes Hits Available: 1 Reward: $2.00 Qualifications: SurveyGroup [505] has not been granted; Exc: [-465488139-50576] has not been granted; Location is one of: US

 

Title: Paraphrasing | PANDA Worker: Preview | Accept | Requester Requester: Kasisto - Primary [A3G0QO2P6GWLSN] (Contact) TO 1: [Pay: 4.44] [Fast: 4.85] [Comm: 3.60] [Fair: 4.54] [Reviews: 40] [ToS: 0] TO 2: Not Available Description: paraphrasing sentences Time: 20 minutes HITs Available: 200 Reward: $0.07 Qualifications: HIT approval rate (%) GreaterThan 97; Location EqualTo US;

HIT exported from Mturk Suite v1.21.11​

 

Keep Asheville Weird

You are from Asheville right? I've been known to mix people up

 

Since ya know... setting quals on hits R hard and stuffz, I'll be sending this back. Rev your pandas ladies.

 

Title: Complete a short survey (~3 minutes) | PANDA Worker: Preview | Accept | Requester Requester: Claudia Townsend [A28TSWBXF1P7OO] (Contact) TO 1: [Pay: 3.28] [Fast: 4.74] [Comm: 5.00] [Fair: 4.88] [Reviews: 54] [ToS: 0] TO 2: [Rate: $3.26/hr] [Pen: -- days] [Res: -- of 0] [Rec: -- of 0] [Rej: 0] [ToS: 0] [Brk: 0] Description: Answer a short question survey and get paid $0.31 Time: 10 minutes HITs Available: 60 Reward: $0.31 Qualifications: HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US;

HIT exported from Mturk Suite v1.21.11​

 

Title: Verbal Picture Description 3 | PANDA Worker: Preview | Accept | Requester Requester: Claire Tang [A3J3AVZNAB6GAH] (Contact) TO 1: [Pay: 3.00] [Fast: 5.00] [Comm: 0.00] [Fair: 5.00] [Reviews: 3] [ToS: 0] TO 2: Not Available Description: Record a mp3 of you describing what's happening in a picture Time: 5 hours HITs Available: 1 Reward: $0.75 Qualifications: None;

HIT exported from Mturk Suite v1.21.11​

 

Title: Verbal Picture Description 1 | PANDA Worker: Preview | Accept | Requester Requester: Claire Tang [A3J3AVZNAB6GAH] (Contact) TO 1: [Pay: 3.00] [Fast: 5.00] [Comm: 0.00] [Fair: 5.00] [Reviews: 3] [ToS: 0] TO 2: Not Available Description: describing a picture verbally Time: 60 minutes HITs Available: 1 Reward: $0.75 Qualifications: None;

HIT exported from Mturk Suite v1.21.11​

 

Title: Verbal Picture Description 2 | PANDA Worker: Preview | Accept | Requester Requester: Claire Tang [A3J3AVZNAB6GAH] (Contact) TO 1: [Pay: 3.00] [Fast: 5.00] [Comm: 0.00] [Fair: 5.00] [Reviews: 3] [ToS: 0] TO 2: Not Available Description: Record a mp3 of you describing what's happening in a picture Time: 3 hours HITs Available: 1 Reward: $0.75 Qualifications: None;

HIT exported from Mturk Suite v1.21.11​

 

Eh, i somewhat agree with you guys... but i personally do take my time on well paying HITs. That TA hit yesterday was a good example, as soon as i saw people posting their completion times i started it. I didn't rush, or look at another page the entire time, even left a nice comment for em. Of course if you have no idea what the pay is going to be that's a different story.

 

As someone who works in academia, MTurk is absolutely not a good sample. However, where else are you going to find a large group of people willing to fill out a survey? There's definitely a market here. A big problem with research on this scale is finding people who are willing to help your cause. A lot of people at my university start by sending an email to the entire student population to ask for survey responses, but that definitely has a sample bias as well, plus the risk of not getting a lot back since there's no incentive.