11/04 - Hooray Thursday!

bugeekman · Nov 4, 2021

Martín Abreu Zavaleta [A3R9VWE5WLIY9S] Study about linguistic communication (survey, 5-10 minutes) - $1.00 | PANDA

Unrated

Unrated

Unrated
$26.87 / hour
00:02:14 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Participated_RI DoesNotExist ; HIT approval rate (%) > 98; Total approved HITs > 5000;

To read Martín Abreu Zavaleta's full profile check out TurkerView!

ChrisTurk · Nov 4, 2021

bugeekman · Nov 4, 2021

UPenn Researcher [A2M70XENI0CWIR] Behavioral Survey(~ 2 minutes) - $0.30 | PANDA

Unrated

Unrated

Unrated
$15.43 / hour
00:01:10 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; cbabc011 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read UPenn Researcher's full profile check out TurkerView!

Joshua Brown · Nov 4, 2021

Abolfazl Keshavarzsaleh [A2IQKKXJGQA8Q1] 5 Minutes consumer survey (~ 5 minutes) - $0.75 | PANDA

Good

Unrated

Unrated
$11.30 / hour
00:03:59 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 5 minutes ago)
Qualifications: Exc: [10192646-328384] DoesNotExist ; CR Research Group #1 >= 100; Location In US;

To read Abolfazl Keshavarzsaleh's full profile check out TurkerView!

Joshua Brown · Nov 4, 2021

Baltimore Behavioral Lab [A2ICH3UFWVRXNA] short survey(~ 5 minutes) - $0.60 | PANDA

Unrated

Unrated

Unrated
$6.12 / hour
00:05:53 / completion time

Pros:

Cons:

Catchability: Expiring Soon (HIT Last Seen: 23 minutes ago)
Qualifications: Total approved HITs >= 100; Exc: [328814-328225] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read Baltimore Behavioral Lab's full profile check out TurkerView!

Joshua Brown · Nov 4, 2021

Julia Minson [A35QRRKSLEDRZA] survey about decision making (opportunity for bonus)(~ 5 minutes) - $0.50 | PANDA

Generous

Unrated

Unrated
$15.65 / hour
00:01:55 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 6 minutes ago)
Qualifications: Exc: [328981-328392] DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 98; CR Research Group #1 >= 100; Location In US;

To read Julia Minson's full profile check out TurkerView!

Joshua Brown · Nov 4, 2021

Ben Peterson [AFEG4RKNBSL4T] Rate Dating Profile Photos of Women - $0.03 | PANDA

Generous

Unrated

Unrated
$27.00 / hour
00:00:04 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: one minute ago)
Qualifications: Location In AU, CA, GB, IE, NZ, US; BP Group B EqualTo 4; BP Qual EqualTo 4; HIT approval rate (%) >= 95; Adult Content Qualification EqualTo 1;

To read Ben Peterson's full profile check out TurkerView!

Joshua Brown · Nov 4, 2021

Ben Peterson [AFEG4RKNBSL4T] Rate Social Profile Photos - $0.03 | PANDA

Generous

Unrated

Unrated
$27.00 / hour
00:00:04 / completion time

Pros:

Cons:

Catchability: Unlikely (HIT Last Seen: 5 minutes ago)
Qualifications: Location In AU, CA, GB, IE, NZ, US; BP Qual EqualTo 4; Adult Content Qualification EqualTo 1;

To read Ben Peterson's full profile check out TurkerView!

lapetitebaker · Nov 4, 2021

UPenn Researcher [A2M70XENI0CWIR] Behavioral Survey(~ 2 minutes) - $0.30 | PANDA

Underpaid

Unrated

Unrated
$10.38 / hour
00:01:44 / completion time

Pros:

Cons:
• One question per page

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; cbabc011 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read UPenn Researcher's full profile check out TurkerView!

Random Turker · Nov 4, 2021

UPenn Researcher [A2M70XENI0CWIR] Behavioral Survey(~ 2 minutes) - $0.30 | PANDA

Good

Unrated

Unrated
$11.87 / hour
00:01:31 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; cbabc011 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read UPenn Researcher's full profile check out TurkerView!

AlexZ · Nov 4, 2021

total said: ↑

CloudResearch is Retiring the “Block Low-Quality Participants” Option

Starting November 1, 2021, CloudResearch will be retiring the Block Low-Quality Participants feature we created in 2020 and continuing with our CloudResearch-Approved Participants option. In this blog, we explain why we’re making this change and what it means for researchers.

Why Are We Removing the Blocked List?
Since Spring 2020, CloudResearch has been engaged in continuous vetting of people on Mechanical Turk. As participants pass through our vetting measures we pair their data with information provided by researchers and make a decision about how likely people are to provide quality data in future studies. People who we think will provide quality data are placed on our Approved List and those who are likely to provide poor data are blocked.

The main reason we are removing the Block Low-Quality Participants feature is because our Approved List is now large enough to handle all studies. Originally, we were concerned that large studies, studies targeting specific groups of participants, or studies with other sampling limitations would be slow to gather data. This is no longer the case. The Approved List now has over 75,000 people and we add new participants each week. As a result, there are enough participants of various demographic groups and levels of experience that the Approved List can support all studies.

Another reason we are removing the Block List option is to better control quality. When researchers run a study using the Block Low-Quality Participants option, everyone CloudResearch has vetted and found to provide suspect data is ineligible for the study (currently over 40,000 accounts!). However, when a study is run using the Blocked List, CloudResearch doesn’t control what proportion of the sample is made up of people on our Approved List or people we’ve never vetted. Because people we’ve never vetted may provide poor data, the Blocked List gives us less control over quality than the Approved List which only includes people we have vetted.

What Effect Will This Change Have on Research?
We do not expect the removal of our Blocked List to affect the viability or speed of research studies. There is also no change in cost to researchers.

As noted above, the Approved List now has over 75,000 participants, and over the last year and a half more than 33,000 studies have been conducted using the Approved List. Supplemental data in our latest preprint show that the demographics of people on the Approved List match those of the U.S. MTurk population well. Thus, we think of our Approved List as an option researchers can use to sample high-quality participants within the US and as a way to restore MTurk to what it was before 2018 when concerns about foreign workers, “bots,” and low-quality data emerged.

Maybe those with CR #2 are going to have their qual removed? Could be good news for some of you, though I'm speculating here given what the above says
Click to expand...

Now that I think about it, this actually gives a pretty decent estimate of how many active turkers there are on the platform, since I would assume most of them have managed to either get CR #1 or land in the blocked list with one of those quals (either CR #2 or something else).

So they say they have 75,000 people whitelisted and 40,000 people blocked, for a total of 115,000 MTurk accounts. So it's probably not a huge stretch to say there are a minimum of 115,000 at least semi-active turkers on MTurk.

That's actually crazy to think about. 115k turkers and only a handful of them on this forum.

Where the heck are those others then? What are they doing? Where do they get their turking information? What kind of lives do they live? Are they all criminals?

OldBoy65 · Nov 4, 2021

UPenn Researcher [A2M70XENI0CWIR] Behavioral Survey(~ 2 minutes) - $0.30 | PANDA

Unrated

Unrated

Unrated
$9.00 / hour
00:02:00 / completion time

Pros:
fair
paid instantly
Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; cbabc011 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read UPenn Researcher's full profile check out TurkerView!

MEC · Nov 4, 2021

UPenn Researcher [A2M70XENI0CWIR] Behavioral Survey(~ 2 minutes) - $0.30 | PANDA

Underpaid

Unrated

Unrated
$6.28 / hour
00:02:52 / completion time

Pros:

Cons:
This requestor can be very hit or miss on the hourly rate. This one was sadly a miss. If it paid more it would have been fine.

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; cbabc011 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read UPenn Researcher's full profile check out TurkerView!

MEC · Nov 4, 2021

PickFu [AI2HRFAYYSAW7] Compare 2 options, 1 written response - $0.17 | PANDA

Generous

<24 hours

Unrated
$32.21 / hour
00:00:19 / completion time
Approved!
Pros:

Cons:

Catchability: Great (HIT Last Seen: 7 seconds ago)
Qualifications: PickFu NDA EqualTo 1; Wine In 1; TWL >= 10; Location EqualTo US; Amazon Prime Membership In 1;

To read PickFu's full profile check out TurkerView!

MEC · Nov 4, 2021

Receipt Processing [AGVV5AWLJY7H2] Are these receipts the same? - $0.01 | PANDA

Low

Unrated

Unrated
$6.00 / hour
00:00:06 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: HIT approval rate (%) > 95; Total approved HITs > 5000;

To read Receipt Processing's full profile check out TurkerView!

MEC · Nov 4, 2021

PickFu [AI2HRFAYYSAW7] Rank 4 options, 1 written response - $0.23 | PANDA

Fair

<24 hours

Unrated
$8.63 / hour
00:01:36 / completion time
Approved!
Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: PickFu NDA EqualTo 1; TWL >= 10; Location EqualTo US; Amazon Prime Membership In 1;

To read PickFu's full profile check out TurkerView!

MEC · Nov 4, 2021

PickFu [AI2HRFAYYSAW7] Rank 4 options, 1 written response - $0.24 | PANDA

Generous

<24 hours

Unrated
$14.64 / hour
00:00:59 / completion time
Approved!
Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: PickFu NDA EqualTo 1; Gender In 2; TWL >= 10; Location EqualTo US;

To read PickFu's full profile check out TurkerView!

malysa · Nov 4, 2021

Shai Davidai [A20Y9FE67UT2M5] Tell us what YOU think!(~ 4 minutes) - $0.50 | PANDA

Unrated

Unrated

Unrated
$8.22 / hour
00:03:39 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 500; Exc: [1271325099-328401] DoesNotExist ; HIT approval rate (%) >= 98; CR Research Group #1 >= 100; Location In US;

To read Shai Davidai's full profile check out TurkerView!

GoldGuardian · Nov 4, 2021

@ChrisTurk Finally cold enough for me to stop wearing shorts...

...but not cold enough to turn the heat on

Moonstone · Nov 4, 2021

11/04 - Hooray Thursday!

bugeekman Active Turker TurkerView Masters

ChrisTurk Administrator

bugeekman Active Turker TurkerView Masters

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

lapetitebaker Survey Slinger TurkerView Masters

Random Turker Survey Slinger TurkerView Masters

AlexZ Distinguished Butthat The Prophet

OldBoy65 Active Turker

MEC Active Turker

MEC Active Turker

MEC Active Turker

MEC Active Turker

MEC Active Turker

malysa Survey Slinger TurkerView Masters

GoldGuardian Black Order

Moonstone Active Turker

About TurkerView Forum

11/04 - Hooray Thursday!

bugeekman Active Turker TurkerView Masters

ChrisTurk Administrator

bugeekman Active Turker TurkerView Masters

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

lapetitebaker Survey Slinger TurkerView Masters

Random Turker Survey Slinger TurkerView Masters

AlexZ Distinguished Butthat The Prophet

OldBoy65 Active Turker

MEC Active Turker

MEC Active Turker

MEC Active Turker

MEC Active Turker

MEC Active Turker

malysa Survey Slinger TurkerView Masters

GoldGuardian Black Order

Moonstone Active Turker

Useful Searches