09/21 - TurkerView.com Thursday!

Discussion in 'Daily mTurk HITs Threads' started by ChrisTurk, Sep 21, 2017.

Thread Status:
Not open for further replies.
  1. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    broken link?
     
  2. KaylaBayla

    KaylaBayla Active Turker

    Messages:
    172
    Gender:
    Female
    Ratings:
    +220

    Same here
     
  3. bulldozer10

    bulldozer10 Active Turker

    Messages:
    325
    Ratings:
    +395
    That's probably the only reason i did this.
     
  4. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,746
    Ratings:
    +163,330
    Question for the crowd:

    If a HIT is rejected, the hourly shouldn't be calculated - right? I'll still store the data in case the rejection is overturned, but I think it makes sense to not rate hourly for rejected HITs (same as only applying a "fast approval" rating to actual approvals).

    Si / no?
     
    • Like Like x 4
  5. Northdakotamom

    Northdakotamom Active Turker

    Messages:
    508
    Gender:
    Female
    Ratings:
    +662
    i would agree
     
  6. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    mine wasn't as involved, but message her too
     
  7. ThisPoorGuy

    ThisPoorGuy ThisPoorMod

    Messages:
    39,486
    Gender:
    Male
    Ratings:
    +81,571
    This sounds sane to me.
     
    • Like Like x 1
  8. AMindAtTurk

    AMindAtTurk Survey Slinger TurkerView Masters

    Messages:
    26,051
    Gender:
    Female
    Ratings:
    +39,565
    Yes :emoji_frowning2:
     
  9. ReaRea

    ReaRea Well-Known Turker

    Messages:
    3,700
    Gender:
    Female
    Ratings:
    +6,408
    Yes and no?
    Even if it was rejected, doesnt mean the next person will be rejected and they might want to know on average what the pay is
     
    • Today I Learned Today I Learned x 1
  10. Northdakotamom

    Northdakotamom Active Turker

    Messages:
    508
    Gender:
    Female
    Ratings:
    +662
    can we get some kasisto plz. thanks
     
    • Like Like x 1
  11. EssArrBee

    EssArrBee Survey Slinger

    Messages:
    14,946
    Gender:
    Male
    Ratings:
    +20,007
    I'm not sure I'm going to survive the mosquitoes in East Texas. I think there may be something in my moisturizer that attracts them or they want me because I'm from out of town and taste different. I have at least 20 bites right now.
    [​IMG]
     
  12. ThisPoorGuy

    ThisPoorGuy ThisPoorMod

    Messages:
    39,486
    Gender:
    Male
    Ratings:
    +81,571
    If you get rejected it might be because you did it too quickly or something so that would skew the hourly. I'm thinking it should only include HITs that got accepted for data integrity reasons.
     
    • Like Like x 1
    • Today I Learned Today I Learned x 1
  13. glossolalia

    glossolalia Survey Slinger

    Messages:
    3,131
    Gender:
    Female
    Ratings:
    +7,233
    Ermahgerd this TurkerView stuff! Seeing how many actual minutes I've worked is gonna be so helpful to me!
     
    • Like Like x 2
  14. dan

    dan daelian

    Messages:
    28,285
    Gender:
    Male
    Ratings:
    +61,817
    Title: Pitch Perception Experiment - Up to $5.05 BONUS possible for a total of $5.50 in 25-35 minutes | PANDA
    Worker: Preview | Accept | Requester
    Requester: McDermott Experiments [A19YWY6E1CP566] (Contact)
    TO 1: [Pay: 3.22] [Fast: 4.28] [Comm: 2.95] [Fair: 4.35] [Reviews: 144] [ToS: 0]
    TO 2:
    [Rate: $10.69/hr] [Pen: 1.33 days] [Res: -- of 0] [Rec: 80% of 5] [Rej: 0] [ToS: 0] [Brk: 0]
    Reward:
    $0.25
    Duration: 2 hours
    Available: 1
    Description: Complete a variety of short pitch perception experiments - making judgments about whether one note is higher or lower than another note
    Requirements: Total approved HITs is not less than 50; Location is one of: CA, US; HIT approval rate (%) is not less than 90
    HIT exported from Mturk Suite v1.25.7
     
    • Nom Nom Nom! Nom Nom Nom! x 5
  15. SoonerChris

    SoonerChris Survey Slinger

    Messages:
    5,033
    Gender:
    Male
    Ratings:
    +6,959
    You've received a bonus from Magy Seif El-Nasr for work related to 3TX9T2ZCB9PRDBUSK86D803T255ZW2.
    The value of your bonus is: $5.00 USD

    The Requester included this note:
    Reached objectives

    [​IMG]
     
    • 5/5 Pay 5/5 Pay x 1
  16. THFYM

    THFYM Survey Slinger Former MTG MotM

    Messages:
    8,887
    Gender:
    Male
    Ratings:
    +23,050
    I probably have an unpopular opinion on this, but I think it should be averaged in at $0.00 x MM:SS. Pay rate should reflect requesters making people waste their time and not get paid for it. If 100 people do a $5 hit in 1 minute each and 99 get rejected, the requester shouldn't have a $300 averaged hourly. Obviously an exaggerated example, but illustrative of a point.
     
    • Today I Learned Today I Learned x 2
    • Like Like x 1
  17. knottypiper

    knottypiper Survey Slinger

    Messages:
    5,776
    Gender:
    Female
    Ratings:
    +12,728
    Title: Describing Norovirus in the patient's words (2-3 minute task) | PANDA
    Worker: Preview | Accept | Requester
    Requester: Remote Care Mechanical Turk [A3UZF0F8TKM3ZQ] (Contact)
    TO 1: [Pay: 5.00] [Fast: 4.50] [Comm: 0.00] [Fair: 5.00] [Reviews: 9] [ToS: 0]
    TO 2:
    [Rate: $10.56/hr] [Pen: 4.00 days] [Res: -- of 0] [Rec: 50% of 2] [Rej: 0] [ToS: 1] [Brk: 0]
    Reward:
    $0.50
    Duration: 60 minutes
    Available: 1
    Description: Not Available
    Requirements: HIT approval rate (%) is greater than 98; Total approved HITs is greater than 5000; Location is US
    HIT exported from Mturk Suite v1.25.7
     
    • Nom Nom Nom! Nom Nom Nom! x 12
  18. knottypiper

    knottypiper Survey Slinger

    Messages:
    5,776
    Gender:
    Female
    Ratings:
    +12,728
    Title: Describing Flu in the patient's words (2-3 minute task) | PANDA
    Worker: Preview | Accept | Requester
    Requester: Remote Care Mechanical Turk [A3UZF0F8TKM3ZQ] (Contact)
    TO 1: [Pay: 5.00] [Fast: 4.50] [Comm: 0.00] [Fair: 5.00] [Reviews: 9] [ToS: 0]
    TO 2:
    [Rate: $10.56/hr] [Pen: 4.00 days] [Res: -- of 0] [Rec: 50% of 2] [Rej: 0] [ToS: 1] [Brk: 0]
    Reward:
    $0.50
    Duration: 60 minutes
    Available: 1
    Description: Not Available
    Requirements: HIT approval rate (%) is greater than 98; Total approved HITs is greater than 5000; Location is US
    HIT exported from Mturk Suite v1.25.7
     
    • Nom Nom Nom! Nom Nom Nom! x 11
  19. glossolalia

    glossolalia Survey Slinger

    Messages:
    3,131
    Gender:
    Female
    Ratings:
    +7,233
    I think this is a really good idea. It makes a lot of sense to me personally.
     
    • Like Like x 1
  20. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,746
    Ratings:
    +163,330
    What if it still showed the calculated hourly for the individual review (so if people go to the page for further details they'll have the info available to them), but wont be included in the aggregate so the on-mturk data isn't skewed since its harder to make an "informed decision" from that snapshot?

    hmm.. too sleep deprived to think this through.
    That's all Kerek :)
    Hmmm.. yupp, not enough sleep for math haha.
     
Thread Status:
Not open for further replies.