Thank you for this video, it helped me greatly. I am currently in the process of posting my third survey and would like to share the following lessons I learned so far: - Despite what is being said in this video, I suggest that you do give every worker an individual code. It happened to me that some workers shared their codes with others and then I ended up with less participants than what I needed (and actually paying people who didn't do my survey...). - Look at your data and how long it took workers to go through the survey. MTurkers are generally quick because they are workers looking to maximize their income. But some workers go overboard with this. They may complete what should have been a 10-minute-survey in 2 minutes... This of course means that their data is essentially useless and they need to be rejected. - Unless you need your data very quickly, I suggest to allow for 3 hours or more in the "Time allotted per worker" section. That part has nothing to do with the duration of your survey (or how quickly workers answer it), but the time workers have to submit the hit. A generous time allows workers to queue the work up, complete the rest of the tasks they already have in the queue, then complete your survey without feeling rushed. It makes for higher quality data.
Thank you so for this video. I wanted to ask , do you randomly generate a number as a code to put in the last page of the survey in Qualtrics? Or is it done in MTurc? I’m confused as who generates the code and where to put it? I appreciate your feedback.thanks 🙏
So the link basically directs you to other services such as google forms/survio/ms forms, right? Amazon is to get the participants, or am I mistaken? I am asking, because I may need to use it soon.
Good question. One method to do this would be to use the Bonus function in MTurk. Here, you can pay individual people different bonuses, which could be based on the task in your situation. Of course, you’d need to make sure you tracked which person did which task.
The primary investigator on a research assignment I'm working on needs to specify a certain racial demographic and sexual orientation. Is there a way to make this a part of the criterion?
MTurk does not offer a built-in way to target on these two attributes. However, there are two alternatives you could pursue. One, you could include these desired characteristics in your description of the mTurk study (e.g., I’ve noted that I needed dog owners in a previous study, which proved successful). Second, and likely more appropriate in an academic setting, you could use an mTurk competitor called Academic Prolific (www.prolific.co/#check-sample). I have used them successfully on many occasions, and this panel is particularly common in Europe (as well as the US).
I followed every step you showed; however, it keeps showing "Layout does not contain any fields that include a name attribute. Please include at least one field with the name attribute (input, select or textarea) that will appear in your results." Do you have any idea why it shows? Thank you.
Sorry I missed this. This message indicates that mTurk doesn’t believe you have any data fields in the survey. If you chose the survey with a link template as in the video, then it should have a field for the person to enter the survey code. Unfortunately, I’ve seen strange behavior if you edit this entry field in any way (see 6:40 in video). I’ve even found that merely clicking in the field can confuse the mTurk design, which will result in this message. Hope that helps.
Can someone help me. When I follow this, I get an error, "You have exceeded your monthly credit limit, see FAQ for more information" and I don't get any payment option. Thank you.
Amazon has changed their payment process for new accounts on mTurk. As a result, this video will no longer apply in that case. Instead, they now process payments through AWS, so you’ll need to create an account for that. Personally, myself and many others now favor Academic Prolific (or Qualtrics) over mTurk as a research panel. This is mainly due to data quality and ease of usage. I haven’t created a video for Academic Prolific yet, but it’s a fairly intuitive interface. Hope that helps.
