Showing posts with label Research Tools. Show all posts
Showing posts with label Research Tools. Show all posts

 



"Willy-nilly... existing autism research findings, and the resultant therapies and educational strategies, have been applied across the board to all autistics.

Unfortunately, a lack of success in therapies not suited for you in the first place, leads to negative downstream impacts such as being placed in low expectations classrooms, the closure of opportunities, and less than positive lifetime outcomes."
-Hari Srinivasan, Time


VR Research Cave

With lab mates from Wallace Lab helping set up the VR immersive environment cave being installed at my research lab.

I'm going to get to use this cool tech in my research design to study sensorimotor issues in autism. 

Attention Check Questions

In my grad school journey or learning to do research, I come across many interesting concepts. Here's one.

Attention check questions, sometimes called validity checks or instructional manipulation checks, are typically included in a survey or questionnaire to ensure that respondents are reading and fully understanding the questions. They serve as a way to assess whether participants are paying attention and not just rushing through or randomly answering questions in order to collect payment. They help improve the reliability and validity of the data collected in a survey.

An example of a simple attention check question could be "Please select 'Somewhat agree' for this question." If a respondent doesn't select 'Somewhat agree,' it can be inferred that they aren't reading the questions carefully, which could invalidate their other responses.

More complex attention check questions might be embedded within the content of the questionnaire. For instance, you might ask a question where the correct answer is obvious or already stated in the questionnaire, or where the answer should be logically consistent with previous responses.

Such checks are important when you're conducting research that relies on self-reported data, as they can help you filter out unreliable responses. However, they should be used judiciously. If used excessively or inappropriately, they can frustrate participants or create bias in your results. They should not be designed to trick respondents or make them feel foolish, and respondents should be informed at the start of the survey that their responses will be checked for consistency and attentiveness

There's no hard and fast rule about where attention check questions should be placed in a questionnaire, as it often depends on the specifics of the questionnaire and the goals of the researcher. 

Some general guidelines

  • Spacing: For a lengthy survey, it may be good to sprinkle several attention checks throughout the survey. They shouldn't be too close together, as that might be annoying or confusing for the respondents. The goal is to check for consistent attention throughout the survey, so they might be placed at regular intervals. For example, if you have a 50-question survey, you could place an attention check question after every 10 or 15 questions.
  • Variety: of attention check question types means participants can't easily identify them and respond correctly without paying attention to the rest of the survey.
  • Placement in Context: The questions can sometimes be related to the subject matter of the survey. In this case, they should be placed where they make the most sense in the context of the other questions.
  • Randomization: If possible, randomizing the order of questions, including attention checks, can help avoid bias that might result from their position in the survey.
  • Placement in Important Sections: If there are certain sections of the survey where it is particularly important that respondents are paying attention (e.g., complex questions or key measures), it might make sense to include an attention check question immediately before or after that section.
  • Avoiding End or Start: At the start, respondents are usually more attentive, and at the end, they may be rushing to finish. Hence, these locations may not accurately capture the participant's overall level of attention.