These Aren't the Droids You're Looking For: Anticipating Participant Mind Tricks in Pilot Study Feedback Responses
Abstract: The motion picture Star Wars features a famous scene where a Jedi mentor shows off his skills to get a foe to repeat his wants: "These aren't the droids you're looking for ..." Researchers and instructional designers often find participants in pilot studies give feedback that may be an attempt at a similar mind trick. Participants responses tended to focus on other aspects other than content when asked about content; design when asked about content -- their minds confused by the interplay of the two. How can the merge be avoided? Should it be? What practices best inform effective feedback? The authors, researchers working on the IVARED (Improving the Validity of Assessment Results for English Language Learners) Project gathered feedback upon release of their five-part online module. Lessons learned from their pilot studies are presented in this session. They include suggestions for those creating, conducting, and deciphering pilot or usability feedback for online training modules.
Presider: Eileen Dittmar, Capella University