These Aren't the Droids You're Looking For: Anticipating Participant Mind Tricks in Pilot Study Feedback Responses

ID: 40639 Type: Best Practices Session
  1. James Hatten and Laurene Christensen, National Center on Educational Outcomes, United States

Thursday, October 24 11:35-11:55 AM Location: Las Vegas Ballroom 4 View on map

Presider: Eileen Dittmar, Capella University, United States

Abstract: The motion picture Star Wars features a famous scene where a Jedi mentor shows off his skills to get a foe to repeat his wants: "These aren't the droids you're looking for ..." Researchers and instructional designers often find participants in pilot studies give feedback that may be an attempt at a similar mind trick. Participants responses tended to focus on other aspects other than content when asked about content; design when asked about content -- their minds confused by the interplay of the two. How can the merge be avoided? Should it be? What practices best inform effective feedback? The authors, researchers working on the IVARED (Improving the Validity of Assessment Results for English Language Learners) Project gathered feedback upon release of their five-part online module. Lessons learned from their pilot studies are presented in this session. They include suggestions for those creating, conducting, and deciphering pilot or usability feedback for online training modules.

Topics

Conference attendees are able to comment on papers, view the full text and slides, and attend live presentations. If you are an attendee, please login to get full access.