Thursday, October 24
11:35-11:55 AM
Las Vegas Ballroom 4

These Aren't the Droids You're Looking For: Anticipating Participant Mind Tricks in Pilot Study Feedback Responses

Best Practices Session ID: 40639
  1. aaa
    James Hatten
    National Center on Educational Outcomes
  2. Laurene Christensen
    National Center on Educational Outcomes

Abstract: The motion picture Star Wars features a famous scene where a Jedi mentor shows off his skills to get a foe to repeat his wants: "These aren't the droids you're looking for ..." Researchers and instructional designers often find participants in pilot studies give feedback that may be an attempt at a similar mind trick. Participants responses tended to focus on other aspects other than content when asked about content; design when asked about content -- their minds confused by the interplay of the two. How can the merge be avoided? Should it be? What practices best inform effective feedback? The authors, researchers working on the IVARED (Improving the Validity of Assessment Results for English Language Learners) Project gathered feedback upon release of their five-part online module. Lessons learned from their pilot studies are presented in this session. They include suggestions for those creating, conducting, and deciphering pilot or usability feedback for online training modules.

Presider: Eileen Dittmar, Capella University


Conference attendees are able to comment on papers, view the full text and slides, and attend live presentations. If you are an attendee, please login to get full access.