Reflecting upon perceptual speed tests in information retrieval: limitations, challenges, and recommendations

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

2 Citations (Scopus)
185 Downloads (Pure)


Perceptual Speed (PS) is a cognitive ability defined by an individual’s accuracy and speed to scan information while completing visual search tasks. Prior studies using PS tests have demonstrated that PS affects multiple factors in Information Retrieval (IR), such as a user’s search performance, interaction with the system, time spent completing tasks, and subjective impression of their workload. With greater knowledge of PS, systems could be designed that accommodate users with low PS to improve their overall search experience. However, in this perspectives paper, we analyse how PS tests have been used in IR, and identify multiple uncertainties regarding PS content, administration, analysis, and reporting of findings. Consequently, we aim to stir discussion between IR researchers by drawing awareness to these issues. As a result, we further discuss challenges involved in advancing how future PS tests are used in IR. Finally, we propose recommendations that have the potential for enhancing the reliability and validity of current PS tests.
Original languageEnglish
Title of host publicationCHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and Retrieval
Place of PublicationNew York
Number of pages9
Publication statusPublished - 18 Mar 2020
EventACM SIGIR Conference on Human Information Interaction and Retrieval - Vancouver, Canada
Duration: 14 Mar 202018 Mar 2020
Conference number: 5


ConferenceACM SIGIR Conference on Human Information Interaction and Retrieval
Abbreviated titleCHIIR


  • information retrieval
  • information retrieval speed
  • speed tests

Cite this