AM08 2008 START Conference Manager    

User Satisfaction versus Retrieval Effectiveness in Interactive Retrieval

Hongyan Ma

ASIS&T 2008 Annual Meeting (AM08 2008)
Columbus, Ohio, October 24-29, 2008


The current study investigates how retrieval effectiveness measured by recall and precision is related to user satisfaction in interactive retrieval. User satisfaction,the multi-dimensional measure, is decomposed into 11 semantic differentials that are related to tasks, results, and search processes respectively. A user-centered experiment was conducted with 24 participants and six simulated search tasks. Results demonstrated that instance precision is significantly correlated to relevant and useful search results and restful search processes. Instance recall is significantly correlated to clear, simple, and familiar tasks, relevant and useful search results, and relaxing, easy, and restful search processes. Through principal component factor analysis, two major factors underling the 11 semantic differentials are identified to correlate closely to retrieval effectiveness.

START Conference Manager (V2.54.6)