ASIST AM 03 2003 START ConferenceManager    

Measuring User Performance During Interactions with Digital Video Collections

Meng Yang, Barbara M. Wildemuth, Gary Marchionini, Todd Wilkens, Gary Geisler, Anthony Hughes, Richard Gruss, Curtis Webster

Presented at ASIST 2003 Annual Meeting -- Humanizing Information Technology: From Ideas to Bits and Back (ASIST AM 03 2003), Westin Long Beach, Long Beach, California, October 20 - 23, 2003


With more and more digital videos found online, video retrieval researchers have begun to create various representations or surrogates for digital videos, such as poster frames, storyboards, video skims and fast forwards. How to evaluate the effectiveness of these video surrogates has become an issue for researchers. This paper proposes two general classes of user tasks—recognition tasks and tasks requiring inference—for which performance measures were developed. The measures include graphical object recognition, textual object recognition, action recognition, free-text gist determination, multiple-choice gist determination and visual gist determination. The preliminary results from two user studies applying these six measures are also discussed in this paper.

Server START Conference Manager (V2.45.2)
Update Time 29 May 2003 at 07:31:05
Start Conference Manager
Conference Manager