START Conference Manager    

Investigating Multi-Label Classification for Human Values

Emi Ishita, Douglas W. Oard, Kenneth R. Fleischmann, An-Shou Cheng and Thomas Clay Templeton

(Submission #116)


Abstract

This paper describes the development of a scalable process for people and machines working together to identify sections of text that reflect specific human values. A total of 2,005 sentences from 28 prepared testimonies presented before hearings on Net neutrality were manually annotated for one or more of ten human values using an annotation frame developed based on initial experience annotating similar content using the Schwartz Values Inventory. Moderately good inter-annotator agreement suggests that that meaningful distinctions can often be drawn by human annotators for this task. Several variations of k-Nearest-Neighbor classifiers were compared in this preliminary study, yielding results that appear promising and that clearly point to productive directions for future work.

Categories

Program Track:  Track 2 - Knowledge Organization
Submission Type:  Short Paper

START Conference Manager (V2.56.8 - Rev. 1261)