Low interrater agreement on the semantic base of textual material.

The present paper describes three experiments which were conducted to determine whether independent raters could agree upon the semantic base of textual materials. These experiments were occasioned by an earlier experiment in which the investigators reported success in increasing the ability of students to extract the semantic base from textual materials. The present paper reports our unsuccessful attempts to obtain an acceptable level of agreement among independent raters about what constituted the semantic base of a number of texts. The paper concludes by raising some doubts about the strategy of extending behavior-analytic research to verbal behavior by combining behavior-change procedures with cognitive constructs.