How Well Does That Rating Scale Work? How Do You Know, Too?

Abstract

This chapter provides readers with specific guidance as to how to evaluate aspects of their rating scale (e.g., how well the scale works). A simple non-Rasch technique is presented that involves a global examination of the percentage of all answers to all items for each rating category. Next is a discussion of the ins and outs of evaluating the probability of a given respondent selecting a specific rating category for a particular item. We call this plot “the hills.” The chapter finishes with a consideration of disordering. Investigating disordering involves computing the mean measure of all respondents answering one item and then computing a mean person measure as a function of rating scale selection. The chapter finishes up with a summary discussion between the two students, Keywords and Phrases, Quick Tips, Data Files, References, and Additional Readings. As in almost all chapters, sample analyses are used to reinforce the chapter topic.