Saturday, May 29, 2010

A BerksNotes® GUIDE TO INTERPRETING STUDENT RATING RESULTS: Total Scale Level

Page copy protected against web site content infringement by Copyscape

WHAT ARE TOTAL SCALE SCORES?
The highest level of score summary is the total scale score across all items. It’s like the total score on a test, except there are no right and wrong answers on a scale. If the scale consists of 36 items, each scored 0–3, the following results might be reported:

Total scale score range = 0–108; Midpoint = 54
        Mean/Median = 96.43/101, where N = 97

The continuum for interpretation would be the following:

Extremely                                                Mean     Extremely
Unfavorable                  Neutral               96.43     Favorable
      0__________________54___________________108
                                                                     Mdn
                                                                      101

INTERPRETATION OF TOTAL SCORES: This score gives a global, or composite, rating that is only as high as the ratings in each of its component parts (anchors, items, and subscales). It represents one overall index of teaching performance, from Extremely Unfavorable to Extremely Favorable. In this example, the score is very favorable. However, the total score is usually a little less reliable and less informative than the subscale scores.

COMPARISON OF ITEM, SUBSCALE, AND TOTAL SCORE SCALES
A comparison of the quantitative scales at the previous levels for a total scale is shown here:

Score Level        Ex Unfav                    Neutral                         Ex Fav
Item                       0 ___________1____ 1.5 ____ 2___________3
Subscale 1(8 items) 0 ________________ 12 __________________24
Subscale 2(5 items) 0 ________________ 7.5 _________________15
Subscale 3(4 items) 0 _________________ 6 __________________12
Subscale 4(13 items)0 ________________19.5 ________________39
Subscale 5(6 items) 0 _________________ 9 __________________18
Total Scale(36 items)0 _______________ 54 __________________108

These levels of score reporting and interpretation are based on a single course. This information has the greatest value to you, your department chair, and the curriculum committee evaluating the course.

How does the total score compare to the global item scores given at the end of the scale? Which score should you use? Is there really any difference?

COPYRIGHT © 2010 Ronald A. Berk, LLC

No comments:

Post a Comment