Assessment Challenges -- DESIGN
-
All research designs involve choices. Every strategy has
weaknesses as well as strengths.
-
Survey data reflect responses from a sample at a single point
in time. The sample may not reflect the larger population and the timing
of the survey may adversely influence the responses.
-
Longitudinal studies have problems with cost, respondent
attrition, and length of time before obtaining useable results.
-
Pre-test/Post-test, value added, and before/after difference
scores are beset by problems of uncontrolled intervening variables, practice
effects, ceiling effects, and regression effects that make interpretation
hazardous.
-
Qualitative judgments about student learning are not easily
summarized.
-
It is often difficult to identify the origins of student
growth and change (campus experiences vs. non-college experiences vs. maturity)
– Use self-reported measures or controlled conditions to isolate the curricular
or co-curricular experiences that produce the change.
-
Knowing two variables are related is important information,
but knowing the strength or educational significance of the relationship
is even more important.
TWO JANUSIAN DESIGN STATEMENTS:
-
Make the assessment methodology and instruments congruent
with the purposes of the assessment (avoid "backing in").
-
Don’t wait for the Grand Plan. Get started by examining existing
assessment evidence on the campus and see what it tells you about student
learning and educational effectiveness.
| Table
of Content | Assessment Challenges and Issues
| Previous |
Next
| Home
|