This is a hard question to answer and, quite frankly, I
don’t have the solution. I am of the
opinion that writing assessments are they are the best way to assess
learning. For teachers, however, they
may be the hardest to manage. They
definitely take a lot longer to grade than running a bubble sheet through a
Scantron machine to spit out a score.
But what about students who are anxious about writing essays, who don’t
write particularly well, or need some form of scaffolding to prompt their
memories or at least offer problem solving options (i.e. multiple-choice, where
some students can minimize the risk of a wrong answer by properly discarding
incorrect choices)?
Can one assessment format work well for everyone? Are performance-based exams (playing a
musical instrument, participation in group work, more complex, structured
assignments such as term papers, etc.) or personal communication assessments
(oral exams, journals, blogging, etc.) better?
I’m not sure. The most logical
answer (to me) is that each has its place.
That might be OK in the classroom, but what about standardized readiness
assessments? I’m not sure. What about teachers or test makers who design
their assessments to try to “out-guess” students? Should the goal of an exam be to confuse or
introduce roadblocks to understanding? I
think not; however, I believe this happens.
A lot.
The Smarter Balanced Assessment Consortium has been tasked by
the U.S. Department of Education to accomplish the goal of a “better” test – a
“high-quality assessment system”. This
exam will be facilitated by computer and is a “learning” exam (computer
adaptive technology) that adjusts its future questions based on the response of
past questions (incorrect answers get easier follow-up questions, correct
answers get harder follow-up questions).
In Michigan, the transition will begin for the 2014-2015 school year;
however, all schools are not yet able to meet the technology requirements and
therefore a paper and pencil option will still be available. Will students who take the computer adaptive exam
score similarly to those who do not?
Would these students have scored similarly on the paper and pencil
exam? Can two different test formats be
properly aggregated, compared to, or ranked against each other?
Something that stood out to me in your post was that some students will be taking The Smarter Balanced Assessments on paper and some will take it on the computer. I don't think that their results will be comparable because you can get different results depending on the medium that the students take the exam on. We just had to read a study on comparing results of students who took a reading comprehension test on the computer against those who took it on paper. The students who took it on paper had better results. I am happy that you raised this issue because I wasn't aware that the students would be taken the exam differently.
ReplyDeleteMr. tippin: Good point when you say, "Should the goal of an exam be to confuse or introduce roadblocks to understanding? ".. I have wondered about this since my childhood:) "Why do they make tests harder every time? What is the point here.. Students need to learn concept and act wisely in different situations.. although I agree about students being problem solvers.. where does an educator draw a line and say - this much problem solving skill is good enough for a particular grade? Why does everything have to be so tricky? "
ReplyDeleteMatthew,
ReplyDeleteLike me, you seem to have a lot more questions than answers. No doubt, writing is the best way to assess learning, but of course, as you say, it is the most time-consuming and potentially the most subjective. I find it interesting that in many of "highest-achieving" countries, high stakes exams simply don't exist until college. Teachers actually determine whether students know the material and or have the skills to move forward; what a novel idea! I think part of the issue here is the inherent distrust of teachers and out ability to accurate assess our students, much like a business must be audited by an outside firm. But of course the inherent premise is flawed here, which is that education should be or can be run like a business...ah, but I digress.'
Interesting, thoughtful stuff here!