Search This Blog

Sunday, July 20, 2014

How can we properly assess student learning?

This is a hard question to answer and, quite frankly, I don’t have the solution.  I am of the opinion that writing assessments are they are the best way to assess learning.  For teachers, however, they may be the hardest to manage.  They definitely take a lot longer to grade than running a bubble sheet through a Scantron machine to spit out a score.  But what about students who are anxious about writing essays, who don’t write particularly well, or need some form of scaffolding to prompt their memories or at least offer problem solving options (i.e. multiple-choice, where some students can minimize the risk of a wrong answer by properly discarding incorrect choices)?

Can one assessment format work well for everyone?  Are performance-based exams (playing a musical instrument, participation in group work, more complex, structured assignments such as term papers, etc.) or personal communication assessments (oral exams, journals, blogging, etc.) better?  I’m not sure.  The most logical answer (to me) is that each has its place.  That might be OK in the classroom, but what about standardized readiness assessments?  I’m not sure.  What about teachers or test makers who design their assessments to try to “out-guess” students?  Should the goal of an exam be to confuse or introduce roadblocks to understanding?  I think not; however, I believe this happens.  A lot.

The Smarter Balanced Assessment Consortium has been tasked by the U.S. Department of Education to accomplish the goal of a “better” test – a “high-quality assessment system”.  This exam will be facilitated by computer and is a “learning” exam (computer adaptive technology) that adjusts its future questions based on the response of past questions (incorrect answers get easier follow-up questions, correct answers get harder follow-up questions).  In Michigan, the transition will begin for the 2014-2015 school year; however, all schools are not yet able to meet the technology requirements and therefore a paper and pencil option will still be available.  Will students who take the computer adaptive exam score similarly to those who do not?  Would these students have scored similarly on the paper and pencil exam?  Can two different test formats be properly aggregated, compared to, or ranked against each other?

One area I contend that teachers and test makers can work on is to proactively build better tests.  The goal should be to write great questions - questions that gauge understanding and allow educators to see a student’s thinking.  If the questions, in any format, are easily understandable and allow the test taker a true opportunity to show his or her knowledge, not contain it within the test maker’s frame of reference, we will be closer to answering the question of assessment value?

3 comments:

  1. Something that stood out to me in your post was that some students will be taking The Smarter Balanced Assessments on paper and some will take it on the computer. I don't think that their results will be comparable because you can get different results depending on the medium that the students take the exam on. We just had to read a study on comparing results of students who took a reading comprehension test on the computer against those who took it on paper. The students who took it on paper had better results. I am happy that you raised this issue because I wasn't aware that the students would be taken the exam differently.

    ReplyDelete
  2. Mr. tippin: Good point when you say, "Should the goal of an exam be to confuse or introduce roadblocks to understanding? ".. I have wondered about this since my childhood:) "Why do they make tests harder every time? What is the point here.. Students need to learn concept and act wisely in different situations.. although I agree about students being problem solvers.. where does an educator draw a line and say - this much problem solving skill is good enough for a particular grade? Why does everything have to be so tricky? "

    ReplyDelete
  3. Matthew,
    Like me, you seem to have a lot more questions than answers. No doubt, writing is the best way to assess learning, but of course, as you say, it is the most time-consuming and potentially the most subjective. I find it interesting that in many of "highest-achieving" countries, high stakes exams simply don't exist until college. Teachers actually determine whether students know the material and or have the skills to move forward; what a novel idea! I think part of the issue here is the inherent distrust of teachers and out ability to accurate assess our students, much like a business must be audited by an outside firm. But of course the inherent premise is flawed here, which is that education should be or can be run like a business...ah, but I digress.'

    Interesting, thoughtful stuff here!

    ReplyDelete