Reliability and validity in assessment ...

I have just enjoyed a two day course on assessment ... measuring assessment and determining the value of questions within a large population question bank. While some of the methodology explored, related to other styles and levels of assessment. It did give me an interesting and informed insight into some of the madness of our national penchant for examinations. Along with a view that our view (in the UK) is increasingly out of kilter with the rest of the planet.

One of the many factors at play is the question ... is the construct upon which the assessment is based, valid, let alone reliable.

While I have not 'accurately' assimilated this idea and can only, for the time being, run with my own biased viewpoint. It has made me stop and think about:

  • The sheer volume of assessments we inflict upon the education system. Their accuracy and the notion that now we have compulsory education until 18, the redundancy of the GCSE.
  • How in nearly all educational establishments, the exam seems to rule, yet there are other valid assessment tools.
  • Competency based assessment seems to have lesser value than general graded assessment, yet high value roles demand this (think about airline pilots before you form a view).
In some areas where I have some control, I am thinking about how we assess. How I assess and the value of this model. I may have hit the right formula, but could always tweak, test and critically assess what I am actually looking for.

Is it reliable?



Comments

  1. Unknown1 November 2014 at 16:05

    valid, reliable, and fair - competency-based assessment is fine when assessing a level of competence, the Oz vocational education and training system doesn't have a place for knowledge-based assessment though, which of course is ludicrous. Plus I wouldn't want to wish our paper-based process-driven audit regime on you, it makes ISO9000 seem like a walk in the park - retirement can't come sooner enough

    ReplyDelete

Post a Comment

Popular posts from this blog

If airlines offer in-flight Wi-Fi, they should invest in an extra black box for security ...

Image
Yijun Yu , The Open University and Andrew Smith , The Open University In-flight Wi-Fi is one of the most sought-after facilities for air travellers these days, now that laptops and smartphones are so common and so much of our working and personal life revolves around online services. But a US Government Accountability Office report has suggested that many in-flight wireless networks could expose the plane to being hacked or remotely controlled . In fact it’s of such a concern to US authorities that when a well-known computer security expert made an admittedly ill-thought-out joke about doing so on Twitter, he was promptly arrested, his computers confiscated, and subsequently banned from the airline . And all he was suggesting was to make the oxygen masks drop down. So it would appear that the stuff of Hollywood may jump from fiction to fact: Liam Neeson and Julianne Moore starred in the 2014 film Non-Stop , where a passenger hacking the aircraft’s internal wirel...
Read more

Wikipedia editors never walk alone: Hillsborough changes can be traced ... from @ConversationUK

Image
By Andrew Smith , The Open University According to the Liverpool Echo , UK government computers have been used to make offensive comments on the Wikipedia page detailing the 1989 Hillsbourgh Disaster over a number of years. The newspaper reports that revisions to the page have been made from computers using the government’s secure intranet since 2009. They include insults to Liverpool fans and a comment suggesting that fans were responsible for the football ground disaster, in which 96 people died. This case highlights the continual issue of trolling and cybervandalism on Wikipedia. It also shows how journalism is using good, technical forensic tools at the disposal of every cybercitizen. Cybercitizens can be good or bad So many of us use Wikipedia on a daily basis that it is one of the most visited websites in the world. Yet not that many of us really understand how it works. Wikipedia is based on the principle that the community can create, edit and refine pages covering...
Read more

Highlights and lowlights of 2014, a golden year for cybercrime from @ConversationUK

Image
Looking back, 2014 was not a good year for keeping things safe under digital lock and key. If a score was being kept, it might seem that the cybercriminals are in the lead, despite the valiant efforts – and own goals – from the cybersecurity profession worldwide. Cast your mind back to March , everyone was panicking about the HeartBleed bug. Based on an error in code upon which the majority of the world’s secure servers relied, experts had plenty of time to fix the issue. Sadly there was an array of conflicting information about changing passwords, leading to widespread confusion. While most IT administrators made sure this was managed in a professional manner, it created a stir that seemed to set the tone for the year. In May , online auction giant Ebay admitted to having been compromised. The site said its systems, with personal details of tens of millions of users, may have had been vulnerable for months. Everyone was advised, indeed forced, to change their password. In the...
Read more