The article Towards a Process for K-12 Students as Content Producers by John Concilus has some great ideas. I really like the way he refers back to well-founded research from an earlier era (eg on process writing and writing for an authentic audience) while discussing the impact of new technology. John’s in-depth article raises lots of interesting issues and explores how tools such as a wiki can be used in student learning without lapsing into over-simplistic promotion of the tool.
One innovation he describes which raises some fascinating issues is the WikiDashboard, which provides a way to analyse individual contributions to a collaborative wiki. WikiDashboard shows a list of users who have contributed to a page and quantitative data about the amount each user has contributed and when they did so.
While this tool provides fascinating information on who has edited a wiki article, I have some strong reservations about its use as an assessment tool. My main concern is that it provides an easier way to quantify contributions but does not really provide any qualitative insights into the quality of these contributions. The danger here is related to the assessment dilemma – we tend to assess the things that are easy to measure, but these are often less important than the things which are harder to measure.
If we want to assess educational outcomes such as higher order thinking, analysis and critical thinking, we need to assess qualitative evidence. While the Wiki Dashboard is a great tool that can help an assessor find qualitative evidence, the data it provides is not in itself such evidence. It can help us find who wrote what content on a collaborative wiki, but we still need to assess each person’s contribution qualitatively and avoid any tendency to use its percentages in allocating grades.