December 8th, 2008
Evaluation Meeting With Helen Beetham, Mark Stubbs, Nicola Whitton, Robin Johnson
Helen found triangle diagram helpful in capturing the essence of our project, suggested replacing courses with â€œcourse teamsâ€
Some initial observations included
â€¢Â Â Â There may differences between professions (established and evolving) in terms of their needs, irrespective of content
â€¢Â Â Â How will skills be embedded? â€“ deeply as in law and physiotherapy or disparately/shallowly/separately as in creative digital
We discussed the need to identify useful interim evaluation criteria and to generate outputs that can disseminate interim and final results.
Helen suggested we consider introducing an annual event with a keynote and 1 or 2 invited people plus all project members to:
â€¢Â Â Â consolidate what has happened in the last year
â€¢Â Â Â re-establish where the project isÂ going
â€¢Â Â Â define what still needs to be done.
This would help to keep members of the project in touch with each other and provide a real/tangible focus for activities and their dissemination. Include some student representation â€“ possibly NUS academic REP
Note to self, need to brief NUS about project.
We talked about internal evaluation and baselining.
Robin described the workshops that we had proposed when discussing how we assess the responsiveness of the MMU Review Processes.
Helen suggested broadening them to consider responsive measures for programme teams, employers, and students (our thinking was that this would include the responsiveness of process review but would address all points on the project triangle) and maybe at different levels – technology, process, people. Use the workshops to baseline the situation and then repeat it as a finishing event. Make workshops subject based. 12-15 people (Employers, programme teams, students).Â Â½ day. Possibly use graphical representations (posters) to stimulate thinking?
We agreed that
1.Â Â Â Helen would think about the content of such a workshop
2.Â Â Â Nic and Helen and Robin would work on the framework for the baselining and hence the evaluation
3.Â Â Â Robin would identify a subject area to start to do initial workshop on and possible dates. First workshop to be end Feb, and others to be in April – Robin has agreed with Physiotherapy that we will do them in the last week of Feb, Claire to confirm exact date.
4.Â Â Â Mark, Nic and Robin to think about possible senior staff that we might want Helen to interview. Nic to do the other interviews.
Helen outlined, briefly, the current thinking about the JISC Curriculum Design Programme Evaluation Framework
Based on a model of accountability
1.what have we done, produced, output
2. to what standards/quality â€“
Very general criteria specified (e.g. flexibility, student centeredness, etc) that need to be refined by projects.
Artefacts might not change but peoples perception or use of them may change â€“ can we show that.
Talk to Student Union
Talk to Institutional audit team!