... including the latest posts:

Real Books

Shelfari: Book reviews on your book blog

Actionable self-assessment & evaluation (for TEOs, Dec 2010)

On December 2nd 2010, Jane delivered a keynote address for the Self Assessment for Quality conference, hosted by the Otago Polytechnic in Dunedin, New Zealand.

The audience were representatives from tertiary (=higher) education organisations from throughout Aotearoa New Zealand working to implement a new evaluative approach to quality assurance, where they ask and answer questions about the quality of their offerings and services and the value of their outcomes for learners and other key stakeholders (such as employers, communities and iwi).

The theme of the conference was Self-Assessment for Quality: How do you know good when you see it?

Jane’s topic was Actionable Self-assessment and Evaluation for the Real World and covered such insights as:

  • What distinguishes real, genuine, actionable self-assessment and evaluation from the rest?
  • Why evaluative questions drive actionability
  • How NOT to answer evaluative questions – using the all-too-common value-free or reasoning-free approaches
  • Why it’s completely invalid to make a logical leap that skips the crucial values step
  • 7 steps to actionable answers – some really practical nuts and bolts
  • Why broad-brush rubrics work better than narrow quantitative indicators
  • Balancing SMART with SPICED indicators
  • Visible values as the key to actionable answers

Download the powerpoint

AES keynote: Extreme Genuine Evaluation Makeovers (XGEMs)

Here’s the handout for Jane’s keynote at the 2010 Australasian Evaluation Society conference in Wellington, New Zealand.

Extreme Genuine Evaluation Makeovers (XGEMs)

Obviously, some of the slides need further explanation for those who weren’t there. I am planning to flesh out some of the key points on the Genuine Evaluation blog over the next few weeks.

AES conference (in Wellington) registration opens – Davidson workshop available

Registration for the Australasian Evaluation Society conference in Wellington has just opened and there’s an impressive pre-conference workshop line-up, including one from Jane Davidson entitled: Actionable answers for real-world decision makers: Real evaluation nuts and bolts that deliver.

Summary of workshops

Date Time Topic Presenters
Monday 30 August 8.30am to 4.30pm Monitoring, Evaluation, Reporting and Improvement (MERI) Jess Dart, Clear Horizon
Monday 30 August 8.30am to 4.30pm Introduction to Realist Evaluation Design Gillian Westhorp, Community Matters
Monday 30 August 8.30am to 4.30pm Linking Evaluation and Social Justice Donna Mertens, Gallaudet University
Monday 30 August 8.30am to 4.30pm Introducing Developmental Evaluation Kate McKegg, The Knowledge Institute Ltd; Nan Wehipeihana
Monday 30 August 8.30am to 12.30pm Using Evaluation for Policy: Rapid Evidence Assessments (REAs) Rowena Cave, Ministry of Justice
Monday 30 August 1.30pm to 5.30pm Using Programme Logic in Multi-Level Multi-Site Programme Evaluations John Owen, Centre for Program Evaluation
Tuesday 31 August 8.30am to 4.30pm Developing Monitoring and Evaluation Frameworks Anne Markiewicz, Anne markiewicz and associates
Tuesday 31 August 8.30am to 4.30pm Evaluation design and implementation Elliot Stern
Tuesday 31 August 8.30am to 4.30pm Actionable answers for real-world decision makers: Real evaluation nuts and bolts that deliver Jane Davidson, Real Evaluation Ltd.
Tuesday 31 August 8.30am to 4.30pm The power of the visual image: Using photo based data collection techniques to enhance participation and dissemination Diane McDonald, Centre for Programme Evaluation; Rosalind Hurworth, University of Melbourne; Pamela St Leger, University of Melbourne
Tuesday 31 August 8.30am to 12.30pm An Introduction to the Most significant Change – uses and aplications of the technique Tracey Delaney, Consultant
Tuesday 31 August 8.30am to 12.30pm (Re)Discovering How Applied Systems Theory Improves Evaluation Planning and Performance Reporting when Working with Multi-Level and Multi-Programme Interventions Jerome Winston, CeDRE
Tuesday 31 August 1.30pm to 5.30pm Evaluative Reasoning, Evidence & Use Thomas Schwandt, University of Illinois
Tuesday 31 August 1.30pm to 5.30pm Designing improved performance measurement systems Graham Smith, Numerical Advantage Pty. Ltd.

It’s possible to sign up for a workshop without registering for the full conference, but the conference itself is likely to be a great one!

Check out the list of keynote speakers:

  • Roger Maaka, an academic who has studied and advised on indigenous issues internationally.
  • Donna Mertens is past president of the American Evaluation Association and editor of the Journal of Mixed Methods Research, as well as a professor at Gallaudet University in Washington, DC.
  • Thomas Schwandt is a professor at the University of Illinois at Urbana-Champaign and  a member of a standing committee of the National Research Council of the US National Academies of Sciences.
  • Elliot Stern is Professor of Evaluation Research at  Lancaster University and the current editor of  Evaluation: the international journal of theory, research and practice.
  • Jane Davidson, formerly the Associate Director of the Evaluation Center at Western Michigan University, Jane now heads an evaluation consulting firm in Auckland, New Zealand.