Evaluating online engagement

I’ve mentioned before that we all really need to start evaluating the online engagement stuff we’re all doing. Alice Casey‘s presentation provides some great pointers for where to start and what to consider:

My main argument was that a good evaluation tells a compelling story through combining qualitative and quantitative information in a clear format to key decision makers and practitioners.

The importance of evaluation

Stephen Hale at the FCO has an excellent, interesting and important post about measuring the success of the London G20 Summit site.

With wonderful openness and transparency, Stephen has set out some of the factors by which the site’s success could be measured, along with the results. Its fascinating reading, and provides lots of lessons for anyone approaching an engagement project like this.

Indeed, this ties in with Steph’s recent (and overly-modest) post about the achievements of the engagement bods at DIUS over the last year or so. He wrote:

We still haven’t nailed some of the basics like evaluation, [or] the business case

Figuring out whether or not something has actually worked is terrifically important, and the long term efficacy of online engagement relies on this nut being cracked.

Stephen’s post highlighted some really good practice here: outline what your project aims to do, and come up with some measures around it so you can work out whether it worked or not.

As Steph mentions, having an up-front business case is really important – a written down formulation of what the project actually is and what it ought to achieve.

Now, business cases and evaluation criteria can be developed in isolation and in a project-by-project basis. I wonder, though, how much more value could be created by developing a ‘package’ of evaluation which could be used as a foundation by everyone involved in government online engagement?

Of course, each project has its own unique things that will need to be measured and tested, but surely there are some basic things that every evaluation exercise would need to look at?

How about some common evaluation documents were created, and that every project undertaken ensured that the basic, common stuff was recorded, as well as the unique bits. That way, some kind of comparative analysis would be possible, especially if everyone submitted their results into a common database.

Just how hard would it be to come up with a common framework for online engagement projects? I think it is worth a shot.

A new collaborative community

Helen has launched a new community blogging project over at digtialengagement.org which aims to be:

a collaborative space for all those interested in digital engagement to share ideas and agree priorities for action around digital engagement

This is of a much wider scope than digital mentors, and has the potential to be a real hotbed of interesting and vital debate. Helen writes:

By digital engagement we mean the use of social technologies for social good. What do you think we should do on digitalengagment.org? In the immediate future, we want to use this site to create a digital manifesto, what more could we all do, and do together to get more people online and engage in the right tools for them to help them in their lives.

I’ve helped out by setting the blog up, and will be adding my thoughts on digital engagement in due course. The aim is for the site to be as inclusive as possible, so see how you can get involved.

We are going to have some interesting announcements coming up, including how we are going to try and get this conversation going en masse at the Digtial Inclusion Conference in April.

Councillors connected: social media online conference

I’m going to be facilitating an online conference with Steve, Ingrid and others, which will be all about encouraging councillors to make better use of social web technology.

It will be happening on a Community of Practice, meaning that there is no limit on how many people can be involved, and no travelling either!

Here’s a quick outline of some of the discussion points:

  • What are councils and councillors doing with social media?
  • How can its use help communities and citizens make connections to local public services and the decisions that affect our everyday lives?
  • How can social media support empowerment, engagement and improvement?
  • What are the risks involved in these new ways of communicating?
  • How can councils and councillors get started?

Some of the speaker involved are:

  • Councillor Richard Kemp, of Liverpool City Council, Deputy Char of the LGA Executive and Leader of the LGA Liberal Democrat Group
  • Councillor James Cousins, of the London Borough of Wandsworth and co-founder of the Cllr Tweeps site
  • Dominic Campbell of FutureGov Consultancy
  • Shane McCracken of Gallomanor and CivicSurf (blogging mentor project for councillors)
  • Stuart Bruce, Wolfstar PR, former councillor
  • Hugh Flouch of Haringey Online (hyper-local networking site)
  • Simon Wakeman, Head of Marketing at Medway Council

It’s happening between 6 and 8 April. It’s going to be awesome.