Are open badges just empty motivators?

I’ve been worried, since I started the INSIGNIA project, that ‘the people’ wouldn’t really get the point of open badges for researchers.

Screen Shot 2014-02-26 at 5.21.21 pmBy ‘the people’ I mean PhD students and their supervisors. No one has ever tried open badges for researchers before – at least as far as I am aware. I have no idea whether they will be interested in doing the web based tasks we develop, or in earning the open badges we make.

One of my chief worries was about the ‘gamification’ model that seems to underlie the open badges idea – badges are a small reward for a certain achievement. Would this audience of researchers see this idea as, well… naff? It’s not the kind of thing that one puts in a grant application of course, but it is a legitimate worry.

Carla Casilli states that “all badges have value” and that, understood as a whole, multiple badges work can act as signifiers for identity. I’ve sympathy with this argument, but I wonder, in this particular case that there are other, strong forces of identity formation at work. Researchers are understood as researchers through their outputs (in most cases journal papers), which gain meaning within a disciplinary community.

A journal paper is the ultimate “badge” for a researcher – it’s a concrete demonstration of skills and abilities.

My other worry is the age of the intended audience for these badges. At the moment, in Australia, the average age on commencement of the PhD is 34 years old. The supervisors are older still: there are more academics over the age of 50 than under. I wonder how many PhD students and academics play computer games and have experienced this kind of reward system?

It may well be that no one in our intended audience really gets it, but that’s the point of research isn’t it? To ferret out and explore the unknowns.

I’m happy to report I am losing less sleep over badge acceptance since we ran a Thesis Bootcamp here at ANU. For those of you not familiar with this concept, the thesis bootcamp concept was developed by Peta Freestone and Liam O’Connell of the Melbourne university graduate school. It’s a simple concept really – gather together people who are all at or very near completion of their PhD. Feed them, console them and give them space and time to just write the thesis. Liam kindly agreed to come to ANU and help me run my first one and learn from him how the University of Melbourne system works.

Screen Shot 2014-02-26 at 5.32.09 pmPart of this system – and the fiendishly clever bit really – is the rewards: a series of lego shaped squeezy blocks which are awarded for every 5000 words written. The blocks come in four colours: green for 5000 words, blue for 10,000 words, red for 15,000 words and gold for 20,000 words. When Liam introduced the idea to our bootcampers there was a palpable air of scepticism in the room. I’m sure the PhD students were thinking to themselves: “this is kind of naff” – since I was already thinking of the blocks as ‘analogue badges’ my heart sank.

Screen Shot 2014-02-26 at 5.33.23 pmLiam reassured me that “this always happens” and we carried on. It took until mid morning on the Saturday for one of our bootcampers, Natalie, to declare she had reached the 5000 word target. The bootcampers looked on with amused bewilderment as  we made a big fuss of the achievement and wrote Natalie’s name on the white board under the “5000 club”.

There was no visible sign that the blocks were working as a motivator until after the third one ‘dropped’. The bootcampers no longer looked on with amusement, they clapped and cheered their colleagues’ achievement. I heard more than one of them mutter “I must get to the first block!”.

Screen Shot 2014-02-26 at 5.32.47 pmGreen blocks dropped faster and faster as people redoubled their efforts. I guess some of them felt left out and some of them were getting competitive. Whatever the psychology, before too long all the green blocks were awarded and a lot of our bootcampers had progressed much further than that. Two bootcampers got gold blocks and four of them declared they had finished all the writing they needed to do to complete the thesis. After that comes editing of course, but having the words to edit is half the battle.

In the kitchen one of the bootcampers who had just got his gold block remarked: “If only I’d known all it took was an empty motivator Inger, I would have been finished long ago!”. It was funny because it was true – the squeezy lego block had absolutely no intrinsic value – it only cost me 50 cents. But deployed as a motivator in a social setting it had amazing power.

I’ve been thinking about the lessons learned from Bootcamp for about a month now and here are two reasons why I think the blocks worked:

1) The aesthetics of the blocks – and the way they related to each other – was important. Liam pointed out that the blocks clip together pleasingly to give a visible sense of progress (we called it “the word wall”). The branding on them worked too – many bootcampers reported displaying it proudly in their office. The lego blocks became a tangible demonstration of membership, much like a branded hoodie or tshirt with your university logo on it. Most people crave some form of membership.

2) Seeing others get the blocks was important. The social dynamics we worked to create were crucial in this instance.  The block – or an open badge for that matter – is a token whose meaning and significance is socially made. I think the bootcampers initially felt a bit embarrassed cheering when someone got a block. Like me, no doubt, they had learned to be ‘cool’ about displays of enthusiasm by teachers in high school. But the initial scepticism died away after a couple of their colleagues got their prize and were so obviously pleased. The competitive spirit, or FOMO, started to kick in as they watched. Once they started joining in the cheering their desire to get a block themselves seemed to increase too.

I’m interested in what others think. What other reasons might there be for the blocks working in this way? What tactics and strategies can we use to mobilise the desire for open badges in our audience? What are the barriers?

8 Comments

  1. Devil’s advocate here: how valuable were the words? I could easily write 5000 words in a day, but they might be complete shite and not contributing to my finishing my thesis – in fact they could put me further back. Is this a case of quantity over-riding quality? Or is it more that people who have difficulty squeezing out any words at all need a kick start? Or, simply, am I missing the point?

  2. Yes – a lot of people have asked that. It’s hard to know of course, but Melbourne Uni are conducting a longitudinal study of outcomes of the Bootcamp experience. From what little I have heard from Liam, the words are very valuable. I don’t want to pre-empt the findings though – I guess we will see at QPR!

  3. Great post and good comments. 🙂

    I’d argue that M-H is perhaps asking badges to do too much work here – both recognise quality *and* quantity. Having written a doctoral thesis myself (and read Stephen King’s advice on writing), I know how important it is to sit in a chair and crank out words. Editing comes later.

    Which raises the point – I wonder what effective editing badges would look like? (not that *everything* has to be badged, I guess…)

    • Thanks for chipping in Doug! I’m finding your work very instructive as I do my reading 🙂 I’m wondering about an editing badge now. There’s some techniques that could be badged – I’m thinking of Zinsser’s ‘on writing’ method of pruning words…. Thanks for the idea! The technical issues, ie: not having an institutional platform from which to issue the badges, is the most difficult thing about the project at the moment or I would have some up and going already. Working on it!

  4. You mentioned that you were wondering how PhDs and their supervisors would accept the open badge system. It does sound interesting and I just had a go at it and I’m wondering if the skills that earn you badges are of a PhD level?
    Most seem to be awarded for really small stuff like registering for something and posting 3 posts in a discussion forum.

    What I found really confusing, is that you provide a list of institutions that award badges, but don’t break it down into topics and/or skill level. This makes browsing for intersting badges tedious.

    Just my 2 cents. 😉

    • HI Notably Curious – I’m not attempting to be comprehensive in my listing of open badges here. I’m just collecting what I discover as I do my research. If you want a better list, have a look at the Mozilla Foundation home.

      One of the questions in this research is to find out what kind of skills that PhD students might be interested in using badges to demonstrate / learn. We are looking at things like searching and referencing, research integrity and risk assessment training at the moment. But I’m sure it will evolve further.

  5. Interesting stuff, Inger. I’m exploring the use of badges for a postgrad programme here at ANU. Good post here, by Scott Leslie, a while back that caught :
    http://www.edtechpost.ca/wordpress/2013/02/20/badges/ with lots of comment on recognition systems, building trust networks etc., which is what you were demonstrating in yr example above.

    I’ve just come back to Canberra from Glasgow, and getting over jet lag, drowsing, reading anything to get you to sleep as you do, in my case it happened to be Macedonian military culture in the Hellenistic period (I’d done a MOOC on the Greek Hero just for the experience of doing one [and hey, yes, I finished] and am still hooked on background reading) when it dawned on me, slow learner that I am, that what was called in Greek armies of the period a semeion, defined as a ‘visible sign, token, standard or signal’, was of course a badge. And that the military had been using signs for millennia, not just to signal what to do on a battlefield, but to signal who was supposed to be doing what, eg the guy galloping up ahead of you in the battle with the flashy armour and horse trappings and the gold circlet round his helmet given to him by Alexander himself in front of the whole army, and whose sign you had on yr belt and shield, he was a cavalry Companion, and knew what he was doing and what you needed to do, and was leading the way and everything about him signified that. Which semiotic bonding is hugely important for that particular moment.

    So when Scott mentions that part of the problem is the word ‘badge’ he’s right. But the Scout uniform is itself a badge, and badge fitted the pseudo-military aspect of boys’ Scout culture (aged 10, I have to confess, I lasted all of three weeks — cdn’t take the oath to the Queen, flag-salutin’ etc — and it was the wrong flag for a Scot, the union jack, not the saltire, and there wasn’t enough wilderness stuff).

    Semiotics is so important here: the look & feel of the thing as something that you want to carry with you, that you feel proud to say you’ve achieved and that you belong(ed) to that community. So the badge has to mean something in the community of practice, it can’t be trivial even if it’s a counter-cultural something. Eg at times of Remembrance Sunday ceremonies in the UK, Quakers (I’m one) often wear white poppies instead of red, to signify a commitment to peace and non-violence, amongst other things (http://en.wikipedia.org/wiki/White_poppy).

    Of course, you cd have levels of badges within which you work up the hierarchy, as per gaming levels in online games. But starting at ‘really small stuff’ as NotablyCurious rightly says above, probably isn’t useful. And it’s really hard to establish a semiotic system when the organisation (army, university, religion, online gaming world, whatever) doesn’t recognise it. Still, no reason why we can’t try, and especially on postgrad programmes.

    BTW Insignia is a great name for the blog & its topic — does it hold implications for what we want to call a badge?

Leave a reply to notablycurious Cancel reply