A null result is still a result. Right?

IntegrityQuiz_makebadgesIn the Unjaded Reflections blog post “Why should you create an open badge system”, Jade Forester has three warnings for people designing open badge systems:

1. Don’t try to make your badge system grow too much, too fast;
2. Ensure you have the technical and human resources you need to fully support your badge system;
3. Make sure there’s a need for badges

Starting INSIGNIA as a small scale system, with available resources, certainly sounded like a sensible approach, especially given this is only a seed project. If the need for the badge is clear, it’s likely to help with acceptance of open badges in the research community. Given these constraints, I seemed to have a perfect starting point: ANU’s compulsory, yet non credit bearing, research integrity course.

This course is a problem I had inherited from my predecessor, who built it in collaboration with the community, but without a good assessment regime or ongoing maintenance strategy. The course attempts to explain, mostly through case studies, how complex research integrity issues, such as authorship, plagiarism, informed consent etc, are in practice. The material was great, but I’ve been working for nearly a year to move the course from his bespoke online platform into our ANU learning management system (on Moodle) and to introduce a quiz as the final assessment activity (yes – this seemingly straightforward task took nearly a year. Committees eh?).

Taking Jade Forester’s advice on board, I thought issuing a badge for the successful completion of the final quiz would be a good first step towards an INSIGNIA series of badges for research education. I needed a way to provide students with evidence that they had completed the course and I had available resources. The research integrity course content was already there in Moodle 2.5, which I know has the capacity to create and issue badges. Red Dog Learning, who had been helping me to build the course, even offered to make the badge for me as the last part of their contract.

The problem, I quickly discovered, was that people and technical resources are not always enough. The barriers are more likely to be hidden and, just like a coral reef just under your bow, you sometimes don’t know they are there until you run aground.

Last week I happened to wander into the lunch room at the same time as the ANU online team, who are the people responsible for looking after ANU’s implementation of Moodle. Over my burrito I asked the team if our Moodle had the badges option turned on because I couldn’t see it anywhere when I was editing my course. The team told me they had not turned it on because no one had asked for it.

I told them I needed it and politely asked if they could turn it on.

They hesitated. “Most people don’t have a good reason for using open badges” said one, cautiously. I suspected this was a gentle way of saying “no” so I pounced on it.

“Well I have a whole pedagogical model” I replied. Then I explained the idea of open badges providing a ‘respectful pedagogy’ for research students, who may be well versed in the material within a course and just needed to demonstrate competency – my research integrity course being a good case in point.

The ANU online team nodded and looked thoughtful.

“We’ve been reluctant to turn it on because anyone could offer a badge for anything” another member of the team said.

I replied that was rather the point of open badges, but I could see the problem with it in a university context. Anything with the ANU brand on it, and no quality control mechanism behind it, was challenging to the credentialing authority of our institution. Poorly designed badges, like poorly designed courses, have the potential to reflect badly on us and might even undermine our credibility as an education provider.

I explained I was happy to have this conversation because my research was designed to elicit just these issues and write about them. But I couldn’t get very far in my project if I couldn’t actually make any badges available. Perhaps they turn on the badge making capacity, but just for me. I cheekily promised to be good.

They told me that turning on the capacity for making badges would have to pass through their stakeholder consultation mechanisms. I’ve been in the university long enough to spot the possibility of slow death by committee when I see it, so I offered to write a memo for the committee and the DVC A – to explain the project and the need for badges.

Still they hesitated. I couldn’t understand why.

As it turned out, the ANU online were worried about the possible privacy implications of open badges. The idea of a badge is that it can be easily moved ‘out’ of the Moodle platform and displayed in other places, like the Mozilla backpack. If the badge ‘carried’ data about the student with it, like an email address, this would be a breach of privacy legislation and the insitution would be subject to up to $300,000 in fines. Apparently this was complicated by the fact that ANU is a federal university (actually the only federal university, since all the others are run by state governments).

I started to get a head ache. “Would an open badge project off the ground actually require an act of Parliament?” I wondered aloud. Then I laughed, you know – in horror. My project was melting around my ears.

ANU online team looked at me sympathetically. They didn’t want to stifle innovation they explained, but they had Responsibilities. I believed them, but had to ask the next obvious question: “can we put in a check box that students can tick so they are giving consent for their private information to be shared in the badge?” Well, that probably contravened the legislation as well they explained. I must have looked despondant at that point because the team did, bless their hearts, tell me they would explore whether Moodle could selectively turn off student information so that the badge could be ‘clean’.

This is, I suspect, where the road gets bumpy… A null result is still a result. Right?

Oh well. At least I managed to use Makebadges to do the graphics for the badge. If you are interested in designing your own badges, I’ve found some good sites which I have started to compile into a ‘make your own badges!” page. I’ll be interested in your comments – has anyone else had a similar experience?


This project is alive… at least I think so.

Screen Shot 2014-01-14 at 2.15.07 PMThe INSIGNIA project got funded! I’ll be using this blog to record progress on the project.

Thanks to the Office for Learning and Teaching for providing ANU with seed funding to explore the use of open badges in research education. The project will be a collaboration between the research training team, the College of Asia and the Pacific and the ANU library, led by myself.

You’re probably wondering what the research project is all about, so here’s a brief outline:

In Australia research students need only write a long thesis or dissertation, most do not do any formal course work with their degree. People now enter research degree study at all ages and stages, and from many walks of life. No longer can we assume everyone starts with the same knowledge.

There is a growing need to provide research students with more formal training in areas like research integrity, research methods and digital literacy. But rather than sit through long courses which might not suit their needs, research students need ways to demonstrate they have competence, or find out what they still need to know. This project aims to explore alternative ways of providing this through open badges.

As you will know, in a conventional course you have regular delivery of content (in the form of lectures, tutorials or modules), activities and then assessment. Courses are linear through time, with clear roles for teachers and students. By contrast, open badges suggest an alternative framework for learning, one that is dynamic and complex.

An open badge is a piece of digital information that is issued for recognition of a skill or ability. One, relatively conventional, way to use open badges is to issue them for completion of an assessment task or activity. The key player in the field of open badging is Mozilla who are authoring a set of standards and tools to facilitate the design and delivery. Their forthcoming Badgekit will provide crucial tools for this project. Once it is issued the badge may be displayed by the learner on digital platforms like blogs or in Mozilla’s Open Badges Backpack.

There are many ways to think about open badges, but the first type we plan to explore is a ‘recognition of learning’ approach, which treats open badges as similar to achievements in computer gaming. To earn a badge learners must complete a challenge which demonstrates their knowledge. The course content to support a badge activity might be provided, or learners may customise their own learning from a range of course materials which have been curated by a teacher or a community. Or a learner might just already know how to do the task.

There are three main research questions which we will try to answer with this work:

  • Are open badges useful for research education?
  • Will students (and supervisors) want to use them?
  • What are some of the barriers to implementing open badges within conventional university settings?

That’s probably enough for a start… but I’d like to take the opportunity here to acknowledge the work of Dr Lyndsay Agans who worked with me on the initial project proposal. Lyndsay has now left ANU and can no longer be involved with the project, but it’s fair to say this grant would not have been successful without her input. I’ll do my best to carry on alone!

if you are interested in reading more, here are three references on open badges which we appended to the original application: