Category: research

Measuring learner engagement in online education

I recently presented a paper at #amee_els about how myself and colleagues at the Univeristy of Otago have gone about developing a questionnaire to measure learner engagement in online medical education.

It seems to have struck a chord, and a number of people from the conference have asked if they can use this approach in their work.

The answer is yes, of course, and the slides from the conference are posted below. A journal article describing the development is being written, and I will post here when that is published. For now, however, I want to point out a couple of things:

  • the version of the instrument referred to in the slides is essentially a beta version
  • we’re currently looking at the psychometric properties, and some adjustment is necesary
  • I suspect that some of the items are redundant and/or too specific to a learning context and/or not only related to engagement.

What I am working on now is a different version of the instrument that is more easily generalised. I’m currently testing this out in a project and will be looking at the pyschometrics of this approach soon. Updates will be posted here.

How you use this approach

If you wish to use this approach, go ahead. All I ask is:

  1. Let me know by emailing steve.gallagher [at] otago.ac.nz. Tell me a bit about how you’re using it and any other feedback you wish.
  2. Please use this attribution if you write anything about this work

 

Gallagher, S. (2015). Measuring learning engagement in online medical education. Paper presented at the AMEE eLearning Symposium, “Shaping the Future of Technology-Enhanced Learning”, September 5-6, 2015, Glasgow, UK. DOI: 10.13140/RG.2.1.2873.7767

Here’s a link to a Google Doc version of the survey: https://drive.google.com/open?id=1BkBv0VrCqN3sjO2z7vAd9H-Lv5hf4CXYpzBz2NPOwoo

“The internet is good for lots of things…”

The lovely @sarahlibrarina just posted this on Tumblr. So I liked it on Tumblr, Facebook, shared it on Facebook and am now posting it here. My Tumblr tweeted it for me gah…..

http://sarahlibrarina.tumblr.com/post/51097774981/the-internet-is-good-for-lots-of-things-and-it

The top 5…

I don’t know about you, but I struggle to keep on top of the many things that are published and discussed about topics that I find interesting. Many smarter people than I have come up with ways of managing information overload. For example, The Getting Things Done methodology of David Allen is well regarded and probably works very well. I bought the book in 2006 and never got past the first chapter. Not because it was boring, because I didn’t find a way to make the time to properly engage with it.

I spend a lot of time online, and constantly come across things of interest. I favourite them on Twitter, but rarely go back and look at them. I capture them to Delicious, Pocket, Springpad, Evernote, Endnote… I’ve tried them all and never found something that works for me. As a researcher I need to be good at this. I was good at it when I did my PhD, and had to focus on only one or two core topics for a 3-4 year period. Working life, particularly in the private sector doesn’t encourage this kind of focus unless you are a specialist.

What’s my problem?!? I have every tool I need to organise this but haven’t made it work.

One issue I see is the problem of depth of processing. Using the tools above, and Google, I can find and curate thousands of resources into categories and topics – but that’s not the same as processing them. It’s a bit like when I used to do literature searches, print the articles but rarely read them in full. Printing an article is not reading it, nor is bookmarking a link really processing it.

So how am I planning to fix this? By having a top five. It’s just an idea at the moment, and probably one that others have thought of before. Here’s how I think it will work.

For every topic I am interested in, or is important in my practice, I will have a post on this blog. Just one post per topic. In this post, I will link to and critique, or at least summarise, no more than five resources at one time. Only five. In order to make it to the top five, I’ll have to actually process it to a certain depth. I can probably quickly discount many with a quick scan, others that take my interest or say something important can make the list. If I get more than five, one needs to come off the list. (I will probably cheat and keep an archive of those that get knocked out over time).

Why five? Well, it’s a popular number in lists. In terms of working memory, it’s a bit of a magic number, being the lower bound of the famous “Magic Number Seven (plus or minus two)“. By rights, if pushed, I should be able to recall the main points from 5 different resources on the same topic. Any more than that and things get fuzzy.

So, in due course, a new page on this blog will emerge, called topics. In it, posts about things i’m currently investigating or interested in. In each post, the top five resources. Let’s see how this goes.

Using SiliconCoach for enhancing reflection in clinical education

At the end of 2012 (the last day of work, in fact) I found out that myself and a team of colleagues from within the Division of Health Sciences at the University of Otago had been awarded a grant to investigate the use of online, annotated video for encouraging reflective practice in health education. Funded by the University’s Committee for the Advancement of Learning and Teaching, the grant will allow us to investigate whether filming real and simulated clinical consultations and allowing students to review and annotate these online will encourage reflection on professional practice.

In researching tools to test this out, we discovered a local company, SiliconCoach who provide online video-based coaching solutions for elite sports, and we’re working with them to trial the technology in medical education. It’s exciting to be working with an innovative company who are keen to explore different uses of their application. So far, it’s proving very easy to use and we’re looking forward to testing with students soon.

Time for an update – lifehackhq.co

Getting more and more interested in internet use and wellbeing, and am kicking around some research ideas with a few people.

Among the more interesting things to happen in the last few days, I’ve been introduced to http://lifehackhq.co/ – a NZ venture to help young people to use tech to create support and help for improving mental health. It’s a great concept – they are running a series of startup weekends in the main centres in NZ. Dunedin is up on April 26th to 28th, and will bring together mentors in IT and Mental Health to help qualify the ideas that will ultimately be pitched and voted on for further development. I love it – there’s real enthusiasm and I’m getting involved.

image