What I Want in a xMOOC

Listen, I hear you – many will respond to my title and say “nothing, I want nothing from an xMOOC and I hope they all become the passing fad that they are”. I feel your sentiment, but I think there’s value in xMOOCs, as bad as the pedagogy is behind them.

1. As a training program, which most xMOOCs are, they can be incredibly useful. For base knowledge, and introductory subjects, these are appropriate tools to get learners to the next step. What I want to see from the Coursera’s and Udacity’s is that they provide more flexibility – open enrollments, work at your own pace, maybe even mini-credentials per unit (via badging?) and most importantly, multiple pathways for learning. I would love to see an online course develop multiple methods of instruction that as a student, I could opt into if I’m having trouble with a topic. That would signal to me that it’s about learning, not about profit margins – because frankly, developing multiple methods of instruction for an online course is incredibly expensive. Putting on a venture capitalist’s hat (and it’s ill fitting on me, I will admit), this could give a company an advantage in being able to leverage the data to determine which learning method is best suited to a student/learner, based on prior successes.

2. Better mechanisms for assessment. All the MOOC platforms have great testing banks, but not much else in the way of advancing assessment. Coursera’s peer evaluation is a step towards something good – but it relies on peer assessment without any repercussions – I could do a garbage job of assessing someone and it won’t affect me – there needs to be a balancing here to ensure that peer assessment is valued as important. Programatically, it’d be easy to do, make sure that feedback exists, make sure it’s longer than x characters, and make sure that there’s a mechanism for providing ways to improve (could be as simple as an explicit “ways to improve this critera”).

3. Speaking of open, for the courses that are free, I’d like to see a commitment to openness, meaning that the materials created are able to be repurposed in other contexts, easily acquired, clearly labelled and ideally in a repository. Yeah, like that will happen. The only open in xMOOC is open enrollment.

Learning Portfolio Writing Prompts

One of the problems of asking first year students to “reflect” is that, typically, they don’t know how to reflect. It’s not a skill that a lot of students come prepared to University with, nor have developed. Yet, it’s a critical skill to have – to think about what you’ve done, and identify what worked well, what needs improvement and what can change.

Reflection is really not a simple process, but it’s crucial to learning, and really important to deep learning. Think of all the life lessons you’ve learned, and I bet you’ve thought about them often, and sometimes deeply. They change you. Similarly, good educational experiences (whether that’s reading a book, attending a lecture, practicing a lab, or just trying something out) cause you to think about them, and again, sometimes deeply. It’s that deep learning that the Learning Portfolio wants to get at.

The activities we have unveiled in the first year of the Learning Portfolio were good – but mostly course based. Anecdotally, we didn’t see a lot of extracurricular activity, or if we did, it was part of the program. One potential reason was that we didn’t give any student a reason to actually use the tool. So one way to solve that will be to post writing prompts, to offer students something to reflect on and a reason to use the tool on their own. Each writing prompt will help students connect their academic work to their “outside” life, connecting academia to reality. I consider this sort of thing “translational” – an effort to break academia down to understandable language for the average person. In the process, hopefully students will engage with thinking about what they’re doing, set a goal for themselves and maybe get a little bit more out of their experience here.

Learning Portfolio Showcase at McMaster University

The day surrounding the culmination of a significant portion of my work around the learning portfolio at McMaster this year was the Learning Portfolio showcase.

In the morning, Randy Bass gave a talk about where learning might be going – I’ve embedded it here to provide some context for how our university is framing the discussion.

As usual, Randy gave a great talk, this is my second (maybe even my third) time listening to Randy speak and it’s well worth the investment of time. In the afternoon, there was more discussion around the use of the Learning Portfolio – from potential employers, from faculty, from staff and from students. Below is a short overview of some of the things we’ve learned.

One of the  big things I’ve learned this year is that the tool we’re using (D2L’s ePortfolio tool) really dictates how things get done. It would be nice to have a timed reflection option (currently we use Quizzes for this process – and that’s got problems in and of itself), it would be nice to allow students to act as teachers in certain contexts – dictated by the instructor of the course. I know that the tool is getting an upgrade, but the upgrades can’t come soon enough. Once we can use the ePortfolio app (and that’s not D2L’s fault, we can’t use it because of the method of single-sign on that we use) that will change some contexts, but maybe not all.

With all the statements about student-centred learning, faculty are asking for the ability to simplify access to ePortfolio content. I can see some benefit in the K-12 market as well for this behaviour (as much as I don’t particularly like it). If faculty are to guide students in good reflection, they should be able to randomly select someone (maybe blindly select from a group of people).

Survey Says? A: Integration!

We’re in the midst of developing an LMS survey – which has broader implications as we also want to ask about other services my department provides (which is Blackboard Collaborate for web conferencing and iClickers for classroom response). All of a sudden, this quick survey has turned into this potentially really long thing that people will be unlikely to answer. Never mind it’s late in the semester (exams started yesterday) so I expect that user responses will be less than stellar.

With that said, it will be interesting to see what people think of D2L as we’ve introduced it. In the three years I’ve been here we’ve made some significant upgrades (from 9.2 to 10 in one year, and to 10.2 the next) and with those upgrades have come some significant growing pains. Next year should see us integrate Blackboard Collaborate, Pearson and McGraw Hill into our instance of D2L, which will hopefully solve some issues for faculty (namely the butt ugly interface you have to use with Blackboard Collaborate). We’re also planning on fixing the partial e-mail issue and additionally have PeopleSoft integrated into our process as the old Student Information System is going to get shut off. Cripes, that looks like a lot of change on paper – and I’m not quite sure how things will get managed. So yeah, if I’m not blogging that may be why (never mind the two presentations I’m co-presenting at Fusion, or the one I’m doing at AAEEBL!). Busy, busy summer.

Well, what does that mean for you, good reader? Well, probably more of the same – sporadic updates, maybe some neat charts and graphs,  some preliminary findings from our Learning Portfolio initiative in year one and more snarky comments about what MOOCs have become.

 

ePortfolios So Far…

So I’m the (self proclaimed) technical lead for the ePortfolio tool (which McMaster has rebranded Learning Portfolio). Actually I fell into the role when the person who was supposed to manage it ended up not being able to deliver the initial rollout presentation due to illness. The tool has worked admirably, scaled well, and frankly done its job. There are warts on the tool – maybe barnacles are a better imagery (to go a step further, barnacles can be removed  with a lot of hard work). The way one assembles a presentation (a sharable portfolio) is very mid 90’s – which makes the product a hard sell to student used to the ease of Tumblr or WordPress. Despite that major hurdle, we have seen over the first semester a moderate success, just over 21,700 items built in ePortfolio, with close to 3500 of those being reflections. We have over 3200 unique users, with just 17 courses using it. We’re now starting phase two of the first year, which will be periodic reminders to students, and we should see an uptick in usage – as well as an addition of two courses which will impact at least 1500 students. Now the real question is will students start to use it outside of classes?

NMC Horizon Report 2014

Hmmm.

With every passing year I spend in edtech, I always pick this PDF up with some dread. It provides hope on many of it’s long view items – hope that educational technology will get better, less manipulative, less data driven, and more inventive – allowing teachers to do what they love (hopefully) better and differently. This year’s report is pointing at The Quantifiable Self as something teaching and learning will be doing in five years as well as Virtual Assistants.

On the surface, these seem reasonable – however I believe that most institutions are doing this in some form already. The Quantifiable Self is really about identifying trends (mostly around health through tools like FitBit or Nike+ app) and using that physical information to push you to do better, walk more and so on. With education, in a well designed course, students are already doing this – taking self-assessments that build confidence in a field, confirming that the student “knows” something. LMS analytics also contribute to this – in our instance Desire2Learn has the Student Success System, which gives feedback to students individually on how they’re performing in the class and in school in general. This horizon technology is already here, not five years away at all. At some point, there will be pushback (I hope) on all this data collection that is saved in private institutions – you as the creator of that data should be able to control it – it is in fact your intellectual property.

Virtual Assistants? Oh c’mon. That’s here in higher education now. Students are checking Google on their phone, which gives them more information (tailored to their search patterns) that they might need. On the Android phones, Google Now is providing contextual information that can be used in context – if you search for political science information every Wednesday at 7:00, Google Now will start feeding you information about political science at that time. Furthermore, Google then takes your new interest in political science into consideration on future searches. Siri and Iris are omnipresent in classrooms, and used to fact-check, find alternate solutions to problems, or just alert the user to a new deal on shoes. Again, this is not on the horizon, it’s here.

What is on the horizon is faculty using and integrating this technology into their classrooms in creative ways.

Ontario Online Initiative

So, undoubtedly this announcement by the Ontario government to give $42 million dollars to develop online courses, by getting Universities to compete in some sort of race-to-the bottom/bloodsport of course development so that they get money to develop courses that can be delivered online is kinda’ quaint. I mean, I’d be impressed if this was 1997, or even 2003, but 2014 seems a bit shameful.

Let’s face it, I’ve said it before, and I’ll say it again, Ontario is a decade behind the western provinces (who easily lead innovation in this realm in Canada) and probably five or six years behind the maritime provinces, who do online learning out of necessity. The really shameful thing is that Ontario Universities should’ve been able to see this gap growing for years, and sought to address it sooner. I guess the last fifteen years of conservative government at the provincial level didn’t help as they were looking to scale back and demolish education into a private business as they are likely to do. $42 million dollars is really  a drop in the bucket – especially if you’re setting up a whole education system outside of the existing University and College system, that will allow transfer of credits to those systems. Which brings up an interesting issue, if I take a University credit, will Colleges accept that towards a diploma they offer? What about the other way?

Of course all Universities will be in on this action, and some of the more developed online schools will have a leg and hand up but it’s a nice development for someone like me who needs 4 or 5 more credits for my degree, and has had a lot of problem with either a home University accepting a credit, but the visiting University not accepting me as a student (in favour of their own); or taking the course and not having the credit accepted at all.

What worries me most though is that if this initiative is ushered in (as no doubt the government goes to election) and is a fair to midlin’ reception. What happens then? This institute and and initiative is certainly subject to a new government’s impulses and legislation. I can easily see a conservative government saying “this doesn’t work, let’s let private market run it better and cheaper.”

And we know where that will end up.

Happy New Year

In the past I’ve looked at previous posts about what I think will happen, and reflect on those ideas. It’s not that I don’t think reflection is valuable, it’s just that I’m not that interested in navel gazing (hell, I can see my navel getting bigger by day).

This year, I’ll outline some of the projects I’m currently involved with and will try to write about this year.

Work Projects

So for work, I’m working on two large-ish projects. One is a Productivity and Innovation Grant funded project lead by the University of Guelph, around learning outcomes in D2L. What the project encapsulates is ensuring there’s alignment between course, program and ultimately University related outcomes – and the reporting that D2L will suggests where there are holes in the alignment. It seems like it will improve the Analytics/Insights tool greatly with global reporting options – which is something I’ve struggled with greatly.

The other, is around Learning Portfolios. The department that I’m embedded with has gotten some funding from the University to advance Learning Portfolios (the ePortfolio tool in D2L) on campus and it’s looking like we will be responsible for this area from here on out. I think that some improvements to the way the tool works by D2L will only help the adoption of the tool – however there’s still some major hurdles that have to be overcome before there’s widespread adoption. That’s not to say that adoption and use hasn’t grown greatly, it has – just the impact of the use so far has not produced enough of a ripple to spread campus-wide. That’s our job in year two. I’m putting in a Fusion 2014 proposal to co-present one of the really interesting stories from first semester that ties blended learning, learning portfolios and helping students reflect (in this case on career choices).

Personal Projects

Other than the banal things like redo the bathroom and visit more places, I’m putting out a record with my one band and releasing another record with my other band. Not very exciting unless you like hardcore punk.

While this is work-related, I want to put together a rubrics repository (like Rubistar, but much more focused on local courses, and local sharing) that has a series of rubrics saved covering higher education courses that the University teaches. This way, it gathers together some of the best work that faculty have done, recognizes them, allows them to set sharing permissions, and ultimately, choose to export as PDF or into D2L. This is a big project, and really not on anyone’s timeline, but I want it to happen. It’ll have to be open source, and to that end, maybe it doesn’t just spit into D2L but into Blackboard or other systems too. The first iteration will of course work with our system (D2L) and then maybe we can branch out.

I’d love to help update the Feed2JS codebase to get it WCAG 2.0 compliant.  I’d also love to blog more.

More About the Learning Portfolio

I’ve written a fair bit about my process for developing support materials – which is something I’ve become good at over the years. I haven’t really spent any time writing about some of the other, smaller initiatives around the Learning Portfolio. One of which is getting students to set their own learning goals.

It’s ironic that an institution (who have their goals for students) wants students to be self-directed, yet everywhere in their classes have very little choice in the way that they can determine their own goals and achieve them. This self determination is left to their own time, and is in every sense, not a part of school. However, the institution is certainly looking at ways that students can determine, set and track their own goals – and to that end, with a consultation with Desire2Learn, developed a widget that sits on the homepage that students can click on the link, enter their information on a form which creates an artifact in their ePortfolio/Learning  Portfolio. A small portion of the student population use the Learning Portfolio (about 5%-10% of our full time enrollment) but use is picking up. Use of the Learning Goals widget is also a large percent of that group – maybe making up 2% of our total population.

The idea with this widget is to get students thinking about their own goals and trying to tie those goals to their academic learning. I don’t know if there’s enough being done around this – and we’re only in the beginning, but some thinking needs to be done about this for sure. We aren’t tracking whether these goals are ever met, or even the content of these goals – in fact we only can make a guestimate based on how many times the title of the widget shows up in the Learning Portfolio object creation report.

I’d be interested in hearing about whether anyone’s doing major ePortfolio/Capstone project work – trying to encapsulate a student’s experience at University or College in that course/project – and ways that an ePortfolio might help that along. Sure, we know that portfolios are great for procedural/project based learning, especially when guided. I’m more interested in if this can be done institutionally. Really adding a great incentive to building this work.

Student Engagement Idea: Upvote/Downvote Questions In Discussions

Way back at the beginning of time, I worked in Language Studies with a professor, Gerry Dion. Gerry was (and is) a great guy, and frankly, about ten years ahead of his time. In my first semester working with Gerry, my job was to maintain computers in a small lab, and help students use the First Class communication system, which was a really good system to use for class collaboration and instructor flexibility. Gerry taught “French, in a Canadian Context” (course code was LL636, which is part of the minutia that I carry around in my head). Anyways, this course was a flipped class with course materials on a CD-Rom. The first six weeks were French language basics, the second six weeks were cultural research. Students grouped up, did research, and then posted to First Class their essays. Everyone in the class would read each other’s essay. Then there was a multiple choice final exam that consisted of questions pulled from the essays.

I’m on a bit of a nostalgia kick lately, and well, I was thinking about this sort of activity, except within a modern LMS context. Here’s how a similar exercise using the discussion forums in D2L’s version 10.3 might work:

First, have students read each other’s work. Typically these are submitted to the discussion forum, for posting – but a group dropbox (with the entire class enrolled in one group) might work as well. Second, have a forum for each essay, and students are to generate x number of questions (and potential answers) each, and post to the appropriate forums the questions. This part of the exercise ensures that they at least read some of the work submitted. Third, have students use the upvote feature (new in version 10.3) to vote up or down the question – voting up the questions means you could answer the question, voting down means you (as a student) couldn’t answer it correctly. Students essentially identify easier questions on a fairly large scale.  Fourth, to assess activity in the system you could use the reporting feature attached to discussions to export a list of activity to CSV, manipulate that CSV to be a grades import (aligned with previously created columns). Fifth, using the upvote data, select questions that did well, and did not do well and create a quiz out of those – you could even take it a step further and allow the system to randomly select questions (once imported into the Question Library) from each difficulty of question.

Going back to my history lesson at the top, Gerry was not an easy marker, but almost always did well on his student feedback – students learned from those sorts of exercises.