Category Archives: EdTech

One Course to Rule Them All: A Return to the Course Management System

Several times each year, professors all around the world undertake a ritual that dates to the invention of the semester. They update their course materials. Sometimes they do this on their own or with someone else teaching the same class at the same institution. Sometimes they download the latest slides available from a textbook publisher and tediously upload them into the Learning Management System one-by-one. Sometimes life gets busy, and they skip any updates for a semester. Maybe they find someone teaching the exact same course at another school and share the load with that person. This would make sense, since it seems insanely wasteful for everyone to reinvent the wheel and update their own copy of Calculus 101 to be ever-so-slightly different than everyone else’s. In fact I’d argue that most, single, logical courses are more or less the same regardless of the institution. In other words, the materials and lessons for Calculus 101 as taught at one institution are not really so different than those used by Calculus 101 as taught at another. Analysis of a million syllabi seems to confirm this hunch.

Most content for a single logical course overlaps significantly with the content for that same course when taught at a different university

Today, for the most part, these classes exist as separate islands in different LMSs. Updating one does not update another, and any updates are largely done manually. Rarely do professors who teach in different LMSs collaborate – there is simply too much effort required to reconcile the glitches. Even with open standards to support “LMS agnostic” content that is transportable across LMSs, it’s incredibly time consuming even for a single instructor who teaches in different LMSs to ensure that they behave in the same ways across these systems. Ask any adjunct who teaches the same course at multiple schools with multiple LMSs. The types of test questions supported in each LMS might be different. Or the link from a given content item to another content item in the same course might break and need to be manually re-established. Or the weighting that you want to give to assignments in the gradebook might not work the same.

Calculus 101 as delivered at different schools in different LMSs

The textbook publishers, back in the day, created a way to make this process a little easier – provided that you were teaching with their textbook and only their textbook. They created content packages specific to each major LMS that could be imported with a click of a button. This addressed many of the compatibility and fidelity challenges. A modern-day variant of this concept links out to that publisher’s content (hosted on that publisher’s web site) instead of importing PowerPoint and other files directly into the school’s LMS. The primary limitation here is that the content still comes only from that single publisher.

Publisher content packages can be imported into many different types of LMSs

The MOOC providers offer the most recent variant of a potential solution to this problem. They teach a single course on their single platform and allow anyone to enroll. Instructors can co-teach a class, and content updates are immediate and available to every participant. MOOC platforms also have the capability of aggregating immense amounts of learning analytics data that – hopefully, …theoretically… – could be used to foster better course design and support adaptive and personalized learning experiences. But this model does not fit the way that institutions enroll students into course sections and does not address such details as privacy controls over student data, which an institution can control for its own LMS. Students, should they want to take the course, have to register in a disjointed way on a different system and attend each course, potentially, in a different MOOC platform – Udacity, Coursera, edX, etc.

MOOC – one course, with that course’s content, taught repeatedly on the same platform.

One Course to Rule Them All

Particularly as adaptive learning becomes more mainstream and the desire to pursue competency-based learning grows – the implication being that every piece of course content will need to be tagged with metadata and every click captured and analyzed – I believe that the level of effort required to build, configure, and maintain just one single online course may make developing that course a prohibitively expensive exercise, certainly for an individual instructor and maybe even so for a single institution. Our existing, individual, piece-meal methods of semesterly course content maintenance may quickly become unsustainable. Even the level of effort required to completely reinvent a single online course to be adaptive, capture the right analytics, and be aligned to learning standards is a significant undertaking. Our existing ways of hosting courses in disjointed ways across different LMSs – particularly as we try to aggregate and align standards and analytics data among them – are showing their limitations. In addition, particularly for the STEM fields, it is increasingly difficult to keep materials up-to-date given the pace of change. This is going to force instructors and institutions (and maybe even publishers, associations, alumni, subject matter experts, private companies, and others) to work together in new ways.

I believe that we will soon live in a world where universities and publishers and individuals collaborate to build a single “perfect course” for each logical course in each subject area – complete with every piece of possible and optional content, every remedial material, large pools of test questions, assignments, and homework activities. These courses will come pre-configured with all standards alignment and analytics capabilities baked-in and adaptive paths available for different learner profiles. Instructors will still be able to choose, tweak, and rearrange their course content – they just won’t have to start from scratch and will always have the latest, relevant materials available. Everyone will share in the heavy-lifting of building and updating each course. Perhaps different models of funding, coordinating, and distributing responsibilities for course development will emerge. These courses could then even be delivered through the same familiar LMSs of today – or from some other central platform.

While this seems ominously centralized, I’m not too worried about courses becoming too homogeneous. Assessment tends to be where courses differ the most. The experience of each instructor and the interaction of students are what tend to take each class in unique and different directions. There will be benefits to this new model and certainly some risks and trade-offs.

As for the actual content, I’m a big fan of separating course content from the system in which it is delivered. Many in the profession have reservations about the LMS (Learning Management System) acronym. These systems don’t really manage learning as they exist today (if one even agrees that learning can be managed). This concept would more accurately be called a Course Management System (CMS) – which is what most LMSs of today used to be called before Content Management Systems won out in this acronym war. 

Over the years, a couple of LMS product features/concepts attempted to address this specific need. Blackboard’s xpLor attempted to provide a single, central repository where instructors could build and share courses and propagate updates easily. The problem with this product is that it provided a great empty shell – but someone had to build all the content, and licensing of proprietary content still proved to be a challenge. Moodle also created a feature called the Moodle Network which tried to syndicate and sync course materials across Moodle installations, but it was too buggy and was eventually removed as a feature. The problem of keeping distributed content in sync is actually a hard problem to solve when you begin to define what “in sync” means to different sets of users. For example some may always want the most recent copy of a piece of content, others the most recent copy reviewed and approved for use in their course, and still others a stable version as of a certain date.

There are also pockets where progress is currently being made in this area. Course Exchanges, which are becoming more frequently discussed, solve one piece of the problem. Usually this concept involves students and instructors from multiple institutions co-teaching and co-learning in the same LMS with the course credit flowing back to the student’s institution. Carnegie Mellon’s Open Learning Initiative seems to provide a model closest to what I’m suggesting. Some of their courses even integrate with existing LMSs. The largest advantage of CMU OLI’s approach is that it isn’t just a technological solution. The development of each course is wrapped with solid instructional design guidance, and revisions to future course versions are informed by data and feedback from previous editions of the course.  I’ve seen schools collaborate on course development and contribute course revision assistance to the OLI courses as a means to sustain them. I’ve also seen schools pay what they would ordinarily pay a content publisher or producer to contribute to the initiative. This concept deserves further – and significant – investment.

Creating course content is not going to get any easier. To reap the benefits of advancements in adaptive technology (and even OERs), schools are going to need to find ways to share in the effort and expense of creating and maintaining course content. I am doubtful that the publishers alone will be able to offer and sustain complete, pre-packaged course solutions, each on their own. Even Pearson with its abundant market presence never got beyond a handful of it’s “My Lab” style courseware offerings and is struggling financially.  I also doubt that learning platform providers creating “empty” adaptive products will succeed much in the long term. Instead I think these “perfect courses” are going to resemble something like the MOOCs of today.  This trend will likely start with common introductory or high-enrollment classes where the largest returns on investment can be made to the most impact. Over time I see instructors who teach niche classes connecting with each other from across institutions and finding a place in this model as well. But the model we have today is incredibly wasteful and limits the progress that educational institutions can make in the long run.

This is a guest post authored by George Kroner

 

Why Are We Still Using LMSs?

I was a student when my undergraduate university purchased its first LMS. While it took several semesters for anyone to really begin using it, I managed to enroll into the first fully-online class offered to residential students (and the second, and the third – in a hybrid variant). Over 15 years later, I completed a Master’s degree entirely online. Something about my experience as an early online student sent me down an interesting career path. I joined Blackboard after completing my undergraduate degree, just after it had started taking off. It was a great place to learn a lot and to meet great people. I lived through the acquisitions of WebCT and ANGEL and Moodlerooms. As a student, I’ve taken courses in each of these LMSs. I’ve also built course materials for many of them, too. In the early 2000s for a class project, I even built a mobile app to pull my grades out of ANGEL (I suspect this is what may have landed me that job at Blackboard). One of my first jobs at Blackboard was traveling around from school to school integrating SISs with LMSs so that when a student enrolled into a class, he or she showed up in the corresponding LMS class roster. Then I focused on building learning apps on top of LMSs and integrating third-party apps and content. The better part of a decade later I left Blackboard to take a job at a university that involved migrating over 100,000 users from a homegrown LMS onto D2L’s Brightspace. They also used Canvas for continuing education classes.

It is no surprise to me that Client Stat’s most recent LMS data update shows more schools using LMSs than ever before. The technology has become pervasive and thoroughly entrenched…though paradoxically almost universally loathed. Around 2007-2008, some started to predict the death of the LMS. Others lament that just about every promising new learning tool invented, given enough time, begins to resemble a LMS. Some have attempted to explain why LMSs are so terrible while still others have been trying for years to reinvent the concept, to invert it,  to unbundle it,  or to offer an alternative to the LMS paradigm moving forward.

Nevertheless, here we are – in 2017 – with Learning Management Systems that very closely resemble what LMSs looked like 20+ years ago when the product category was invented. I’ll admit that for having invested so much time in the technology myself, the progress I’ve seen has been disappointing. Sometimes I think our desire to explain what’s wrong with LMSs clouds what has given them such staying power.  While this is not a post in support of LMSs, I do hope that by acknowledging what they do well, we’ll be able to better focus on improving upon, evolving, or maybe even replacing the concept.

Convenience

The single largest factor for the success of LMSs is that they are the default option. Every school has one. For many schools, courses and enrollments are auto-populated, almost magically, at the start of each semester. LMSs log in with the same password used for every other campus system, and new user accounts are set up automatically. There is usually training and support available for the LMS. Security of the system, backing it up each night, and bringing it back up if it goes down is IT’s problem.  Some schools even pre-populate the final grade from the LMS back into the SIS eliminating even more manual work for each instructor. Many instructors have spent many semesters perfecting their LMS course content to be “just so.” And when the semester is over, this content is rolled over and copied into the next semester (even the assignment due dates get updated) – again, for many schools with a click of a button. LMSs possess great organizational inertia, and for the ways that many people use LMSs today, it would simply be more work to choose to do otherwise.

Consumerization

Students today have demanding expectations driven by consumer technologies that have high levels of usability, versatility, and user-friendliness. They expect the same of their digital campus experience. The LMS – behind e-mail – is the campus system a student is most likely to use each day. Because of this, it tends to define the student’s digital experience while in college, and despite the many complaints people have about LMSs, they still do a good enough job serving in this capacity such that nothing else has yet replaced them.

A central LMS provides one place to log in to see everything that a student or instructor needs to do in a week – specifically a single view into all notifications/alerts, grades, and assignments. One missed item, especially one that puts the student behind or impacts a grade, could cause a student to lose faith entirely with any additional, external, or disjointed learning system no matter what its benefit. This is especially the case for adult learners who have full-time jobs and families and want to focus on learning during their nights and weekends instead of navigating across disparate systems. It is also true for instructors who as a whole tend to value a consistent, known experience over the novelty of trying out alternative platforms. Instructors who choose to use something outside of the LMS often face backlash from students – unless that external site or tool is connected to through the LMS to provide a central jumping-off point, much in the same way your mobile phone is the jumping off point into a wide variety of apps. And asking students to purchase and carry both an Android phone and an Apple iPhone to get the best out of both choices sounds kind of like a ridiculous idea, doesn’t it? (Not so ridiculous is to choose to use an app that exists for both phone platforms even though the experience may differ on each.)

Connectedness

Over the course of many years, every school has refined and perfected the connections LMSs have into a wide variety of other campus systems including authentication systems, identity management systems, student information systems, assessment-related learning tools, library systems, digital textbook systems, and other content repositories. APIs and standards have decreased the complexity of supporting these connections, and over time it has become easier and more common to connect LMSs to – in some cases – several dozen or more other systems. This level of integration gives LMSs much more utility than they have out of the box – and also more “stickiness” that causes them to become harder to move away from. For LMS alternatives, achieving this same level of connectedness, particularly considering how brittle these connections can sometimes become over time, is a very difficult thing to achieve.

In other words, it’s the same reason why individuals rarely switch bank accounts. Once your paycheck direct deposit and auto-bill-pay are configured, and you become familiar with which local ATMs don’t incur an additional service charge – switching banks becomes an increasingly less likely activity.

Compliance

Whether instructors realize it or not – or agree with it or not – there are a wide array of laws and regulations with which they should comply. Copyright and FERPA are two of the biggest ones. LMSs limit the visibility of copyrighted course content to only course participants for the duration that they need it. (Of course, this would become a moot point if using openly licensed OERs.) In the context of FERPA, LMSs ensure that only a given student can see his or her grades, and some LMSs have the ability for system administrators to configure which student data is shared outside the LMS with other systems such as digital courseware and e-textbooks. LMSs (for example D2L, BlackboardInstructure, and Moodle) offer tremendous support for improving accessibility of course materials to comply with accessibility laws, sometimes offering tools that allow instructors to automatically check their course content to make sure those students with sight and hearing disabilities can use it effectively. There are various regional and institutional rules and policies that LMSs help to support as well. For example, some states require instructors to provide details about required course materials ahead of the class start date to improve textbook affordability by giving students more time to shop around.

Compliance is not always the friendliest word to throw around, but LMSs do provide some structure to help in this regard (and also the ability to shift some of the associated risk from the institution to a vendor).

Advice

There’s a whole bunch of other useful things that LMSs do, too, but they don’t get used frequently enough for me to believe that these items contribute as significantly to their staying power as the factors above. Similarly there’s a whole bunch of great things that non-LMSs can do even though they haven’t gained much traction because they lack more than one of the factors above. At various times in my career I’ve waffled in my enthusiasm about LMSs. Over time, I’ve taken a more pragmatic than aspirational stance.

Overthinking Technology’s Role

There are benefits to using LMSs, and there are trade-offs. Sometimes, though, I wonder if we are overthinking technology’s role in the delivery of online educational experiences. I am a believer that success can come not only from which technology we choose to use, but also how we most effectively use the technology we have. Even great demos of the newest educational technology solutions leave me skeptical that they are too complex or promise too much. Could different co-teaching and collaborative course approaches or more modern pedagogical practices move the needle more than the latest LMS features? Are there other non-technical solutions such as using course coaches or student advising teams that would stand a better chance of sustainable success? Probably, but even so the LMS would likely still be a core component of the strategy.

Prepare for an Inflection Point

The homogeneity of most LMSs and continued consolidation of the product marketplace is evidence that the technology has reached a stable, dominant design. Typically when this happens in a product category, a new wave of innovation characterized by different ways to address the same need (and additionally new and unknown ones) emerges driven by commoditization and downward price pressure from vendors offering the previous generation of competing solutions. This does not appear to be happening with LMSs, in my opinion largely because of the way they are procured.

Will there soon be a tipping point for LMSs? Maybe- but it will be driven by courageous choices made by individual institutions – likely driven by forward-thinking instructors who want to do things differently across a whole department or institution (i.e.: not just for their own class).  To those instructors and institutions – you will know when an opportune moment surfaces to do so when your existing LMS becomes so woefully outdated that it needs to be wholly replaced, or a group of faculty pursue a unified effort to teach differently (such as by using mobile devices or an OER-based curriculum or a competency-based one), or when some widespread glitch or deficiency with your current LMS causes enough pain for everyone to trigger a re-evaluation. Instructors, you can start to prepare now by thinking about how you can segment your course content from the LMS so that it withstands any migration intact.

Final Thoughts

Educational experiences are not transactional; they are transformational. And I still see great instructors succeeding despite the flaws inherent in LMSs. This said, they’re the best general use educational technology solution we have for now – and likely to be for some time. But always remember – there is no one right way to use a LMS. Use them for what they are good for but not for what they aren’t. Hopefully with more information about what gives LMSs their staying power, we can begin to focus on those areas that still need some work with greater chances of future success.

This is a guest post authored by George Kroner