First road test of Hypothes.is

It’s all about annotation, and I’ve been comparing Kami and Hypothes.is. Last semester, I used Kami  ($50 for no ads) for students to annotate text with my History of Technology class. I had some success, but I was not happy with its limitations, so this summer I tried Hypothes.is instead.

The students were offered a video tutorial on how to use it. I made a group just for them. The assignment was extra credit — for each of the three classes I uploaded an article for them to read and annotate, replying to each other. Sample instructions:

Extra credit for up to 3% of the grade:
1) Get your own account at Hypothes.is at https://hypothes.is/register. Please use your name as enrolled for the username.
2) Join the test group at https://hypothes.is/groups/n3an6ndm/test-group.
3) Go to https://via.hypothes.is/fand.lunarservers.com/~lisahi2/hist104/AnAggravatingAbsence.pdf
4) Annotate the article with your own responses and answer those of others. Annotations are graded on academic quality, connections to coursework, acknowledgement’s of others’ ideas, and evidence of understanding of the article.

I had been concerned that they would automatically post in Public instead of in the Test Group, because I could find no way to limit that or point them directly to the group page – the choice is made only via a drop-down menu in the upper right corner. Sure enough, several students posted in Public and missed the discussion going on in the group. I will have to add this to the instructions as well as in the tutorial.

I had thought that analysis and counting their contributions would be made easier by the brilliantly conceived Hypothesis Collector, created by John Stewart. It worked great last night. Unfortunately, when I tried it this morning, it only gave me the posts that had been made as of last night. I simply couldn’t get it to work and had to manually count annotations to assign points. I have been contacted by Jeremy Dean of Hypothes.is for ways to integrate with Canvas – this might be a huge help next year.

I am considering providing my next class textbook, The American Yawp, with my own annotations. The book, an open textbook, has a number of faults and omissions that would make for great learning opportunities for students. My own annotations would be like mini-lecture commentary, glossing on the text. But for some of the summer articles (one out of three of mine) in Hypothes.is, the section one highlights is quoted in the annotation without spaces, which is ugly. Also, there is little color or design in the annotation box to alert the student to the presence or unique character of an annotation.

Samplehypothesis

I think Kami looks better for this, and then I will export my pages as PDF for the students.

Kamisample

I had originally thought I could use The American Yawp’s own affordances as an updated online text, but just got an announcement that, ironically, their current update will be integrating Hypothes.is. Each page served by them will then come up with an invitation to annotate publicly. While this might or might not help students with the text, it provides an additional way for students to go wrong beside the Public or Group problem, so I don’t think I’ll be working off the Yawp html pages regardless.

Don’t get me wrong – the business model of Hypothes.is is wonderful. They make a real effort to reach out, adapt and update. In fact, that’s one of the reasons for this post – to provide input that I hope will continue its improvement as an open source product made by people who really understand the value of text annotation.

The Pedagogy of Canvas

Having worked in Canvas for just a little while, its insidious pedagogy is beginning to reveal itself.

Above all, Canvas’ appearance is designed to evoke simplicity, like Google’s Search page. The fonts are large, friendly, sans serif. There is plenty of white space, implying rest, with no need for cognitive agitation or disturbance.

PCcleandesign

The language for instructions and content regions uses short words at the second-grade level, which is more reassuring than complex instructions. This implies that this will be easy, no need to fear the system.

The default left-hand menu, which cannot be moved or removed, makes it clear that certain elements are expected and that they are meant to be organized by type:

CanvaMenuAnnotated

This type-centered pedagogy is enforced by design that does not permit any of the menu items to be changed, only disabled. Once on the DL, they never disappear. But neither can they be edited to prevent a long list of disabled mistakes.PCdisabledpages

You can create new pages or even external URLs as menu items, using the Redirect App, but it takes multiple clicks and multiple saves and is quite tricky (thus my long DL). The implication of so many steps is that doing this should not be standard operating procedure.

Notice that some pages cannot be disabled, only hidden (Discussions, People). This implies it is wrong not to want those items, that you should reconsider.

Getting back to the navigation: if you don’t like the content organized by type, and would prefer an interactive syllabus (like Moodle’s weekly design), you’d use Modules. The Modules page lets you organize all the class items within subheadings. These headings and all the links are bold text, with no provision for adding images (though you can apparently substitute icons if you know what you’re doing). The list of links is in forest green text and is spectacularly ugly, suggesting one wouldn’t want it to be a landing page – wouldn’t it be better to go back and do everything by type instead?

uglymodules

The Quizzes use test banks for creating variety (i.e. 50 questions in the test bank, using 10 randomly on each quiz), but items changed in the banks don’t change in any quizzes that have already been created. Created quizzes are thus intended to be static.

Each question in a quiz must be worth at least one point, and increase in whole numbers only. You cannot take a batch of questions and combine them into a single quiz of, say, 10 points, which might make each question worth .35 points, for example. This implies that quiz questions should be simple, each worth numbers that are easy to add up.

There are few areas where students can take control, and most of these are outside the actual LMS (like in Google Docs). Crocodoc is available for the instructor to annotate student work, but not for students to annotate together. This implies that the instructor is supposed to control all class elements that are inside the system.

Of interactive elements, only Discussions are actually inside the system. The posts are somewhat nested. This implies there should be replies to posts, but the large font size and huge amounts of white space, and the fact that the Discussions page itself is a long list of links, imply that there should be multiple discussions, on different topics or for different times, rather than one large discussion area.

Going outside the system to collaborate and meet synchronously implies these are unusual things to do. They require additional log-ins to places people might not be comfortable with, like Google. There are many “Apps” that can be linked into the class in such a way. Many require not only additional log-ins but additional payments. This implies that such places are special, unusual, perhaps dangerous.

Adding media to a post offers few options. To add media to a post, you may either record a video or audio file right then, or upload a media file. This implies that you should be using some talking head video, or have your video in computer-based files, rather than on the open web.

Confused? Assistance is available. On the top of the first page when you go into your new course is an offer of help setting up. This leads you to a list of steps:

PCcoursesetup

The list implies that you should import content if you can, then add assignments, students, and files. Then decide which items on the menu you want to use. Customize your home page, set up a calendar, add TAs (how lucky are you to have these?), then publish. There is no discussion of  your objectives or your pedagogy on these helpful steps. Really, you aren’t meant to think about all that, just put all your stuff in the right place so students can find it.

In the 2013 article The Predatory Pedagogy of On-Line Education , anthropologist Brian McKenna uses an investor conference for Instructure (makers of Canvas) to highlight problems with LMSs and online education. This caught my eye:

The stakes are incredibly high. But most faculties across the country seem in the dark. “Pedagogy as an intellectual, moral and political practice is now based on measurements of value derived from market Competition,” argues educational theorist Henry Giroux, “Mathematical utility has now replaced critical dialogue, debate, risk-taking, the power of imaginative leaps and learning for the sake of learning. A crude instrumental rationality now governs the form and content of curricula, and where content has the potential to open up the possibility of critical thinking, it is quickly shut down. This is a pedagogy that has led to the abandonment of democratic impulses, analytic thinking, and social responsibility.

It is not the case the one cannot create constructivist or connectivist pedagogies, or design explorations or learning adventures, in Canvas. I intend to spend much of the next year doing exactly that. But the design of the system does not encourage it. The system strips code entered into its pages, won’t display elements it doesn’t like from outside URLs, and makes embedding tricky and difficult. In the Canvas Community, there are hundreds of requests from faculty and instructional designers to add features that have long existed in other systems. While many of these features are managerial, at least as many concern aspects of opening up the system to greater customization, faculty control, and student leadership.

As I noted years ago in Insidious Pedagogy, LMSs each have their own internal pedagogy, based on the principles of their designers. The teachers who are most likely to be led by the default designs of these systems are instructors who are new to online teaching, or teaching with a pre-made course, or using few online technologies in their own lives outside their classes. More online teachers than ever fall into these categories. Like their students, they will prefer things simple and standardized so they can work more quickly rather than learn more. Thus will the critical pedagogy of faculty, which is so necessary for creating critical thinking in our students, be suppressed.

Complexity over simplicity in online classes

road to the hamlet A student goes into Online Class A for the first time. They see a list of items by type (syllabus, readings, lectures, discussion). They see a syllabus, listing the dates for when each of these content type items is due, and what constitutes them being done (i.e. complete this quiz, post one posting and two replies, submit this essay). They buy their textbook, and follow it, with chapter readings listed clearly on the readings page. At the end, they take a final exam that goes over the entire course content.
forest Another student goes into Online Class B. They see a list of weeks, or topics. There is a syllabus laying out the goals of the course: exploration, discovery, production of assignments, community. Readings are provided, but may not be required or there may be a choice. Perhaps there is a learning contract instead of a syllabus. Forum postings may be focused on what the student has discovered by following research instructions, scaffolded to adapt as the student’s work changes. Assignments may emphasize skills rather than content. The final exam is a video project where their unique research is shared and peer evaluated.

Given the dozen or so years a student has spent in traditional classes prior to college, Class A may seem more familiar, comfortable, and simpler. Class B may be perceived as difficult, or disorganized. Data on student clicks and questions asked may show some confusion, some cognitive challenges that need to be overcome. More questions may be emailed to the instructor, or posted to a forum.

Recent efforts to “improve” online course “integrity” have led to various rubrics, standards, and evaluative tools, wielded by administrators and instructional improvement teams. These assess the “quality” of an online course. The ones I’ve seen, and the faculty I’ve talked to who have been subject to them, note that the rubrics clearly prefer the Online Class A model: content-based, simply laid out, clearly expressing not only expectations but overall outcomes. Complexity is seen as “cogitive overload” and is discouraged.

The result is an unexpected (and for the admins, often unintended) standardization. Although the teams and projects deny that the intention is to standardize online classes, to make them “cookie cutter”, that is the likely result. The instructor’s role is to guide students through the material in an organized way, and to use insightful discussion prompts and exam questions to assess deeper thinking about the content. If the content they used has been structured to clearly align everything the student encounters with particular learning outcomes, so much the better, privileging textbook publishers who create such programs for profit.

How do faculty respond to this push for simplicity, when we know that teaching is inherently complex? In my years heading the Program for Online Teaching, we have always seen a tendency for any instructor new to online classes to automatically follow the Class A model. The reasons for this are varied. In most cases, the instructor has not examined their own pedagogy in the traditional classroom, or does not use online communities and resources for their own learning. Some are intimidated by the technology and throw their own classroom pedagogy out the window, having been guided by instructional designers and other support staff to simply fill in the blanks of the LMS.

Since many faculty new to online teaching are under time pressure to develop a class, the cognitive dissonance in their own learning becomes overload very quickly. The easiest thing to do is opt for the simple path – upload a syllabus in Word or pdf, upload readings the same way, set up a weekly discussion post with a question requiring a response, and create some exams. Many, many students complain that their online classes are impersonal, that they feel like they’re just learning from a computer instead of a person (and in the case of instructors who adopt course cartridges, that is often true). Students come to believe that this is what an online class is – a list of tasks to be completed and graded, rather than a learning experience.

simplemaze complexmaze1
This maze looks complex, but it is actually simple – there is only one path. You will learn little by attempting it.
This maze is complex, so you will need to make choices.

This is why POT has focused on helping instructors understand their own pedagogy, assess their teaching strengths, and build online classes that emphasize these strengths, calling this “Pedagogy First”. We encourage models that break away from “type listing” to create a unique interactive syllabus. And we want faculty to explore models that encourage students to think critically, express their learning creatively, and utilize the affordances of technology. If the supported LMS doesn’t fit what they want to do, we want them to link out or adopt a different venue. If they excel at student-directed learning, student-developed content, constructivism, or connectivist learning, we want them to have the freedom to build their classes around those models.

That’s because we value faculty creativity, originality, and pedagogical goals. We also believe that only by offering various pathways and options to explore learning about online teaching can we help teachers excel as the professionals they are.

Unfortunately, a trend has begun to cast those of us who were early adopters of online technologies, and originators of our own online pedagogies, as outliers instead of guides and modelers. We are being told that the days of “cobbling” our own systems together are over, that we need to join the “community” of large initiatives designed to create more accountable and approvable online classes. There is head-shaking about the learning we had to go through “back then”, and reminders that such efforts (like learning html, or exploring different online tools) are no longer necessary. We now have everything laid out for us; all the features we need are inside the mandated LMS. We must step down from our role as innovators and join the parade, marching together. We must realize that it is time to, in a word, simplify.

The temptation is appealing, but what is lost when we shift from complexity to simplicity? When instead of exploring and discovering, we are given the tools and the platform? Do we wish to encourage that sort of simplification for our students, when employers have made it clear that what they want is workers who can actually learn? Are such industrial models appropriate in a post-industrial world?

The only solution, as I see it, is to continue to encourage complexity, in both the development of faculty talents and student potential. POT will continue to encourage the reassessment of the Class A model, and continue to question content-based, standardized, simplistic classes both online and in the classroom. We will view ourselves as people of value, with knowledge to contribute to the discussion. We will treat our fellow faculty as creative, self-actualized human beings, lifelong learners who want to express their teaching goals through any of the myriad of available tools and approaches. And that task, like the work we all do, embraces complexity.

What might they recall?

This semester I instituted “roll calls” in my online classes, one during each week before a drop deadline. My idea was to check on my students quickly, see who was paying attention, before looking more closely at who might need help or need to drop the class.

I did this in the form of a “Choice”, a tiny Moodle survey. Once they answer, they can see everyone’s answer.

The first one is just a check to make sure they’re receiving the announcements (called Latest News in Moodle) by email. The options are:

• Yes, I am!
• No, so I’ll check my spam filter and profile settings.
• No, but I don’t need them because I check Latest News every day.

For next semester, I will be adding: “No, but then I found them in my Promotions folder in Gmail, so I’ll change my settings.”

The second choice asks what their favorite part of the class is so far (see results here).

My third one, about 75% into the semester, said, “What might you recall when this class is over?” and I only gave four options, and they could only choose one. Here’s what happened, across four class sections:

  • factual details from history 36
  • the primary sources I found and posted 48
  • how to write a historical thesis 30
  • how to manage time while taking an online class 29
  • not answered 5

I was surprised by how evenly these were spaced, but gratified that the searches they did themselves were likely to stick.

I have yet to find a way to do this in Canvas. They don’t seem to have open surveys…

Giving SCOPE to Online Classes

It isn’t enough for those of us who are labeled “early adopters” and “artisan” online teachers to just complain about what we don’t want. We know what we are against: monolithic systems, simplistic solutions based on administrative goals, dumbed-down pedagogies, standardized course design, and the stifling of creativity.

But as I’ve been saying about democracy in America (well I have, just not here), we can’t just moan about what’s going wrong – we have to be able to articulate, clearly and convincingly, our positive position. We need to present what we do want, what we favor, what is worthy of defense and respect.

We value:

Serendipity over restrictive pathways.

We believe in frameworks for guiding students in their work — it’s our job to create them. But there must be room for discovery – opportunities for students to find things, pursue their own interests, go down the “rabbit hole”. This might mean having students create content or access the “teacher” features of the technology. It might mean re-evaluating standard grading schemes and “learning outcomes”. This can be messy, and messiness is essential to learning.

Complexity over simplicity.

This does not mean we do not appreciate clear navigation and helping students understand what tasks to do in our classes. What it means is that we really want to challenge students intellectually, to provide multiple pathways to learning and plenty of resources. Online classes should not be simpler than on-site classes, but rather train the student mind for intensive cognitive work. Simple classes which emphasize rote learning and/or “completion” and/or student retention encourage students to see the purpose of the college experience as “getting stuff done” instead of building their minds. What’s easy for students is not necessarily what’s good for students.

Originality over processed content.

Certainly textbooks and material created by others are useful. But the course itself, in design, intent and materials, should be the work of the instructor. Many of us who use Open Educational Resources came to them, not just to save students money, but to provide less restrictive yet more focused objects for student learning. Universal design, while well-intentioned, should never prevent original approaches to material. To us, professional development does not mean learning the LMS – it means discovering ways to find, create, build, and explore so we can create better classes.

Pedagogy over management.

Yes, having an operational website, or even an LMS, may be preferred for “delivering” the class. But the emphasis should be on allowing the instructor to develop their own pedagogy by providing them with the tools and/or freedom to create. The convenience of administration should be a secondary consideration behind creating courses and using tools that emphasize the instructor’s teaching strengths. We want teachers to be able to say, “X works in my class, but Y doesn’t work”, even when the “guidelines” say that every class should have Y, and funding should be provided for X.

Excellence over expediency.

Rewarding instructors who create these serendipitous, complex, original classes for students would go a long way toward making more of them. The goals of building student minds, creating an educated citizenry, and sharing our enthusiasm for our subjects – these define excellence. Excellence is not defined by the opinion of those who appreciated the easy A, or how well a course meets the “best practices” determined by “experts”, or whether the course design is consistent across the disciplines. Rewarding classes that fit the rubric, make administrative processing easy, allow student thinking to remain rudimentary, and provide “options” from a list of things that are all the same — this does no service to our society.

There are many ways to give online classes “SCOPE”, and we need to articulate them.

A 50/50 Proposition

The saying goes that there are two types of people: those who divide people into two types of people, and those who don’t.

Our current Program for Online Teaching Chat has turned toward the issue of learner-centered versus teacher-centered instruction. This week’s discussion focused on what has become the so-trendy-we-must-question-it shift from the “sage on the stage” to the “guide on the side”. This is the belief, promoted in numerous papers and presentations over the last decade, that instructor-led, lecture-based, textbook-based, LMS-dependent, top-down models of pedagogy are antiquated and useless, leaving underprepared or economically disadvantaged or socio-economically challenged students out in the cold.

The answer is to shift to student-led, interest-guided, open resource, open format, participant-centered pedagogies, exemplified by but not limited to Massive Open Online Classes (MOOCs). Even apart from the fact that corporate interests have taken the side of this more-customer model, we still have two types of people: those who support a 100% shift to student-centered learning, and those who don’t.

z_creamsicleBut, as many of our experienced faculty have pointed out in our Chat, it doesn’t have to be an all-or-nothing proposition. And certainly, every time I change something in my classes, I end up with a combination pedagogy, a 50-50 type of deal.

I hesitate to stay this, but there are few faculty who can actually pull off fully student-centered classes. I do know some who have, and I admire them enormously. But the difficulty is that the risk is too high for those of us who teach large, publicly-funded classes. For these instructors, if we cut off the instructor-directed elements (textbooks, continual reminders, poured-in information) our students could drop or fail. Since many of us can’t afford to let that happen, we have to be careful.

So yes, I support a shift from fully prof-directed pedagogies. But to a 50-50 model:

  • 50% prepared materials / 50% student-created materials
  • 50% open stuff / 50% closed safety
  • 50% instructivism / 50% constructivism or connectivism

Not quite a popular point of view in our increasingly polarized educational and political climate, but heck, I’m a pragmatist. Some students do better with the more instructivist elements, likely because they’re trained to it and it feels safe. Other do better with the more constructivist work, finding it more fun and interesting. I set up my classes with three areas of graded work: one part instructivist (quizzes based on reading), one part constructivist (posting primary sources), and one part a combination (writing assignments based on those sources).

I didn’t do this consciously – it has simply evolved based on my practical experience. Students are pushed out of their comfort zone, but only 50% of the time. They get the content I feed them, but only 50% of the time. My grade scale makes it possible to get a C in the class by being good at half and not good at half. That works for me.

Join the POT Chat in Facebook