Why discussion sucks (and what to do about it)

Students at colleges around the country are told to participate, but why?

Since the dawn of online classes, the goal of college professors has been to somehow duplicate the excitement of classroom discussion. With the advent of the Read-Write Web (Web 2.0) fifteen years ago, the threaded discussion forum became popular, and immediately the pattern was set.

We do what we’ve been told to do: create a great prompt, not a yes-no question or something too shallow. We want everyone to respond to it, reinforcing readings or other learning in the class. Then, because we want student-student interaction, each student is required to reply to at least two of their colleagues. The prompt-post-reply model has held.

Never mind that this is not the way discussion happens in a classroom. There may be a prompt thrown out by the professor, but only a few students answer, and only if their answers can be different. We might set up small groups to get students to talk, but if we’re experienced we know better than to just say “discuss”. And we usually intervene to advance the discussion or take it in another direction.

Never mind that we haven’t bothered to ask why we’re doing online discussion at all. It’s discussion. You’re supposed to do it. Or you have to do something. Many colleges require “student to student interaction” for all online classes. But no one explains why. It’s just assumed to be a Good Thing.

And yet the result is often appalling.

The problem

Most online discussions are absolutely worthless to read (from an instructor perspective) and worthless to do (from a student perspective). The eager students answer the questions first and fully. The others trail along just to finish and get the points. Every student knows the drill: post once, reply twice. Then leave as quickly as you can and do not return.

If the prompt is a question, however intricate, or a specific task (“post your thesis”), then once their first post is done, the student’s task has been completed. The only reason to reply to anyone else’s post is because the prof told you to. That’s not interaction. It’s mandatory politeness, like saying “how are you?” when you don’t really care.

“I agree, James,” they write, “I also think that slavery was bad.” Nothing really happening there mentally, I don’t think. And James likely won’t return to see the reply anyway. Why should he?

A twist on traditional discussion

I went as far as I could with the method, in an effort to increase participation. I achieved discussion somewhat successfully with my two-step approach. This involved starting with a prompt that did not require previous knowledge, and set up some kind of moral judgement to get people engaged. Questions like “was it right to drop the bomb on Hiroshima?” or “did the Confederacy have a point about states rights?” or “was slavery essential to the growth of the United States?” got students started.

After they had all emoted about the topic for the first half of the week, I posted “Take discussion from here”. I used big font and a color for my post, and it summarized what they’d said so far, naming names of students who had made good points. Then I asked different questions that seemed to follow from what they’d said, questions that relied on their reading and used reason (rather than emotion) to deal with the main issues. Their second post was a reply to mine and/or to each other, to conclude that week.

It worked, in a way. But many students, having given ill-informed opinions to start, didn’t bother to return for the real work in the second half.

Designing for necessity

Sometimes, there’s simply no need for conversation. You read (or look, or listen), you do the work, and you’re done. Discussion should only take place when it is necessary, whether in the classroom or online. There are two things that can make discussion necessary:

  1. If talking together is essential to work something out or to complete a task.
  2. If the product of the conversation is going to be used, applied, or figured out.

So we could design for necessity. Let’s say I’m teaching design, and I demand on the discussion board that each student design and post a different carnival ride. Once they have posted, they seem to have finished the task. There could be no reason to ask them to comment on two other students’ designs. But if the next task is to write a short paper contrasting three designs (yours and those of two other students), then the comments become preparatory for creating something.

Or we could do role play. The class is to be considered a committee-as-a-whole for determining which route across campus would be best for the architects to create as a footpath. What information should be gathered, and how? Once results have come in, how will the data inform the decision? The deadline is Thursday, because the architects need to break ground.

Or let’s take my two-step discussion technique, where I start with something ill-informed and emotional, and then we get informed in the second step. I could have made it better by making sure that the discussion was used somehow, through a formal assignment such as a paper or quiz. The conclusions we developed could have been summarized and used to inform individual work.

The rules

So my new rules for discussion would be:

  1. ensure that conversation is inherently necessary to the task or subject
  2. design so that each student would naturally post something different
  3. create something that applies or uses the results of the discussion

Otherwise, I’d say there’s no point.

Discuss.

Perusing pictures

I almost forgot, in all the madness, that I am trying an experiment in my History of Technology class. I detailed the idea in my post from July. But I hadn’t implemented it till this semester.

First a review: in every class I teach online, instead of a traditional discussion board, I assign a set of primary source documents. I put these in Perusall (using the LTI in Canvas), uploaded as a pdf. Students then can select parts of the text, and annotate it. They can respond to each others annotations, and add images or video to help each other read the material.

This semester I’ve tried it with images. I put together two sets of images in Microsoft Word, one for images from the Book of Hours of the Duc de Berry (for the Middle Ages), and one for a collection of postcards from the early 20th century imagining the world in 2000 (for the turn of the 20th century). I then saved each collection as a pdf, and uploading them into Perusall.

I’ve just been reviewing the latter. The History of Technology class is always difficult to get talking. The class attracts a wonderful assortment of students, particularly those in computer science or who already work in information technology. They don’t tend to be much for chit-chat, and some of the written articles on technological history don’t interest them. The pictures, however, have created much more participation.

You can see here that not only did they comment on the images, but that they also replied a lot to each other (the bubble with the number is replies to the comment showing).

So I’m calling this one a success, and plan to do more!

Class annotation of images

This is another post where I share how I did something, solely so I don’t forget how to do it.

Perusall is a wonderful program for annotating documents with a whole class, and I’m currently using it for all my online classes, which are located in the horror of an LMS they call Canvas. I upload a PDF, and students and I can highlight the document, with a panel popping up for discussion. When anyone clicks on the question mark, it indicates a request for responses. When anyone uses @Someone, it notifies them someone has responded. I have used it to solve the “what if they don’t do the reading?” problem, since we all kind of do the reading together.

All this is great. The system “auto-grades” (though I have to set it then check it very carefully), and pushes the grades to Canvas gradebook on my command, so I can focus on the discussion itself instead of evaluating it.

But you can’t do this with images — just upload and everyone talk about it.

Except…you can. Perusall won’t upload images natively, nor link to images directly on the web. So I downloaded an image, and saved it as a pdf in Preview, then uploaded it. Then I clicked on a section of the picture. Instead of highlighting text, Perusall put a pin. I can then ask a question or make a comment about just that portion of the image. Click the pin, and the conversation panel opens.

But the interface itself takes up a lot of the screen, which we don’t want for images. So I’m going to show students what to do about that:

If they do it, then it will look like this:

More room for the image, less clutter. I’m thinking it would be possible to put several images on a page to be discussed for that week.

What it’s doing is similar to ThingLink, which I learned about from our wonderful art historians over a decade ago. But ThingLink and similar programs, although they can be embedded into Canvas with iframes, cannot track a student’s comments, nor auto-grade them. Perusall can, which shortens my workflow so I can focus on the discussion, just as I do with annotated text.

So, annotations for images when I teach a European history course that focuses on the Humanities, and a History of Technology class that can get bogged down in text? I’m in!

 

Prepping adventures: the big questions

To the dismay of some of my colleagues, and the delight of others (and the total incomprehension of most), I am continually preparing the next class. So, even though it’s June and I’m teaching three classes that started last week, I am thinking seriously about Fall.

Fall for us begins in August, so it’s not that quirky. And next term, for the first time, I will have an intern. The SDICCA program in San Diego County, in association with San Diego State University, matches Masters students with community college professors*. The intern will work closely with me the entire year, attending my classes and campus meetings, and learning from me as his mentor.

This requires a certain meta approach from me as I design and teach my classes, particularly the on-site classes. This opportunity was one of the reasons I wanted to be a mentor. While my ego does not require a minion to learn things “my way” (on the contrary), I do require that things change up a bit to keep me on my toes. The necessity to explain why I do what I do, and to change things in response to someone else’s thinking, is a boon. Although I do change things in response to students all the time, the power relationship there is quite different than that between mentor/intern, particularly as I intend to make clear I hope to learn as much from him as he does from me.

But one thing I must “teach” is class discussion, my bugaboo. I have only one class where I really do it, my early American history online. At the beginning of the week, I post a 5-minute video from a series that considers “both sides” of an issue, and ends with a question (for example, “Was the Constitution a democratic document?”). The first few days of the week, I allow students to respond with their ill-informed opinions, vent, argue, etc. Then mid-week I summarize their contributions and reframe them, asking new questions based on their input that nevertheless point them toward deeper, thematic issues that connect to the assigned documents. It works well for them, but requires a lot of work from me: it is very much instructor-guided.

Although I have done this also in a classroom setting (using video clips from controversial issues in the news), I feel that these days some larger, philosophical issues should be considered. I do not want to simply increase polarized views by encouraging evidence-based arguments. My goal for teaching has always been to train a person see the news of the day and connect it to similar “news” from the past, to put today’s events into perspective. That’s what history is — context. THE context. It’s the way we know what the present might mean.

When I didn’t know that my modern European History class would be cancelled last spring, I prepared a list of such questions, one per week. I wasn’t exactly sure what I would do with them, and I never got to find out. (Don’t get me started on how students are being told by equity-minded individuals to avoid European history, and how they are avoiding classes that require deep thought so they can more easily achieve “academic success”.)

I tied each question to that week’s area of coverage:

  • 1 Story So Far
  • 2 17th c Politics and Culture
    Should only people who own homes vote? -or-
    At what point should society’s leaders no longer be allowed to lead?
  • 3 Science and Enlightenment
    How important is reason as opposed to emotion?
  • 4 Enlightenment Economy and Society
    How should a country’s economy be regulated, if at all?
  • 5 Political Revolution
    Is there a point where the people can get too much power?
  • 6 Industrial Revolution
    Should we help workers who don’t make enough to live on? how?
  • 7 Socialist and Romantic Response
    How do ethics come into politics?
  • 8 19th century society
    How important is it that people have definite roles in society?
  • 9 Nationalism and Imperialism
    Does nationalism necessarily lead to treating others poorly?
  • 10 Great War and Russian Revolution
    Does war settle disputes?
  • 11 The Interwar Years
    How can fiction help us understand the present?
  • 12 World War II
    Why do people become followers?
  • 13 The Cold War
    How does one find ones place in society?
  • 14 Social Revolution
    How can literature guide people’s views?
  • 15 The Contemporary West
    What issues or values should transcend politics?

So now, keeping in mind the need to connect their own opinions to the topic, I’m starting here for modern American history:

  • 1 US to 1865
    Why study American history?
  • 2 Reconstruction
    What might have been a better plan for Reconstruction, and what would have made it difficult?
  • 3 The West
    What happens when we see people from the past as victims as opposed to people with agency?
  • 4 Incorporation and Immigration
    How do immigrants become part of the American story?
  • 5 Empire
    Does America still have an empire?
  • 6 Progressivism
    What should be the government’s role when capitalism causes problems?
  • 7 The Great War
    How should Americans who oppose war be treated?
  • 8 The 1920s
    In what sense is progressive thinking countered by traditional thinking?
  • 9 The Depression
    What is the government’s role in alleviating suffering?
  • 10 WWII
    How should the U.S. respond to authoritarianism around the world?
  • 11 Post-war and Cold War Politics
    In what sense do fear and restrictions of civil liberties go together?
  • 12 The Fifties (culture)
    Why is celebrity culture so influential?
  • 13 War and Activism
    When a college tries to make its curriculum “relevant”, what does that mean?
  • 14 Inclusion and Exclusion
    Which is more important to social justice, the laws or the courts?
  • 15 New Millenium
    What have been the impacts of the internet?
  • 16 Contemporary US
    What is the role of the idea of “privilege” in contemporary discourse?

I am not sure that these are the exact questions, or how I want to use them in class, but it’s a start to think bigger.

 


*It’s interesting. We are called “professors” in the press and in the commencement program, but when I asked for this designation on my college business card, I was told no. We don’t even get “instructor” anymore, only “faculty”.

The hour before the deadline

We all have stories, usually told while shaking ones head, of how students do things at the last minute.

Long ago, the deadlines for my online classes were set at 5 pm on the day something was due. But “everyone else” (the dozen or so others teaching online) set theirs at Sunday midnight. I would receive panicked emails between 5 pm and midnight, or after an assignment was graded late. So my nicely planned evenings of sitting and marking papers didn’t work. I changed my deadlines to Sunday midnight.

So when I began using Perusall for annotations, I asked, repeatedly, for students to participate beginning on Tuesday and ending Sunday midnight. Some do so. But many try to read five documents and cram in all the annotations on Sunday. This prevents the close reading I had intended by assigning annotations in the first place, an issue for another post. But it also provides a bizarre opportunity.

Perusall emails me when a student answers a question I’ve posted.  It also emails when a student tags me with an @. Throughout each Sunday, these emails increase, with a flood of them in the last hour: 11 pm to midnight.

If I go into Perusall on Sunday night between 11 pm and midnight, I can participate in the discussion, adding questions and using @ to reply to individual students, and I’ll get a response. It becomes almost synchronous.

I’m not saying I do this every week and every class, but if I’ve assigned a particularly difficult document (last week’s Henry Miller: Tropic of Cancer comes to mind), I can engage a great deal of the class at that hour.

No, I’m not recommending this. But it does seem to open potential for the last hour before the deadline. I have a colleague who uses Google Docs and notices that same activity shortly before the deadline — he sees the number of participant bubbles at the top increase as he watches.

So I wonder two things. First, is it safe now that we have many online classes to change deadlines to a more reasonable hour? And is the last hour before the deadline an opportunity to teach that we should be using?

Grade work, not students

It seems like a technology thing, but it isn’t. Of Moodle, Blackboard, and Canvas, only Moodle lets you grade posts, not students.

Bb and Canvas both let you use rubrics/ratings to grade discussions, but both want to grade by student rather than post. Canvas even forces you into one grade per student, regardless of how often they posted.

This is a perfect example of bad pedagogy embedded in the technology. It’s based on the idea of grading students, because students get the grades.

But I don’t grade students — I grade work. In forums for posting primary sources, I rate each source, using qualitative scales — primary source fulfilled, live link needed, full citation needed, etc. These correspond to number grades that go to the Gradebook, but what the student sees is the comment, indicating which corrections they need to make.

And in Moodle I can grade them all with drop downs, because a single, simple forum is all on one page. Super quick.

Bb and Canvas’ insistence on grading per student means several clicks per student, per class, every week, for every source posted. Bad pedagogy, bad workflow.

Perhaps if these LMSs considered that we were grading work rather than students, it wouldn’t be designed like this. When a student asks “did you grade me down?” or “when you grade me, remember I have four classes”, I always point out that I never grade them, only their work.

How did we get to a place where the default is to grade students? Is it our educational culture, associating a person’s work with who they are? Surely that’s a bad idea. When we conflate a person with their work, we imply that their work is not only a product of themselves, it is their self. Every critique become a critique of the self.

We mustn’t embed bad ideas into immutable systems. Really.

 

Embedding Hypothes.is in Canvas

This is one of those posts I’m writing so I don’t forget how to do something.

After testing Hypothes.is for annotations, and realizing that the Redirect Tool in canvas would force an ordinary webpage with annotations to only open in a new tab, I figured out something.

Canvas will only embed secure (SSL) pages (those with an address starting https://). All my web pages are just plain ole http. But it turns out that my host, Lunarpages, can create an SSL page by just using the URL of the server (https://fand.lunarserver.com/username + rest of the URL). So any page I already have can become a secure page by using this URL instead.

So to make this happen automatically, here’s the workflow:

1. Create my own webpage with text and images.

2. Include the hypothes.is code in the HTML of the page

https://hypothes.is/embed.js

3. Use the Redirect Tool in Canvas, using the URL of the page, but with the Lunarpages server preface (in this case https://fand.lunarservers.com/~lisahi2/)

redirectapp

4. Voila:

hypothesisincanvas

Floating discussion as a new fix for an old problem

Online discussion often sucks. The prompts are answered best by the first few go-getting students, and everyone else can only agree. Or the prompt is designed to elicit opinion in order to prevent repetition, and devolves into the sharing of personal beliefs without much connection to the class. I’ve avoided the whole thing by making my forums focused on posting primary sources.

Then there’s the issue of where to put the discussion. One giant discussion board with many topics and multiple clicking? A discussion each week, where ideas are abandoned as the class moves on?

Having eliminated weekly discussion as being useless, I have been putting one main forum at the top of each class (called the Coffee House, or Pub, or Tavern, depending on the class). I ask them to post their introductions there at the beginning of the class, but since I don’t require it for a grade, hardly any one participates after the first few weeks. That’s not surprising – all the rest of the work is listed in a weekly block. Why should anyone go back to do anything at the top of the page?

Right now, the last weeks of class are upon us. In my modern US History classes, I decided to add a discussion of current events,  to take place in the last week. Instead of creating a new forum, I just moved my Coffee House to the final week’s block.

migratingdisc

Then it hit me – I could do that throughout the semester. Have one big board with topics, but add each topic when I move the forum to the weeks they belong. For example, the first week in US History is Reconstruction, but I don’t want a discussion in the first week, while they’re getting used to the class. But when we get to the next week, on The West, I have a question about victimization that makes for good discussion. I could add that at the beginning of that week, then keep pulling the forum down to the weeks where there’s really something do discuss. The forum would migrate according to the week’s topics.

Since I haven’t done this before, I might want to make it extra credit with an expectation to post, rather than a required element.

The advantage would be that all previous discussion would be available each time, and the tracking would be easy with only one forum.  Might be a good idea…

A really good start

Every semester I encourage students to start their online class by posting in the forum (variably called the Pub, or Coffee House, or Taverna, depending on the class). I usually ask them to do a couple of things, like update their Profile, take a distance ed readiness quiz, and introduce themselves. Although I encourage them to reply to each other and make connections, I always have classes where it’s all left-justified responses to my post – they don’t talk to each other.

This semester is totally different – they’re all talking about what it’s like to take an online class, and what their hopes are for this one, and how they’re getting organized to stay on track (not staying on track is, to my mind, the #1 reason for failure in online classes).

What made the difference? Well, I made a video about the class, but I’ve done that before. No, I’m convinced it was putting this video, usually just a link for the class, embedded right there in the forum.

I’m guessing that they “see themselves” in the video, students like themselves. They watch it because it’s right there at the start of the class, inside the discussion, right at the top.

The video is patched together from last year’s extra credit assignment, where I asked students to make a video clip with advice for new online MiraCosta students. I graded them higher if they filmed on campus and offered a really good tip. They had to give me permission to use their video publicly. Then I just edited and uploaded to YouTube.

It will be interesting to see how things go from here. Will they talk more in the posting forums, where discussion is not required? I don’t even have a grade for discussion or contribution this semester. Will they stay motivated? Will they stay enrolled? Let’s find out.

Whose discussion? (my 500th post)

For years, I didn’t have a “discussion” in my online classes. When I changed the discussion forum to a workspace, a place for students to post primary sources to support their writing, I didn’t miss the “I agree” posts or the obvious display of ignorance intended to pad a certain number of posts a week.

What started cropping up, though, were bits of discussion. A reply to a primary source, or to a writing assignment, because a student was particularly moved or related to the subject. And there didn’t seem to be enough opportunity to discuss issues in history, controversies and interesting perspectives that weren’t covered in the material. Plus, it was clear to me that the students had too many writing assignments. I was asking for them weekly, not very big assignments, but because they were scaffolded they required a lot of grading and feedback. That was hard to do with so many students, and they were getting bored with the work even if I wasn’t getting bored reading them.

So last summer, where the 16-week class is compressed to 8 weeks anyway, I had the students writing weekly, but there was also a discussion. I assigned students to groups randomly once the enrollment settled down. Then I made simple instructions, and modeled by leading the first discussions myself.

disc1

discfirsttopic

In the third week or so, I posted the student-led discussion forums, with instructions like this:

Grading was just rolled into the Contribution Assessment grade at mid-term and at the end of the class.

The result was excellent last summer, so I decided to keep it going this year. I model the first two discussions with questions and ongoing participation, then the groups are supposed to take over. This semester has been very different from last summer, however. A couple of groups had to be contacted to remind them to start discussion. One student wrote me complaining that another student had plagiarized his discussion question off of an educational website instead of creating his own. Now in Week 12, the discussion participants are fewer in every class.

So what’s different?

1. The instructions are a little more specific.
Last summer I was pretty vague, and didn’t insist that they connect topics to lecture or readings. While I added this to bring the focus onto the course materials, it may have stifled some freedom.

2. The discussions are every other week in the 16-week format.
This may have encouraged lost attention and boredom over time. A shorter, compressed format seems to keep focus better in general. This may be a good argument for 8-week classes.

3. The Contribution Assessment happened only once.
I was doing a mid-term and end-of-term assessment, but dropped the latter because the point of it was to help students recognize and improve their performance, and it’s too late to do that at the end of the class. But I may have gotten rid of a stick/carrot motivation for participating in discussion during the last half of the semester.

4. The students are different.
Last summer I had one Western Civ class full of university students, and one US History class full of typical community college students. At the start of the term, the university students were gung-ho, then they faded. The community college students’ behavior was reversed — they started slowly and gradually became more engaged. So I assumed that I would see similar patterns. But in all of this term’s five sections, there is just one pattern — about a dozen particular students are really into discussion, and the others are just posting to post. I can tell because they don’t reply to each others’ posts, just to my prompt.

So what to do for this summer? I think I should keep the format. But for next fall? Should I create my own discussions? Drop them again? Gotta think on this one.