It’s only taken me 17 years of teaching online to develop a student survey that is both broad enough to cover all my classes and narrow enough to give me good feedback.
Just sharing a few things here. Total students responding was 131. Most students responding were passing the class.
They still like my lectures the most, and textbook readings the least. They still like posting their own primary sources.
Hours and hours of work on that Help Page and – no surprise given what they email me about – they don’t use it. They do like seeing the whole course on one page (so I won’t switch to showing only the current week, an option in Moodle) and they like my comments and the audio of my lectures (I’ll read it for you!). The None category is a little depressing….
The engagement results are clear, too. They like the lectures and posting their own source. They don’t like reading much. But they really liked what I added this year – the completion checkboxes on the Moodle page. I will be sad to lose that. But note: they like seeing each other’s work, but don’t require contact with other students. I’ve been saying that for awhile – collaboration and teamwork is online classes is not always needed. For my class, engagement with the work and posting what you find may be taking the place of “interaction” among students. They can learn from each other without necessarily engaging in forums in response to each others’ posts.
A draft of another tripartite idea, this time focused on online classes in general, across the board.
Run inside an LMS, or even better by Coursera or Udacity, and/or offered by proponents of the mass-produced course (U of Phoenix, Ashford, etc), the McClass features recorded lectures, an unmoderated internal discussion (if any), and grading by graduate students, peers or staff (and soon robo-graders). All xMOOCs are in this category, but so are classes created by teams of instructional designers or course developers and “content experts”, but facilitated (I hesitate to use the word “taught”) by less experienced instructors or program coordinators. Sartorial analogy: one size fits all.
The sub sandwich class
It’s a six inch or a twelve — you can change the mix of ingredients inside but the options are standardized. Sub sandwich classes are offered by community colleges and universities dependent on a single Learning Management System, the inherent design of which influences (and may determine) instructor pedagogy. Even built on a whole wheat system like Canvas or an in-house product, the defaults of the LMS are easy to adopt without requiring an examination of ones own pedagogy. Hallmarks include dependence on publisher-produced materials, and an internal, traditional moderated discussion of issues, usually lacking a constructivist focus. Quality varies and is partly dependent on the freshness of the ingredients.
The artisanal class
Created by the instructor, the artisanal class includes only those elements that help realize the instructor’s pedagogy. The design is developed based on knowledge and experience as an active, independent teacher. The artisanal class may exist inside an LMS, but when it does the LMS is substantially customized, and often external web elements are brought in to replace built-in features (blogs, wikis, etc). Hallmarks include a foundation in free and open or home-made formats, innovative assessment techniques, and a distinct lack of top-down control. Discussion may be distributed or focused on content creation. Flaws add character and provide opportunity for community creativity. Most cMOOCs fit this model, but so do classes offered by public institutions who allow faculty substantial control over the design and deployment of their work.
Lately I’ve been engaged in a conversation in G+ with Laura Gibbs, George Station, Donna Murdoch and Edward O’Neill. We’ve been talking about the current controversies in higher ed in terms of the value of on-site versus online education, in particular the role of the physical classroom, and the extent to which it may no longer be needed. The question of whether the online classroom will/should/can replace the physical classroom is, of course, a very old (what, 14 years?) topic. But I’m seeing different metaphors now.
The most significant, I think, has to do with space in which to think. For example, I personally like a certain amount of clutter. I like to be surrounded by books and objects. But I also find clearing counters and hiding objects create a different kind of work space, one more conducive to contemplation as well as relaxation.
If we accept that when people learn new things, they need space and time for reflection, the question with online learning concerns the environment where reflection can take place.
My classroom on campus
The physical classroom, at least at the college level, is often a fairly sterile space, without much clutter. I recall when I was first hired that I frantically hung posters on the walls and wondered why there weren’t any bookshelves in the room. It seemed like a place that was too clean and bare to learn anything.
Now I look at my computer screen, cluttered with disorganized files. And my browser, with its many tabs open. Emails come in, ads pop up, while I work and try to learn things. Yes, students have grown up with multiple distractions like this. But in many ways I’m actually more accustomed to it than they are, since I grew up hating silence and quiet. I had the TV (not the radio – that’s only one input) blaring while I wrote every paper in college and grad school.
At the same time, I know many students who do very little classwork outside of the physical classroom. On-site students seem to think that everything to do with learning should take place in that space. It’s a challenge I’ve been working with for a number of years. I was “flipping” the class before it had that name, moving more and more analysis into class time, reducing lecture and shifting the delivery of facts to out-of-class time. The result, predictably, is little reading or listening outside of class, which I anticipated. I now aim for balance.
In declaring the end of Higher Ed as we know it, Edward O’Neill writes that we have a Higher Ed system based on mistaken beliefs, such as proximity being necessary for quality, and learning being transmitted by contact with smart people via osmosis. He writes
In short, colleges and universities are to the mind what monasteries once were to the spirit: places where you lock yourself away in close proximity to powerful souls whose vibrations will influence you deeply by a kind of prayerful osmosis.
Monasteries were a place for the mind also, as were medieval universities where a great deal of “study” (quiet, independent study) of texts was key to learning. Even today, most of the great intellectuals, whether they are teaching at universities or not, would tell you of many hours spent in contemplative study. I always find it amusing that so many of the techno-utopians and 2.0 educational reformers have degrees and knowledge based on extensive book learning. Deep learning can’t happen without deep reflection.
So, in the online world (by which I mean both online classes and the always-on-electronic world where many of our students live), where is the space for contemplative study? Could it be the physical classroom?
In suggesting a special place for the physical classroom, I risk the wrath of my colleagues in educational technology, MOOCs, and the other wonderfulness that is learning online (maybe Jim Groom will ask me which side I’m on again!). But I have seen students who need the physical classroom to learn, and it isn’t just because of osmosis or time management issues or tradition or industrialized education or Pavlovian training.
They need it because the physical classroom provides the only even partly contemplative space they have, a space where they are supposed to pay single-minded attention even if they choose to watch surfing videos on their laptop instead, a space where they are supposed to think about one subject for over an hour, a space where some of them actually learn better than online. I have students contact me when they’re not doing well in an online class, and they are very apologetic that they just seem to “need the classroom”. Ira Socol noted, in rejecting the flipped classroom for public schools, that a lot of kids do not have a supportive environment for study outside of school. That is still true in college. We’re a commuter campus with limited library hours. I have students who were kicked out of the house when they reached 18, or can’t think at home because they miss their deployed spouse. They need classrooms.
Our exciting “new models” for higher education are models that counter industrialized and standardized education, which is great. They emphasize collaborative work, social learning, and the affordances of the web in achieving greater learning through guided exploration and community, all fabulous things. But in promoting them as a substitute for “old style” learning, they also risk eliminating a place that may have become the last monastic space in which to work with the mind.
Finding myself arguing social benefits of an LMS was a sobering experience. It happened tonight in a COOLCast featuring Bon Stewart, who had mentioned that she prefers networks to systems like Moodle because the students can find each other. I shared my story of discovering students finding each other using Moodle Messages. Then I actually argued that some students might feel more comfortable contacting each other inside an LMS, where there is a commonality with other students, all of whom are taking the class. This might be more comfortable than Facebook, where you are supposed to be “friends”. In the LMS, you are clearly colleagues and might feel freer to call upon each other for, say, help with the class.
This, combined with my last post including some good things about an LMS or course blog, means I’m diluting the Kool-Aid.*
I know the strong flavor of connectivism, the headiness of open networks, the high of networked learning. I’ve experienced and studied it in the CCK08 class four years ago, in the joy that is ds106, in Twitter, in Facebook, and Diigo and Google Plus. I am a networked person, a networked teacher. I’ve read Vgotsky, Holt, Tapscott, Gladwell, Kamanetz, Rheingold. I’ve taken class with Siemens, Downes, Cormier, Couros and Groom. My articles on why Learning Management Systems are badly designed and anathema for novice online instructors still hold true.
Yet I’ve been continually skeptical (some would say critical) of ignoring the bad impacts of social media, the privacy violations, the perpetuation of teenage popularity contests through such sites as Technorati and Klout. I’ve also read Lanier, Bauerlein, and Carr. And I’ve watched in horror as the wonderful openness that is MOOCs gets commercialized and monetized and universitized and systematized.
I’ve used Blackboard and Moodle and WordPress. I’ve watched my own students get lost, inside and outside an LMS. I’ve seen them ignore the obvious, mislay the instructions, forget the deadlines, fail the class, inside and outside an LMS. I’ve also seen them fly outside the box, discover wonderful things, build their own learning, both inside and outside an LMS. In my SMOOC I’ve guided a global contingent of adults in using their own blogs, aggregated to a central blog, and had some get lost, and some get joy.
And each semester I agonize over using Moodle again, feeling trapped in my 6 sections of 40 students each. But I am not a novice online instructor. I create meaningful assignments, and make informed choices about what I have my students do and not do. I can force an LMS to do what I want. So why do I feel pressured to “network” my students’ class experience? Will their learning really improve if they search the web for primary sources and post them on their own blog instead of in a dedicated class space? Will they learn history better communicating with fellow (18 and 19-year-old) students in the space where they talk to their friends? Will they become better historians if they follow their own interests to the exclusion of, for lack of a better term, the canon of historical “content” considered basic knowledge in other countries?
All the flavors are important: self-directed learning, open education, constructivism. But a watered-down version, inside an LMS or on a common blog, can let them join the party without passing out in the bathroom. They can use the open web for their research, finding their sources, then return to the familiar “classroom” to get information, post their work, discuss with colleagues.
But me? I can drink the Kool-Aid straight up to study all this. I want it as strong as I can get it for my own learning about the web as an environment for learning and an educational tool. But I wouldn’t want that if I were taking an online class in biology, math, or literature. I wouldn’t want to go find my colleagues in Facebook if I didn’t understand that Coleridge poem or what Assignment 1 was supposed to be about. I’d want a classroom, and class colleagues, and a space I know is dedicated to learning. I’d at least want to start with watered down Kool-Aid and a sippy cap, then get the strong stuff in a big girl cup when I have more experience.
Or, at least, that’s what I’m thinking today.
* Cultural literacy note: “drinking the Kool-Aid” is a tasteless reference to the Jonestown Massacre
The focus on technology for teaching becomes increasingly dangerous, and the only response is to articulate ones own pedagogy and be prepared to defend it.
More and more articles imply that teachers who don’t use the current gadgets and technologies are illiterate and useless.
On the other side, in a recent article, it is gleefully pointed out that Michael Wesch’s methods (which rely heavily on Web 2.0 and student exploration) may not be suitable for everyone, as he observes another professor doing quite well with lecturing. And yet Wesch’s awe at the effectiveness of another professor’s non-technology-based pedagogy should not be surprising, because Wesch is a good teacher who sees that different pedagogies may be equally useful.
Ed tech pushers try to force people to get trained in technologies that may soon be worthless or, worse, may force the pedagogy of the instructor into modes unsuitable for that person’s teaching style. I have refused to use far more technologies than I have adopted.
Luddites would have one believe there are no improvements to be made in classroom teaching. While this certainly isn’t true overall, it may be true for those who experience success in the more traditional methods. There is simply no proof that the charismatic lecturer teaches more poorly than the Web 2.0 devotee. Hattie’s studies indicate that student achievement is only related to a few teacher-controlled areas, and that these are primarily feedback, student’s prior cognitive ability, and instructional quality (knowledge, guidance, more feedback), none of which require technologies beyond a space with a roof and some writing materials.
Meta-cognition about pedagogy is what’s valuable here. In a world where some want to push people to use educational technologies (including Blackboard and other expensive college-wide systems) and others want to drone on and on or read from the book and call it “lecture”, we must all be prepared to defend what we’re doing. This is true whether we’re in a formal faculty evaluation or a hallway conversation. The ability to do so is an important skill, or we’ll get overwhelmed by supposed “improvements” that can do a great deal of harm to our effectiveness as teachers.
Few of us were asked to consciously develop pedagogy when we began teaching. We were either left alone or given a specific model to follow (deliberately or accidentally). We assessed our own effectiveness through how well we thought students understood, and what grades they earned according to our standards. Most of us got upset when students did poorly, and changed our pedagogy and materials (often every semester) to try to “get through” and improve results. In this development, we came to believe that certain things were important and other things were not, and through experience created our own pedagogical framework. We operate within that framework every day, keeping what seems to work and changing what doesn’t.
But we must learn to articulate why, to understand our own strengths and the reasons we teach the way we do. Great lecturers should not need to justify why they don’t use the web, unless they are in a research field and are refusing to help their students access the world of information. They should not be forced to engage in small-group activities or other techniques that do not work for them. You cannot use a technique effectively if you can’t do it well, and none of us does everything well. We try to do better (I am currently working on guiding large-group discussion, an area of weakness), but we must be allowed to use the techniques that we find most effective.
So don’t come into my office shaking your head because so-and-so just won’t use the web for his classes. I don’t care. Does he teach well? Does he know his subject, communicate it effectively to students, and assess their understanding? Can he articulate his pedagogy and justify his method?
We also need to be prepared to do this for online teaching. Here the training and understanding of technology is necessary, but its purpose is to achieve our pedagogy in an online environment. The equivalent of the boring classroom lecture is there online too, in posting Word documents in Blackboard, asking a few questions in the discussion forum, and assuming the class will run itself. Good lecturers must learn the technologies to get that energy online if they want to replicate their pedagogy in an online environment. Teachers who excel at groupwork must learn the technologies to do that effectively in an online setting. Those who want to use a guided exploration technique may naturally be led into Wesch-style 2.0 teaching.
All these can be justified if we focus on our pedagogy instead of who “gets it” with technology and who doesn’t.
This week I have been attending to the various discussions around the recent work of Jon Dron and Terry Anderson, including the Hot Seat forum related to the 8th International Conference on Networked Learning (no, I’m not going to Maastricht) and Jon’s presentation at the Change MOOC (the web space for this is here). Sources also include Dron and Anderson’s 2009 article Lost in Information Space: Information retrieval issues in Web 1.5.
I am intrigued and delighted with an approach I see as middle ground between the Web 1.0/closed classes/LMS/hard tech/group focus and the Web 2.0/open education/network/connectivism focus.
For the former, the model seems to be formal groups of people, such as a class, using closed but comfortable ways to learn online in a manner prescribed by an instructor, with the result being a grade.
For the latter, we have the open ideas of networks, learning taking place in weak and strong connections, with softer technologies that provide for more creative work. Looser forms of assessment (such as badges and feedback) follow this model as well.
In the middle of this dichotomy is what Dron and Anderson call Web 1.5, and what they refer to as “sets”, unintentional collectives of people who learn within a shared interest. Thus there is a middle ground between the horribly limited, walled garden system and the wild, diffuse, scary openness of networks.
These discussions are especially timely in light of my own efforts to find such a balance between closed/open, safe/scary, hard/soft in designing my online classes for next semester, where the unscary stuff (my own work, such as lectures, information, readings) is completely open, but the scary stuff (anything graded, such as student forums, quizzes, and essays) is closed in the Moodle LMS.
It is not, as I’ve noted, an ideal balance or compromise, because unlike the Elgg VLE used by these authors, I do not have granularity of permissions where students may choose exactly what elements of their work are open or closed.
I had thought that creating a broader “group” in Facebook (of all my students, not just those enrolled in one class) would design some openness for them, but of course I have been reminded that Facebook is closed too. It’s just an LMS with advertising, and a flat social space. On the other hand, at least there isn’t any hierarchy, and perhaps there is comfort there within a more open way of communicating, if not a more open role.
As much as I love the far out, wild west, final frontier elements of open web-based learning for my own use, I do not think my students are ready to the extent that I could handle helping 240 of them manage it. At the same time, the limitations of LMS-based education drive me crazy. So it’s productive to envision Web 1.5 pedagogies that could, in Jon’s Goldilocks analogy, get to a point of “just right”.