{"id":392,"date":"2009-11-30T19:34:48","date_gmt":"2009-12-01T03:34:48","guid":{"rendered":"http:\/\/lisahistory.net\/wordpress\/?p=392"},"modified":"2025-08-18T13:08:04","modified_gmt":"2025-08-18T20:08:04","slug":"ramblings-on-assessments-that-work-and-assumptions-that-dont","status":"publish","type":"post","link":"https:\/\/lisahistory.net\/wordpress\/2009\/11\/ramblings-on-assessments-that-work-and-assumptions-that-dont\/","title":{"rendered":"Ramblings on assessments that work and assumptions that don&#8217;t"},"content":{"rendered":"<p>At this time of the semester, I am grading Participation Assessments. I do this twice each semester, asking the students to evaluate their own participation in the course as compared to <a href=\"http:\/\/lisahistory.net\/hist104\/pw\/grading2.htm#1\" target=\"_blank\">a rubric<\/a>.<\/p>\n<table  class=\" table table-hover\" border=\"0\" align=\"right\">\n<tbody>\n<tr>\n<td><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/lisahistory.net\/images\/f-test2.gif?resize=198%2C357\" alt=\"\" hspace=\"8\" width=\"198\" height=\"357\" align=\"right\" \/><\/td>\n<\/tr>\n<tr>\n<td style=\"text-align:right;\"><em>Clip art licensed from the<br \/>\nClip Art Gallery on<br \/>\n<a href=\"http:\/\/discoveryschool.com\" target=\"_blank\">DiscoverySchool.com<\/a><\/em><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>At the end of the first eight weeks, when they do this for the first time, there are often revelations. Students are grateful I gave the assignment, because now they know they aren&#8217;t meeting expectations. Many promise to do better.<\/p>\n<p>I learn from this that the assessment is important, because it makes them look at the <a href=\"http:\/\/lisahistory.net\/hist104\/pw\/grading2.htm\" target=\"_blank\">Grading Policies <\/a>page, where the rubric is. That page has been &#8220;required&#8221; reading since the beginning of the class. There were questions from it on the Tech Check\/Syllabus Quiz, which is the first thing due in the class. And yet most have forgotten it, or never read it, or didn&#8217;t think it applied to them, etc. till the assessment.<\/p>\n<p>What&#8217;s remarkable is that occasionally, the assessment at the end of the year also prompts discovery, or in this case, makes me aware there hasn&#8217;t been any.<\/p>\n<p>My ending Participation Assessment says:<\/p>\n<blockquote><p><em>After carefully examining the grading rubric, your logs, and forum posts for the second half of the semester, consider in what ways have you improved or reduced your participation from the half-way point. Please briefly explain:<br \/>\n1. how may points you received on the first Participation Assessment,<br \/>\n2. how many you think you should have for this half, and<br \/>\n3. why.<\/em><\/p><\/blockquote>\n<p>One student wrote:<\/p>\n<blockquote><p><em>&#8220;I&#8217;ve actually probably participated less since the class begun. I just try to learn the information that is presented along with information in my book and take the tests and get the best grade possible. I&#8217;ve always not really understood the class discussions, since i can usually do the test with out them and i am really busy. I don&#8217;t think i should get to many points in the participation section! I&#8217;ll try to get by and do my with the tests.&#8221;<\/em><\/p><\/blockquote>\n<p>This student didn&#8217;t have a single discussion post since the first evaluation, and seemed unaware that the discussions aren&#8217;t just chatting &#8212; they constitute the bulk of writing for the class. I tell them this, of course, but I say it in the forums! And there&#8217;s no evidence here that he looked at the rubric at all.<\/p>\n<p>I figure the <a href=\"http:\/\/lisahistory.net\/hist104\/pw\/grading2.htm\" target=\"_blank\">Grading Policies<\/a> page isn&#8217;t the only page not being seen by some. I know by looking at logs that many skip the Study Guides (and therefore don&#8217;t realize they contain all the multiple choice questions that will be on the forthcoming quiz). Or they don&#8217;t bother with the lecture. They read the book, and take the tests.<\/p>\n<p>In terms of course design, I don&#8217;t consider the discussion 20% of the <em>course<\/em>, just 20% of the g<em>rade<\/em>. It&#8217;s more like half the class, because it&#8217;s the processing and sharing of the knowledge learned via presentation and reading. It&#8217;s the heart, not a side activity. It&#8217;s lower stakes (not 50% of the grade)\u00a0 because I want the students to feel free to explore. I assume they&#8217;re looking at the grading, and figuring where to spend their time for maximum grade impact. But I see increasingly that they don&#8217;t do that.<\/p>\n<p>Rather, they make assumptions:<\/p>\n<ul>\n<li> Anything called a test or quiz is important.<\/li>\n<li> Anything called discussion you can miss.<\/li>\n<li> The textbook is the heart of the class and should be read carefully.<\/li>\n<li> Anything called an assessment could go one way or another.<\/li>\n<li> If it&#8217;s online, it&#8217;s self-paced and you don&#8217;t need to &#8220;show up&#8221;.<\/li>\n<li> All online classes are in Blackboard.<\/li>\n<\/ul>\n<p>They have to discover that it&#8217;s not that way, but to discover one has to explore. As I see all these wonderful ideas to get students to explore (using collaborative or <a href=\"http:\/\/en.wikipedia.org\/wiki\/Connectivism_(learning_theory)\" target=\"_blank\">connectivist<\/a> methods) they have to actually peruse the class website, understand the rules and the process. My class isn&#8217;t that much different from a traditional class, yet I have a very non-traditional element in the way I use discussion and participation assessments (where they get to assess their own learning). If students can&#8217;t even accept this, what chance do more radical methods have?<\/p>\n<p>I know, I have heard that one has to throw out the whole thing (university, grading, teacher-directed anything) for it to work. But I refuse to believe this. If I do that, I will spend the entire class with teacher-directed instruction on how to do the class! Once I created an (on-site) honors section where all we did was write one research paper, meeting an hour a week throughout the semester. Just one paper. Instead of talking history and ideas during our hour-long sessions, I ended up having to instruct them on <em>how to write a paper<\/em>. Even with a list to guide them, they did not know how to do basic college English 101 things, like make an outline, do basic research, develop a thesis. Of the 12 who started the section, only 3 finished. Their assumption? That I would lecture on history for the 16 hours, and they&#8217;d memorize it. My radical method was great for 3 students. That doesn&#8217;t hack it in my job.<\/p>\n<table  class=\" table table-hover\" border=\"0\" align=\"right\">\n<tbody>\n<tr>\n<td><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/farm1.static.flickr.com\/16\/22774997_d5026fc1c5_m.jpg?w=648\" alt=\"\" hspace=\"8\" align=\"right\" \/><\/td>\n<\/tr>\n<tr>\n<td>\n<div style=\"text-align:right;\"><em><a rel=\"cc:attributionURL\" href=\"http:\/\/www.flickr.com\/photos\/amagill\/\">http:\/\/www.flickr.com\/photos\/amagill\/<\/a> \/ <a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by\/2.0\/\"><br \/>\nCC BY 2.0<br \/>\n<\/a><\/em><\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>This means that designing an online class is not just an exercise in transferring pedagogy, or plugging things in. It is an <em>awareness that the exact same difficulties that haunt us in on-site classes are not magically solved online<\/em>. These challenges include students not attending class, not reading the syllabus, not understanding when they ask a question and it is answered, not asking questions when they need to, missing tests, having low reading ability, being inexperienced at processing basic information, and not being aware of cues given to help them.<\/p>\n<p>Sometimes we focus so hard on the &#8220;online&#8221; aspect of the class that we forget these problems exist, or think they are replaced by scary tech problems instead. The scary tech problem comes down to <em>one<\/em>: if the only way the student will understand what&#8217;s necessary is to be talked to into his face, then he will not understand. If he couldn&#8217;t understand anyway, no matter how many different ways it&#8217;s explained, then that&#8217;s the way it is. Whether it&#8217;s online or on-site, all we can do is provide resources and repeatedly remind the students that those resources (the instructor, the rules posted or handed out, the entire internet, <a href=\"http:\/\/education.indiana.edu\/%7Efrick\/plagiarism\/index2.html\" target=\"_blank\">that site or handout about plagiarism<\/a>) are there for them.\u00a0 We can try to counter assumptions, but we cannot eliminate all obstacles.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>At this time of the semester, I am grading Participation Assessments. I do this twice each semester, asking the students to evaluate their own participation in the course as compared to a rubric. Clip art licensed from the Clip Art Gallery on DiscoverySchool.com At the end of the first eight weeks, when they do this [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","jetpack_post_was_ever_published":false},"categories":[33,10,13],"tags":[],"class_list":["post-392","post","type-post","status-publish","format-standard","hentry","category-discussion","category-online-teaching","category-pedagogy"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/posts\/392","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/comments?post=392"}],"version-history":[{"count":1,"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/posts\/392\/revisions"}],"predecessor-version":[{"id":10040,"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/posts\/392\/revisions\/10040"}],"wp:attachment":[{"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/media?parent=392"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/categories?post=392"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lisahistory.net\/wordpress\/wp-json\/wp\/v2\/tags?post=392"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}