tag:blogger.com,1999:blog-50793046818023440592024-03-04T23:01:52.243-08:00Student AssessmentRobert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.comBlogger82125tag:blogger.com,1999:blog-5079304681802344059.post-47660065332432110362022-03-27T23:02:00.003-07:002022-03-27T23:02:39.017-07:00What students take from our classes
Just reading a piece of science on the web (background microwave radiation) and then happened to glance at the comments section and was struck at how random the comments often appear to be. Leaving out the obvious spam ("Hi, I have a large collection of meteorites I'd like to sell") there are those who debate the implications of the finding (fine!) and then there are those who just go off on wild tangents -- "well, that proves there is/isn't a god", that "it explains why it rains so much", or "is the Earth conscious"? <P>
And it occurred to me that the comment section of online columns, news reports etc., give me a bit of insight into what my students are actually thinking as I lecture -- that what I think I'm talking about and what is actually going through their brains at any given moment are probably largely unrelated. That while I'm lecturing, what they are taking in as initial input is then filtered through a kind of free association with the stuff already in there, and what they consequently take away from my lectures probably has very little overlap with the objectives listed on my lesson plan. Given what I see on their exam answers, I've always known that what I said and what they recall may not correspond all that well, but I've never really been able to open their heads and see the squirrel's nest of random associations that leads them from what I said to what they got. Unmoderated comment sections give us a Kind of view inside what the average citizen is thinking...well, I use the term 'thinking' somewhat loosely.
<p>
One thing that might help: actually telling our students what the lesson objective is for today. A lot of teachers seem to feel this should be "teacher-only" secret information. Which is bizarre. As my mentor used to regularly say to me, students can hit any target they're shown and that holds still for them. If their is a point to today's class, probably best to tell them that at the outset, but certainly by the conclusion of the class.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-52822209456284374182020-11-14T19:40:00.005-08:002021-10-15T18:31:47.829-07:00Exam security<div class="separator" style="clear: both;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjFghlwVIGMzVl6cQ1hsabW-jFKQYP7K1HLPecT9iO4Lo1o44Q5cAZdbFknALGZNT9zPe07z2tNV7zm013AbhniF36cNqgUAfzyXde9Jfqeg3D8JvNLsAXbVy1EmNVy4qwPGNrutng-3R1h/s424/final_exam.png" style="display: block; padding: 1em 0; text-align: center; "><img alt="" border="0" height="400" data-original-height="424" data-original-width="281" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjFghlwVIGMzVl6cQ1hsabW-jFKQYP7K1HLPecT9iO4Lo1o44Q5cAZdbFknALGZNT9zPe07z2tNV7zm013AbhniF36cNqgUAfzyXde9Jfqeg3D8JvNLsAXbVy1EmNVy4qwPGNrutng-3R1h/s400/final_exam.png"/></a></div>
<P>
This is funny, but also not. At a certain university (NOT the one I taught at) the IT department invested a quarter of a million dollars on a new security system, touted as unbreakable. The instructor in an advanced graduate course in the computer science department made that week's assignment to break the security system, thinking it would be humbling for the students to encounter at least one assignment that was not doable. My friend, a computer genuis, broke in to the supposedly secure system in about an hour, and posted his "how to get around security" assignment on the [open] class website, as per the assignment directions. By the end of the evening, every computer geek on campus (and beyond) had a copy, and the new security system was thus rendered useless. My friend was summoned before the Dean, but simply brought a copy of the assignment, complete with directions to load the completed solution on the open class site, and was pretty much off the hook (though he had to listen to a long lecture on 'judgement' and 'taking initiative against security breaches rather than creating them" and so on). What happened to the prof, I was never told. The morals here are: (1) don't be a wisenhimmer and assign criminal acts to your students, even if you think it impossible or that they will get that it's a joke assignment, (2) don't assume your students aren't way smarter than you are and can't do something just because you can't. Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-28283329067405722532020-10-20T15:12:00.003-07:002020-10-20T15:12:59.907-07:00The difference between teaching reading and teaching writing"Give someone a book, and they’ll read for a day. Teach someone how to write a book, and they’ll experience a lifetime of paralyzing self-doubt."
<p align="right">—Lauren DeStefanoRobert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-15683368032989375202020-09-15T10:19:00.001-07:002020-09-15T10:19:59.788-07:00Providing feedback on Student WritingHere is an excellent essay on editing student writing by Ilana Reimer from Editors Canada:<p><a href="http://blog.editors.ca/?p=6956">http://blog.editors.ca/?p=6956</a><P>
That article also linked to this other excellent article on teaching writing<P> <a href="https://curiosityencouraged.com/help-students-revise/">https://curiosityencouraged.com/help-students-revise/</a>Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-27921492555161134282020-07-04T18:00:00.000-07:002020-07-04T18:00:14.527-07:00Homework and Worksheets<br /><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhpkAfSI6oqaaAHXQlmLGpI8zeaJj3hMChn2FUa57d4F1IlvXu4_aorPnjv3pBj_XiyFRv4Kmt4jHPqZzMSyLWteMpQSSehTwL5h5O-FA3Q_zyf1I8y7tzjF54SWohzaxpQmvAOGg0vxUr9/s524/assessment+blog.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="165" data-original-width="524" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhpkAfSI6oqaaAHXQlmLGpI8zeaJj3hMChn2FUa57d4F1IlvXu4_aorPnjv3pBj_XiyFRv4Kmt4jHPqZzMSyLWteMpQSSehTwL5h5O-FA3Q_zyf1I8y7tzjF54SWohzaxpQmvAOGg0vxUr9/s320/assessment+blog.jpg" width="320" /></a></div><P>
This Foxtrot cartoon strip has been circulating on the internet these days and raises the question of the relevance of completing homework or in-class worksheets.
<p>Adults may recall that when math homework was being assigned in the 1950s,60s,70s instructors often said, "Do questions 1, 4, 7 and 9" There were two reasons for this. First, those were the questions that had the correct answers in the back of the textbook--the answers to 2,3,5,6 and 8 were wrong. There was a famous study of math textbooks that found that something like 38% of the answers in textbooks were wrong, because *sloppy*. Wrong answers in textbooks drove students insane, of course, as they worked and reworked questions trying to figure out why their (correct) answer didn't correspond with the (incorrect) answer on the answer key. On the whole, textbooks are held to a higher standard these days (in math, anyway) so that's less likely the reason your instructor is skipping questions now.
<P>
Which bring us to the second reason: worksheets and textbooks have more questions than necessary to demonstrate a student's knowledge. Pratice makes perfect (okay, makes satisfactory) but some students need more practice than others. Even great students are going to blow the occasional question through some silly mistake or through misunderstanding the concept. Consequently, they need a second or third practice question to see if they have the concept or can avoid careless mistakes this time. Weaker students may need to work through half a dozen examples before feeling confident they have it. So I don't have a problem with worksheets/homework that provides a lot of examples, or with teachers who chose questions 1 and 4 to start with, because 1 tests a different concept than 4, so teacher needs to see both of those, but not necessarily 2 and 3 if 1 was done correctly.
<P>
But that does bring us to the question raised by the above meme: if a student has demonstrated his proficiency with a sufficient sample, should we be wasting the student's time by penalizing not completing every question. Obviously they can't stop half-way through the sheet because later questions may get harder, and we need to see if the student is up for the more challenging examples; or later questions may test quite different concepts. But young Mr. Fox has it right when he did a representative sample of questions from which it would be reasonable to coonclude he had mastered the skill being tested. Too often teachers confuse means and goals, enforcing completeness rather than trying to identify if the student has particular skills and knowledge. The purpose of any assessment is to find out what students know and can do, so that the teacher can (a) reteach missed concepts and (b) know whether it is possible to move on to the next learning objective. Too often, however, worksheets and homework become about which students can tolerate tedium, are the most compliant, and who never question whether directions make sense.
<P>I like to think most teachers are interested in teaching concepts and skills, not subservience to authority figures. Yet I regularly encounter instructors who say things like, "This student is one of my best, they know the material backwards and forwards, but I can only give them 50% because they never complete their work." No, that's not a bad student, it's bad assessment. If your sense is the student knows their stuff, and (if one took the time to actually <i>look</i> at their worksheets/homework rather than just run over it with an answer key to document whether they are covering all the necessary concepts and difficulty levels, then assigning them a lower grade is simply inaccurate. If you're going to use worksheets/practice homework, get it right. Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-16646991403034478822019-11-25T13:45:00.000-08:002019-11-25T13:45:58.720-08:00Curving Class Grades<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiIgzP4J0KEtKJ94E1AHx83hd1VbjDemdJPOSFYFe8IR0C5191X91tNJuOOB6l2_MICRIKo9E4X7GqeXed0tQrlz4pyimJiE-_fMXuMeusKGCa4cOQoVaxmesB84RAlV6o9zhGv5AWISYCW/s1600/curving+grades.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiIgzP4J0KEtKJ94E1AHx83hd1VbjDemdJPOSFYFe8IR0C5191X91tNJuOOB6l2_MICRIKo9E4X7GqeXed0tQrlz4pyimJiE-_fMXuMeusKGCa4cOQoVaxmesB84RAlV6o9zhGv5AWISYCW/s400/curving+grades.jpg" width="400" height="400" data-original-width="960" data-original-height="960" /></a>Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-26920703610217266462019-07-15T13:33:00.000-07:002019-12-12T19:25:29.593-08:00Question writing<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiY9NbyCkxcycB5cJW-5iKTHTkCv6QofSKCdwqjJd-LMAo1iUVPuoWWwUJ4wQqiwJd47r1t1XYToMqcMicmsadCkKHzp3LOsNM_Hfz9OkDbT0REuXwFaWKx6OTAumboFwFKWvRNRncA0dUi/s1600/67277044_2753187414709686_5141748470960357376_n.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiY9NbyCkxcycB5cJW-5iKTHTkCv6QofSKCdwqjJd-LMAo1iUVPuoWWwUJ4wQqiwJd47r1t1XYToMqcMicmsadCkKHzp3LOsNM_Hfz9OkDbT0REuXwFaWKx6OTAumboFwFKWvRNRncA0dUi/s400/67277044_2753187414709686_5141748470960357376_n.jpg" width="347" height="400" data-original-width="832" data-original-height="960" /></a>
<P>I appreciate when instructors attempt to relate their abstract course content to real-world situations. Math teachers who just come in and cover the board with numbers—without any explanation of <i>when</i> one might need to deploy that equation—do a disservice to math instruction. You have to teach Z-scores in the context of when you'd need to use Z-scores, or whatever.
<P>But by the same token, you need to have some passing familiarity with your real-world example. "If a train leaves Pittsburgh at 4PM going 100mph..." was fine when most people traveled by train; now, not so relatable. And if you going to use, "If a plane leaves Pittsburgh" you'd better include, "not counting the time spent clearing security or the delay for the flight crew showing up" as part of the problem.
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-13181895932263008402019-06-11T09:21:00.001-07:002019-06-11T09:21:18.506-07:00How am I going to make this assessment relevant?Peter Greene said:
<P>
. . . if your spouse says, “I’m looking for ways to make you interesting and appealing,” that is not a good sign.
<P>
Once you look at a lesson and ask, “How am I going to make this material relevant,” you have admitted that the material is not actually relevant. If that’s true–if the lesson is inherently irrelevant–then you need to ask a bigger question. Why are you teaching it at all? Because it’s on the test? Because your boss said you have to? These are lousy reasons to teach anything. More importantly, no amount of stapling on pictures of movie stars will convince your students that you aren’t wasting their time, and wasting students’ time is one of the unforgivable sins in the teaching biz.
<P>
Know why you are teaching what you’re teaching. Know why the material has value for your students. This is not always obvious, but this is where your expertise in the subject matter is supposed to come in. You’re the teacher–you’re supposed to know what the connection is between your content material and the business of being fully human in the world. If you don’t see a connection, you need to go study and look to find it, or you need to reconsider whether you should be teaching it at all.
<P>
[Via www.forbes.com/sites/petergreene/2019/06/08/dear-teachers-please-dont-make-your-lessons-relevant —
Found on Scott MacCleod's excellent blog, <i>Dangerously Irrelevant</i>, about the need to move schools forward into 21st century.]
<P>
The same is true of assessments. It's easy to come up with assignments that generate grades for a report card, that rank students against each other, but does the activity actually have anything to do with anything that matters? If the assessment isn't authentic, don't do it.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-6183621221270169992019-05-26T11:27:00.000-07:002019-05-26T11:27:51.939-07:00Math UnderstandingA popular meme:<P>
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhDJe5VtcLvr2UbLyikqBogT-bueNANnmmjx4klGWEhYX0koDzUkxAADy75WE1v6eTP94tUAzwN9oWMxg5JlqNafGV7uSR0c4-COAbWz_4NwwYyxfAwxljG5p5QPgFT2EvZo6VLpQZ9snSa/s1600/math+meme.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhDJe5VtcLvr2UbLyikqBogT-bueNANnmmjx4klGWEhYX0koDzUkxAADy75WE1v6eTP94tUAzwN9oWMxg5JlqNafGV7uSR0c4-COAbWz_4NwwYyxfAwxljG5p5QPgFT2EvZo6VLpQZ9snSa/s640/math+meme.jpg" width="640" height="550" data-original-width="714" data-original-height="614" /></a><P>
The objective of the marker is to assess the student's understanding, not their ability to follow expectations.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-57769358134132015332019-05-25T20:41:00.000-07:002019-05-25T20:41:21.077-07:00Summer Reading Assignments & Note About Assigning Shakespeare<a href="http://dangerouslyirrelevant.org/2019/05/6-articles-on-teacher-assigned-summer-reading.html?utm_source=feedburner&utm_medium=email&utm_campaign=Feed%3A+dangerouslyirrelevant+%28Dangerously+Irrelevant%29">Dangerously Irrelevant</a>, an excellent blog on school leadership in 21st century, has an excellent list of six articles on why assigned summer reading is a seriously stupid idea. An important first step in good assessment is having good assignments. Forcing kids to do reading homework over the summer is obviously wrong-headed, but these articles will give you the amunition necessary to argue with those who still think it is a good idea.
<P>
On a related topic, any teacher about to take up Shakespeare could do a lot worse than to hang up posters banning the <a href="https://www.amazon.com/Shakespeare-Slackers-Tragedy-Macbeth-William/dp/1452870764"><i>Shakespeare for Slackers</i> series.</a>. Aaron Kite provides the translation of Elizabethian English (the original text on the left hand page) into modern punk (on the right hand page) which is both hilarious and educational. Students get to understand the jokes in the original, get to observe how modern English is more linear than Shakespearian English, and gain a whole new appreciation for the original drama. Better than the <i>Star Wars</i> as Shakespeare books, in my opinion. Or assign a compare and contrast essay on the two versions if the whole 'banning' trick doesn't work....
<P><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiyMXTv1na82qW17FLZ8LVX1njVWPS17DDhI3ZiHZ2_LO7OaV_Bmg_ViTmUoUkQiFYP450LcJKKIvz68i9xZKfQbdizdS74ABlSOyDvNfYuTqUDu6v7qX3DgchyphenhyphengA2aoeSBWBshUsY3RPc/s1600/81ZHTI9nBsL._AC_UL436_.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiyMXTv1na82qW17FLZ8LVX1njVWPS17DDhI3ZiHZ2_LO7OaV_Bmg_ViTmUoUkQiFYP450LcJKKIvz68i9xZKfQbdizdS74ABlSOyDvNfYuTqUDu6v7qX3DgchyphenhyphengA2aoeSBWBshUsY3RPc/s320/81ZHTI9nBsL._AC_UL436_.jpg" width="224" height="320" data-original-width="305" data-original-height="436" /></a><P>
Alternatively, try John Poulsen's <a href="https://www.amazon.com/Shakespeare-Readers-Theatre-Hamlet-Midsummer-ebook/dp/B00AZNX3VU/ref=sr_1_2?qid=1558841820&refinements=p_27%3AJohn+Poulsen&s=books&sr=1-2&text=John+Poulsen"><i>Shakespeare for Reader's Theatre</i></a> series, which gets students performing Shakespeare's plays within about 45 minutes of the start of the unit. Highly recommended.<P>
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgI_hGqVoIm4J3zEaLcLWPnmBHOsC5Ro66yq0PdiHoB2BSyordOlO88XmMZnn58PydmMMDwdghOxaAiIeaEkC4LjHUkL2AivX2UQk3WoGJUfRCtdj5D7kWOlkzois9eRGy9VlFH0plTDVI/s1600/51EcniV6ucL.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgI_hGqVoIm4J3zEaLcLWPnmBHOsC5Ro66yq0PdiHoB2BSyordOlO88XmMZnn58PydmMMDwdghOxaAiIeaEkC4LjHUkL2AivX2UQk3WoGJUfRCtdj5D7kWOlkzois9eRGy9VlFH0plTDVI/s320/51EcniV6ucL.jpg" width="225" height="320" data-original-width="352" data-original-height="500" /></a>
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com3tag:blogger.com,1999:blog-5079304681802344059.post-39061910695853898892018-11-22T10:39:00.000-08:002018-11-22T10:39:19.195-08:00Guest Post: Four Reasons to be Happy About Internet Plagiarismby Russell Hunt<BR>
St. Thomas University<p>
<blockquote><small>[This column is reprinted (with the author's permission) from <A href="http://people.stu.ca/~hunt/www/4reasons.htm">http://people.stu.ca/~hunt/www/4reasons.htm</a>. Teaching Perspectives (St. Thomas University) 5 (December 2002), [1-5]. Repr. Teaching Options Pedagogiques (University of Ottawa) 6:4 (August 2003), 3-5; repr. [as "Let's Hear it for Internet Plagiarism"] Teaching & Learning Bridges 2:3 (University of Saskatchewan) (November 2003), 2-5; Teaching Matters Newsletter (University of New Brunswick, Saint John) (January 2007) 6-9; in Think: Critical Thinking for Everyday Life, ed. Judith Boss (New York: McGraw-Hill, 2010): 367-368. Note: this is an excerpt from a longer project, which can be found in draft form at http://people.stu.ca/~hunt/www/plagiary.htm ]</small></blockquote><P>
The "information technology revolution" is almost always presented as having cataclysmic consequences for education—sometimes for the better, but often, of course, for the worse. In postsecondary circles, perhaps the most commonly apprehended cataclysm is "Internet Plagiarism." When a university subscribes to turnitin.com, the local media invariably pick up the story—"Students to Learn that Internet Crime Doesn't Pay" -- with the kind of alacrity usually reserved for features on political sex scandals or patronage payoffs. When the newest cheating scandal surfaces at some prestigious southern university known for its military school style "honor code," the headlines leap across the tabloids like stories on child molestation by alien invaders.
<P>
It's almost never suggested that all this might be something other than a disaster for higher education. But that's exactly what I want to argue here. I believe the challenge of easier and more convenient plagiarism is to be welcomed. This rising tide threatens to change things—for, I predict and hope, the better. Here are some specific practices which are threatened by the increasing ease with which plagiarism can be committed.
<P>
<B>1. The institutional rhetorical writing environment (the "research paper," the "literary essay," the "term paper") is challenged by this, and that's a good thing.</B> Our reliance on these forms as ways of assessing student skills and knowledge has been increasingly questioned by people who are concerned with how learning and assessment take place, and can be fostered, and particularly with how the ability to manipulate written language ("literacy") is developed. The assumption that a student's learning is accurately and readily tested by her ability to produce, in a completely arhetorical situation, an artificial form that she'll never have to write again once she's survived formal education (the essay examination, the formal research paper), is questionable on the face of it, and is increasingly untenable. If the apprehension that it's almost impossible to escape the mass-produced and purchased term paper leads teachers to create more imaginative, and rhetorically sound, writing situations in their classes, the advent of the easily-purchased paper from schoolsucks.com is a salutary challenge to practices which ought to be challenged. One good, clear example of the argument which can be mounted against generic term paper assignments and in favor of assignments which track that writing process and / or are specific to a particular situation is in Tom Rocklin's online "Downloadable Term Papers: What's a Prof. to Do?" Many other equivalent arguments that assignment can be refigured to make plagiarism more difficult—and offer more authentic rhetorical contexts for student writing -- have been offered in recent years.
<P>
I'm unconvinced that we can address the problem by assuring students that "they are real writers with meaningful and important things to say," or invite them to revise their work where we can see the revisions, as long as we continue giving them more decontextualized, audienceless and purposeless writing exercises. Having something to say is—for anybody except, maybe, a Romantic poet—absolutely indistinguishable from having someone to say it to, and an authentic reason for saying it. To address this problem, I believe, we need to rethink the position of writing in students' lives and in the curriculum. One strong pressure to do that is the increasing likelihood that empty exercises can be fulfilled by perfunctory efforts, or borrowed texts.
<P>
<B>2. The institutional structures around grades and certification are challenged by this, and that's a good thing.</B> Perhaps more important is the way plagiarism challenges the overwhelming pressure for grades which our institutions have created and foster, and which has as its consequence the pressure on many good students to cut a corner here and there (there's lots of evidence that it's not mainly the marginal students in danger of failing who cheat; it's as often those excellent students who believe, possibly with some reason, that their lives depend on keeping their GPA up to some arbitrary scratch). An even more central consideration is the way the existence of plagiarism itself challenges the way the university structures its system of incentives and rewards, as a zero-sum game, with a limited number of winners.
<P>
University itself, as our profession has structured it, is the most effective possible situation for encouraging plagiarism and cheating. If I wanted to learn how to play the guitar, or improve my golf swing, or write HTML, "cheating" would be the last thing that would ever occur to me. It would be utterly irrelevant to the situation. On the other hand, if I wanted a certificate saying that I could pick a jig, play a round in under 80, or produce a slick Web page (and never expected actually to perform the activity in question), I might well consider cheating (and consider it primarily a moral problem). This is the situation we've built for our students: a system in which the only incentives or motives anyone cares about are marks, credits, and certificates. We're not entirely responsible for that—government policies which have tilted financial and social responsibility for education increasingly toward the students and their families have helped a lot -- but the crucial factor has been our insistence, as a profession, that the only motivation we could ever count on is what is built into the certification process. When students say—as they regularly do—"why should I do this if it's not marked?" or "why should I do this well if it's not graded?" or even "I understand that I should do this, but you're not marking it, and my other professors are marking what I do for them," they're saying exactly what educational institutions have been highly successful at teaching them to say.
<P>
They're learning exactly the same thing, with a different spin, when we tell them that plagiarism is a moral issue. We're saying that the only reason you might choose not to do it is a moral one. But think about it: if you wanted to build a deck and were taking a class to learn how to do it, your decision not to cheat would not be based on moral considerations.
<P>
<B>3. The model of knowledge held by almost all students, and by many faculty—the tacit assumption that knowledge is stored information and that skills are isolated, asocial faculties—is challenged by this, and that's a good thing.</B> When we judge essays by what they contain and how logically it's organized (and how grammatically it's presented) we miss the most important fact about written texts, which is that they are rhetorical moves in scholarly and social enterprises. In recent years there have been periodic assaults on what Paolo Freire (1974) called "the banking model" of education (and what, more recently, Tom Marino [2002], writing on the POD email list, referred to as "educational bulimics"). Partisans of active learning, of problem- and project-based learning, of cooperative learning, and of many other "radical" educational initiatives, all contend that information and ideas are not inert masses to be shifted and copied in much the way two computers exchange packages of information, but rather need to be continuously reformatted, reconstituted, restructured, reshaped and reinvented and exchanged in new forms -- not only as learning processes but as the social basis of the intellectual enterprise. A model of the educational enterprise which presumes that knowledge comes in packages (one reinforced by marking systems which say you can get "73%" of Renaissance literature or introductory organic chemistry) invites learners to think of what they're doing as importing pre-packaged nuggets of information into their texts and their minds.
<P>
Similarly, a model which assumes that a skill like "writing the academic essay" is an ability which can be demonstrated on demand, quite apart from any authentic rhetorical situation, actual question, or expectation of effect (or definition of what the "academic essay" actually is), virtually prohibits students from recognizing that all writing is shaped by rhetorical context and situation, and thus renders them tone-deaf to the shifts in register and diction which make so much plagiarized undergraduate text instantly recognizable. The best documentation of the strangely arhetorical situation student writing lives in that I know of is in the work done as part of the extensive study of school-based and workplace writing at McGill and Carleton Universities (Dias, Freedman, Medway & Paré, 1999; Dias & Paré, 2000).
<P>
4. But there's a reason to welcome this challenge that's far more important than any of these—more important, even, than the way the revolutionary volatility of text mediated by photocopying and electronic files have assaulted traditional assumptions of intellectual property and copyright by distributing the power to copy beyond those who have the right to copy. It's this: <B>by facing this challenge we will be forced to help our students learn what I believe to be the most important thing they can learn at university: just how the intellectual enterprise of scholarship and research really works.</b> Traditionally, when we explain to students why plagiarism is bad and what their motives should be for properly citing and crediting their sources, we present them in terms of a model of how texts work in the process of sharing ideas and information which is profoundly different from how they actually work outside of classroom-based writing, and profoundly destructive to their understanding of the assumptions and methods of scholarship.
<P>
When you look at the usual set of examples of plagiarism as it occurs in student papers, for example, what you see is almost invariably drawn from kinds of writing obviously and radically identifiable as classroom texts. And how classroom texts relate to or use the ideas and texts of others is typically very different from how they're used in science, scholarship, or in other publications. There are many such explanatory examples in print and on the Web; let me take one from the Northwestern University "The Writing Place" Web site. They offer the following as an explanation of how to do an acceptable and properly credited paraphrase:
<P><Blockquote>
<B>Original</B><p>
But Frida's <B>outlook was vastly different</B> from that of the Surrealists. Her art was not the <B>product of a disillusioned European culture</B> searching for an <B>escape from the limits of logic</B> by <B>plumbing the subconscious</B>. Instead, <B>her fantasy was a product of her temperament, life, and place; </B>it was a way of <B>coming to terms with reality</B>, not of <B>passing beyond reality</B> into another realm.
Hayden Herrera, <i>Frida: A Biography of Frida Kahlo</i> (258)
<P>
<B>Paraphrase</B>
<P>
As Herrera explains, <u>Frida's surrealistic vision was unlike that of the European Surrealists</u>. While <u>their art grew out of their disenchantment with society</u> and <i>their desire to explore the subconscious mind</i> as a refuge from rational thinking, <u>Frida's vision was an outgrowth of her own personality and life experiences in Mexico.</u> She used her surrealistic images to understand better her actual life, not to create a dreamworld (258).</blockquote>
<P>
Key words and phrases in the original are in <b>boldface</b>. The changes in wording and sentence structure in the paraphrase are <u>underlined</u>.
<P>
What is clearest about this is that the writer of the second paragraph has no motive for rephrasing the passage other than to put it into different words. Had she really needed the entire passage as part of an argument or explanation she was offering, she would have been far better advised to quote it directly. The paraphrase neither clarifies nor renders newly pointed; it's merely designed to demonstrate to a sceptical reader that the writer actually understands the phrases she is using in her text. Without more context than the Northwestern site gives us, it's difficult to know exactly how the paragraph functions in a larger rhetorical purpose (if it does).
But published scholarly literature is full of examples of writers using the texts, words and ideas of others to serve their own immediate purposes. Here's an example of the way two researchers opened their discussion of the context of their work in 1984:
<P>
To say that listeners attempt to construct points is not, however, to make clear just what sort of thing a 'point' actually is. Despite recent interest in the pragmatics of oral stories (Polanyi 1979, 1982; Robinson 1981), conversations (Schank et al. 1982), and narrative discourse generally (Prince 1983), definitions of point are hard to come by. Those that do exist are usually couched in negative terms: apparently it is easier to indicate what a point is not than to be clear about what it is. Perhaps the most memorable (negative) definition of point was that of Labov (1972: 366), who observed that a narrative without one is met with the "withering" rejoinder, "So what?" (Vipond & Hunt, 1984)<P>
It is clear here that the motives of the writers do not include prevention of charges of plagiarism; moreover, it's equally clear that they are not -- as they would be enjoined to do by the Northwestern Web site -- attempting to "cite every piece of information that is not a) the result of your own research, or b) common knowledge." What they are doing is more complex. The bouquet of citations offered in this paragraph is informing the reader that the writers know, and are comfortable with, the literature their article is addressing; they are moving to place their argument in an already existing written conversation about the pragmatics of stories; they are advertising to the readers of their article, likely to be interested in psychology or literature, that there is an area of inquiry -- the sociology of discourse -- that is relevant to studies in the psychology of literature; and they are establishing a tone of comfortable authority in that conversation by the acknowledgement of Labov's contribution and by using his language --"withering" is picked out of Labov's article because it is often cited as conveying the power of pointlessness to humiliate (I believe I speak with some authority for the authors' motives, since I was one of them).<P>
Scholars -- writers generally -- use citations for many things: they establish their own bona fides and currency, they advertise their alliances, they bring work to the attention of their reader, they assert ties of collegiality, they exemplify contending positions or define nuances of difference among competing theories or ideas. They do not use them to defend themselves against potential allegations of plagiarism.
<P>
The clearest difference between the way undergraduate students, writing essays, cite and quote and the way scholars do it in public is this: typically, the scholars are achieving something positive; the students are avoiding something negative.
<P>
The conclusion we're driven to, then, is this: offering lessons and courses and workshops on "avoiding plagiarism" -- indeed, posing plagiarism as a problem at all -- begins at the wrong end of the stick. It might usefully be analogized to looking for a good way to teach the infield fly rule to people who have no clear idea what baseball is.
<p>
<B>References</B>
<P>
"Avoiding Plagiarism." The Writing Place, Northwestern University.
http://www.writing.nwu.edu/tips/plag.html (November 2001). Archived <a href="http://web.archive.org/web/20011119211908/http://www.writing.nwu.edu/tips/plag.html">http://web.archive.org/web/20011119211908/http://www.writing.nwu.edu/tips/plag.html</A>
Dias, Patrick, Aviva Freedman, Peter Medway, and Anthony Paré, eds. <i>Worlds Apart: Acting and Writing in Academic and Workplace Contexts</i> [The Rhetoric, Society and Knowledge Series]. Mahwah, N.J.: Lawrence Erlbaum Associates, 1999.
<P>
Dias, Patrick, and Anthony Paré, eds. <i>Transitions: Writing in Academic and Workplace Settings</i>. Cresskill, New Jersey: Hampton Press, 2000.
<P>
Freire, Paolo. <I>The Pedagogy of the Oppressed.</i> New York: Seabury, 1974. (Translated from the original Portuguese (1968) by Myra Bergman Ramos).<P>
Marino, Tom. "Re: How many minutes per class day does the typical student study?" <i>Professional & Organizational Development Network in Higher Education</i> <POD@listserv.nd.edu>, 28 May 2002. <a href="http://listserv.nd.edu/cgi-bin/wa?A2=ind0205&L=pod&O=D&P=14486">http://listserv.nd.edu/cgi-bin/wa?A2=ind0205&L=pod&O=D&P=14486</a>.
<P>
Rocklin, Tom. "Downloadable Term Papers: What's a Prof. to Do?" University of Iowa Center for Teaching. Tools and Resources: Teaching Ideas from the Center for Teaching and Around the World. n.d. <a href="http://www.uiowa.edu/~centeach/resources/ideas/term-paper-download.html">
http://www.uiowa.edu/~centeach/resources/ideas/term-paper-download.html</a>
<P>
Vipond, Douglas, and Russell A. Hunt. "Point-Driven Understanding: Pragmatic and Cognitive Dimensions of Literary Reading." <i>Poetics</i> 13 (June 1984), 261-277.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-83225838323222063652018-11-22T09:56:00.000-08:002018-11-22T09:56:58.139-08:00Turnitin.com and Student PlagiarismI have recently come across instructors using Turnitin.com to teach students how to cite and reference scholarship. I find this practice completely wrong-headed.
<P>
First, Turnitin is plagiarism detection software. It was not designed as a teaching tool. I remain dubious that it can serve a purpose for which it was never intended better than other forms of instruction. One could easily focus on the most common mistakes students make on their in-text citations without having to resort to Turnitin software—the money spent on the software and the time spent providing students a visual walkthrough of the system would seem better invested in explaining the purpose and principles of scholarship, than teaching students one particular software package.
<P>
Second, as an editor and author as well as an academic, I feel strongly that student copyright and confidentiality is routinely violated by Turnitin retaining copies of student work in (an American) database. Instructors may not have an issue with this, but many authors and students feel this is a violation of their rights.
<P>
Third, instructors using Turnitin software as a teaching tool by having students run their first drafts through Turnitin.com, adjusting their papers until they get a better Turnitin score, ends up mandating a particular writing process—a common but deeply mistaken approach to teaching writing. My commentary on my frustration with such writing instruction is in <a href="http://runtestudentassessment.blogspot.com/2015/08/teaching-and-evaluating-writing-part-1.html">this earlier post on this blog</a>.
<P>
Fourth, focusing on "catching plagiarism"—which I would argue is more than implicit in a software package called "turn it in"—is in my view a wrong approach to teaching the importance of citation scholarship. Students learn that they must follow certain (to them bizarre and arbitrary rules) to manage the score delivered by a software package and does not, I would argue, properly socialize students into the philosophy of scholarship. This approach does not seem to acknowledge that students come from other cultures/philosophical positions that may view the universe very differently. For example, the mashup artist who takes a hundred different film clips, edits them together with some other person's soundtrack to create a new YouTube video that gets a million likes and a monetized video feed is going to need more than Turnitin software to understand why that same behaviour in university gets them a 0 and a yelling at. Effective instruction is not about explaining the rules, it's about <i>converting students to our worldview</i>. I do not perceive Turnitin software as a useful tool in this process.
<p>
I realize mine is a minority view. Turnitin software is 'easy' for instructors and allows them to pretend to be addressing the issues of academic integrity which large classes and a host of other structural issues have made more difficult to manage. That 'easy' or 'widely promoted' equates to 'best practice' or 'best outcomes' remains to be demonstrated to me. I argue there is a difference between 'trained' and 'educated' and using Turnitin to teach rules strikes me (and I dare say most students) like a punitive training exercise rather than an effective approach to socializing students into a new and better worldview.
<P>As I have mentioned before in this blog, the more appropriate approach to issues of Internet plagiarism is to scrap the sort of assignments that allow for 'off-the-shelf' responses, and instead shift to authentic assessments that require original thought and personal commitment. If one asks students for a paper on McBeth, one should not be surprised if students go online to find them one. Instead, ask students how they interacted with the text to relate it to their own lives and or something of that ilk. If your students can't be bothered to actually do your assignments, that likely has more to do with it being a bad assignment, than about having bad students.
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-4466043347214957342018-06-30T14:54:00.000-07:002018-06-30T14:54:19.177-07:00More States Opting for Robo Grading of Student Essays.<iframe src="https://www.npr.org/player/embed/624373367/624911907" width="100%" height="290" frameborder="0" scrolling="no" title="NPR embedded audio player"></iframe>
This article from NPR on the use of software to grade student papers refers to a trend that is so appalling, I almost don't know where to begin.
I was for a decade the person responsible for one of the standardized test programs in Alberta, and we were very proud of our involvement of classroom teachers at every stage of the development and marking process so that the exams would reflect actual classroom practice and the results would be normed accurately across Alberta. We trained teachers to use rubrics to mark accurately and consistently so that it wouldn't matter which marker the student got or what time of day the marking happened, or other chance factors. We did not train them to be robots, but designed rubrics that allowed them to award excellence, even when the student's answer did not easily fit within the rubric. If more than a few answers didn't fit the rubric, we changed the rubric. Routinely.
<P>
In social studies, we eliminated bias by making it explicit: when a marker found himself grinding his teeth over a student's stated opinions, instead of trying to grade it himself, he would hold the paper up above his head and shout "right-wing nut-job" or "left-wing snowflake" (as the case applied) and a suitably left or right oriented marker would happily swap it for its opposite, so that every paper was marked by a sympathetic marker. When a paper managed to offend everyone, it was taken off the marking floor and sent to a special committee of veteran markers who would grade it as a team. We went out of our way to not be robots.
<P>
This is NOT the case with many standardized tests, particularly in the US where it is private publishers rather than the ministry of education designing the exams. There are so many things wrong with most standardized testing programs, I will limit myself in this post to the observation that the purpose of most standardized testing programs is not to educate, nor to reward diligent learning, but to reproduce the class structure. Most tests reward the culture of the white upper-middle-class, and screw everybody else. They are there to explain inequality by saying, "Well you had your chance, but you only got a 58% on your test, so you deserve to spend the rest of your life in the underclass, unlike Frank here, who got 98%"(because we asked Frank questions in a way that makes the most sense to most white males, about stuff that matters to the professional/management class that Frank grew up in and had picked up on from his professional parents by the time he was 8, and because Frank had money for tutors, books, computers, if he happened to turn out a bit 'slow').
<P>
So...replacing teacher-markers with robots is perfect. Relying on software APPEARS to increase objectivity by removing the last vestiges of human intervention (what will be identified as 'bias' as these programs are being implemented) and keeps conscientious teachers from giving an "A" to a paper for its ideas when the student has written "ain't never" which is grammatically incorrect--i.e., has written her answer in the perfectly clear dialect of a to-be-suppressed population. A good teacher knows quality writing when they see it; a software program has the algorithms to suppress the underclass.
<P>Not why I became an educator.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-23679546238193758942018-06-27T12:27:00.000-07:002018-06-30T14:55:42.625-07:00Tech Tools for Teaching
<img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgPZnxmgheTwR7WCUG1SGmMtORT8iUYeaXb0QJoDKZ18Xbwe_fD251pq6ClI4-1muZARS36UMECjJRiV4a4PVU-EiB-1WjlJpveVT0FONRkSbTVgTX8Ee1ofyNiJlWdT027xcjA_WhUi_SC/s400/32b650b16fad247fcc6fc63cf61d7304.jpg" width="400" height="300" data-original-width="480" data-original-height="360" />
<P>Although slightly off the topic of assessment, Scott Mcleod's post on the <a href="http://dangerouslyirrelevant.org/2018/06/10-tech-tools-that-will-make-you-a-super-teacher.html/comment-page-1#comment-1319159">10 tech tools that will make you a super teacher</a> is a must read. Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-13066729290399438342018-05-07T10:26:00.000-07:002018-05-07T10:26:27.837-07:00Homework Assignments<iframe width="560" height="315" src="https://www.youtube.com/embed/XQ_agxK6fLs" frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe>
<P>A clear explanation of why homework is stupid and why standardized testing has problems.
<P>I have always opposed homework. Teachers should teach, parents should be family. Asking kids to take work home in K-12 system is wrong-headed because:<p>
<b>Homework Significantly Undermines Equality of Educational Opportunity</b><P>
Homework greatly increases the disparity between family backgrounds, undermining equal educational opportunity
<UL><li>Some parents work at two jobs to support their families, or work evenings or otherwise are unavailable to help their kids with homework. It is clearly unfair to pit these kids against kids whose parents can do their homework <del>for</del> with them.</li>
<li>Some families speak white-middle-class English; some families speak lower-class English; some black dialect; others speak little or no English at. It is unfair to send home assignments in the expectation that all parents can help their children equally.</li>
<li>Some families need the children to do chores to help with the farm or family business; or disabled siblings, or elder care; or other responsibilites; while other families place no such demands on their children.</li>
<li>Some parents value education and school work; others—having been traumatized by their own school experiences with racial, class, religious, or other biases, and bullying teachers—think, for example of residential schools, to take just one obvious example—do not. It is not fair to demand that kids from these different backgrounds be pitted against each other on homework assignments.</li>
<li>Some homes have resources—computers, books, a table/space to work at, separate bedrooms for each kid—while others do not.</li>
<li>Some homes have the income to hire tutors when kids struggle; others do not.</li>
<li>Homes vary (across all classes, cultures, and backgrounds) in stability. Why are we asking kids to complete work at home when their parents are in the middle of a screaming divorce, or they have bullying siblings, or there are other types of disruption?</li></ul>
Schools are supposed to be safe places for students to learn. Our responsibility is to teach them in schools where we can control the learning environment and make sure it represents a level playing field. Any time we send work home, we privilege some students, undermine others.</li><P>
<B>Homework Undermines Teacher Accountability</B><P>
As a parent, it frequently drove me crazy to find that I was expected to teach my child reading, writing, and arithmetic, while my child's teacher devoted hours of classroom time to non-academic activities. For example, I routinely experienced that whenever the family sat down to enjoy a family movie night on the weekend, that my daughters had already seen the film at school. "Thursday afternoons are movie-day," they would tell me. Why do my kids have two hours of homework each evening, but teachers have time to pre-empt family activities? What's wrong with this picture?
<BR>I get that there should be some 'fun' times at school, to team-build, to reward diligence, to enhance learning. But what I am increasingly observing is these activities displacing learning. I increasingly see a generation of teachers who are more concerned with occupying the children than teaching them.
<P>To cite just one blatant example from my child's education: my wife was present in our daughter's classroom as a volunteer when, in the last week of school, the teacher announced, "Oh, by the way, I forgot to teach printing this year. I'm going to hand out the printing exercise books now for you to take home. Have your parents teach you printing over the summer because you'll need that for next grade." An extreme example to be sure, but underlying every homework assignment is the delegation of teacher-work to parents, who may or may not be in a position to take on the responsibility.
<P><B>Homework Encourages Racism, Class Bias, and Victim-Blaming</B><P>
<P>I hear teachers—and not just my inexperienced student teachers, but senior classroom teachers—dismiss this or that student's lack of progress by blaming the parents. "What can you expect? Ruby comes from ________(fill in the blank with "broken home" or "native home" or "trailer park home" or whatever other unacceptable bias teachers allow themselves. There is no clearer example of blaming the victim than the lowering of expectations for students based on class, race/ethnicity, parental marital status or whatever. What can I expect from Ruby? The same as every other student in the classroom because it is the teacher's job to get every single student to mastery of the subject content. There are no valid excuses for a student failing, except perhaps a doctor's diagnosis of massive brain injury, in which case they are probably not in your class anyway. Homework assignments mask teacher bias by shifting responsibility, along with a high proportion of the teacher's workload, to the family. Instead of taking responsibility for each child's learning, they accept responsibility only for those students whose parents have the social capital to do the teacher's job for them. <P>Bah, humbug.
<P>Good teachers get the work done in their classrooms; they do not assign homework.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-5027889807747949122018-04-17T10:07:00.002-07:002018-04-17T10:07:47.376-07:00Grading True/False QuestionsA student just told me that they had gotten a true-false wrong, but knew the answer. They had marked it "True" and then written in the margin, "It's true, but you made a typo: it should be x/y" (or whatever the math had been— I didn't understand the question well enough to know what she was talking about). So, as instructor what do you do with that?
<P>Mark it correct of course. The correction demonstrates the knowledge we were testing for, and even if they missed the entire point of how True-False is supposed to work, we're ultimately trying to determine their knowledge of course objectives, not their understanding of test-format. So that's just funny, but deserves a mark.
<P>Indeed, I would argue that all True-False should work that way. Good T/F design* includes students explaining why the F options are false. That not only catches the sort of problem above, but ensures that students choosing F aren't just guessing, and that they know the right answer. There may also be more than one way to make a false statement true...that's all okay, as long as it demonstrates the students knowledge (or lack thereof).<P>
T/F Ice freezes at 0 degrees C<P>
That's true; but 'false' and adding "at sea level" is also correct and tells you even more about the student's knowledge. Both answers should get the mark.<P>
<hr length=50>
*Okay, that's an oxymoron: almost all T/F are useless and to be avoided, but there are a few special circumstances—memorization of definitions, names, or dates, as if any of that is ever useful—where they can be used successfully. Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-78067025017747185842018-03-10T20:02:00.002-08:002018-03-10T20:03:57.231-08:00Found on Twitter<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhJfSntJ1TOau74D_eWvXaCdGTVuB1FwtpIpGLELp3FWZmu-DXCX0Jvm8w3SVUxSqA9HlCI_v1L2U9LnPL5_1MIFw9OYQsH-gsBKUg7s5sQyct1krEzsvosl13Mir4mrdXQPKtyxUel1mBv/s1600/DX8jJzJXUAcYE5G.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhJfSntJ1TOau74D_eWvXaCdGTVuB1FwtpIpGLELp3FWZmu-DXCX0Jvm8w3SVUxSqA9HlCI_v1L2U9LnPL5_1MIFw9OYQsH-gsBKUg7s5sQyct1krEzsvosl13Mir4mrdXQPKtyxUel1mBv/s320/DX8jJzJXUAcYE5G.jpg" width="320" height="240" data-original-width="700" data-original-height="525" /></a><P>Found on Dr. Alex Couros (@courosa March 10, 2018) Twitter feed with the comment "Well played". <P>I deeply appreciate any instructor who grades the answer as presented rather than only the expected replies.
Full marks here for both the student and the professor!
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-14395860269485551312018-03-09T09:20:00.001-08:002018-03-09T09:20:34.119-08:00Teaching Excellence<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgK2CDG5HuFlMng-E1X__NO2-FM1s-W-37_6fsy3qCwFZNx3JcjkEu17rDCNq-06pUAu1E083KRv9Xy1o_N3d6MYUktXmDVtJqWKXLaILrhJuLLoFfzD4tfMK_kJb1Gcvx2ASqhqFf9Abo/s1600/GlobalPerspectivesTeachingExcellence.jpg" imageanchor="1"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgK2CDG5HuFlMng-E1X__NO2-FM1s-W-37_6fsy3qCwFZNx3JcjkEu17rDCNq-06pUAu1E083KRv9Xy1o_N3d6MYUktXmDVtJqWKXLaILrhJuLLoFfzD4tfMK_kJb1Gcvx2ASqhqFf9Abo/s320/GlobalPerspectivesTeachingExcellence.jpg" width="213" height="320" data-original-width="200" data-original-height="300" /></a><P>
Only slightly off topic of student assessment is the question of how one evaluates good teaching. Just as with student assessment, defining one's objectives and how to measure progress toward those goals is in fact a highly political activity. Why this learning objective and not that one; why is this particular standard considered inadequate, satisfactory, or excellent; why this group's (students? peers? parents? administrators? stakeholders? taxpayers?) perceptions of quality rather than some others? Do we measure excellent teaching against student expectation, student learning, student engagement, student enjoyment, student self-fulfillment; or by employer needs and expectations, graduate employment figures, graduate life chances; by political socialization or active citizenship; critical thinking or ideological conformity; or societal arts and culture, inventiveness, entrepreneurialism, the reproduction or elimination of poverty and injustice... You get the idea.
<P>
I'm very pleased to have "Excellence for what? Policy Development and the Discourse of the Purpose of Higher Education," appear as a chapter in the just-released Routledge collection, <i>Global Perspectives on Teaching Excellence</i>. The collection is basically a reaction to recent legislation in the UK that attempted to measure and mandate teaching excellence in higher education. My wife and I wrote a critique using my discourse analysis model of the purpose of higher education applied to the new legislation to suggest that the government's definition of 'excellence' might be somewhat problematic from the perspective of students and learning.
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-10230926599436874732018-01-22T23:11:00.000-08:002018-01-22T23:11:08.388-08:00Dyslexia and assessment.Here is a good video on the experience of dyslexia from the student perspective. <P>
<iframe width="560" height="315" src="https://www.youtube.com/embed/WAwRrtH-4Lg?rel=0" frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe></p>
I'm often shocked by how poorly many teachers adapt assessments to deal with disabilities, such as dyslexia. I hosted a panel on "Dyslexia, dysgraphia and the writing experience" at a writer's conference in August, and the room was filled with parents openly weeping over how their dyslexic child had been treated in the school system. The parents were immensely relieved to see a panel of writers and editors talking about how they had managed to not just overcome/deal with their disability, but actually become successful readers, writers and editors in spite of what happened in their schooling.<P>
I keep running into teachers who don't know what dyslexia is or how to deal with it, even though research suggests it affects about 15% of the population. They're always surprised when I tell them that the reason this child can't spell is that they are dyslexic or dysgraphic. <P>"I just thought they were being lazy,not making the effort to learn how to spell the word." <P>Well, "lazy" is better than "stupid", I suppose, which is how the peer group labels poor readers/spellers. <P>"Why are you making this child read out loud in front of their peers? What is the purpose of this public humiliation?" I will ask them. <P>"Well, you've got to read out loud. It's in the curriculum." <p>
"Okay, but have them do that at recess or after class in private. Assessments are supposed to be confidential."<p>
"Really? But this course objective says, 'to an audience'".<p>
"Okay, but then give them the reading ahead of time so they can decipher it at home, learn it as a recitation if necessary, so they are able to be successful. Do not make them do a cold reading where so you set them up for a public failure."<p>
"I don't know. That seems to be giving them an unfair advantage, somehow."<P> And so on, endlessly. No variation from the routine, the easy; no sense that accommodations are necessary to level the playing field. Often hints that the teacher secretly believes the child really is stupid, because how hard is it to read this very elementary book? Most troublesome are the teachers that, having assigned the child to the lowest reading group (which is of no help because they are still dyslexic and now surrounded by peers who act out with various forms of antisocial behavior because they are all being subjected to the daily humiliation of being forced to attempt reading aloud; and the reading material is so far below grade level as to kill anyone's motivation to read) keep them in that group for social studies ("well, that's mostly reading too, right?") and math and art ("Well, they might as well stay in the same group all day, right? It's just easier for everyone") even though the research is conclusive that streaming isn't useful for any student, and in the long run, not even a benefit to the teacher since it leads to more behavior and control issues.
<P>And then there was the teacher with the fill-in-the-blank worksheet. Read the chapter, fill in the (apparently random--not even key words) blanks. When I questioned why she was making this dyslexic child read and fill in the blanks when the student (a) couldn't read and (b) couldn't write, she conceded that that might be a problem. <p>"I'll give the child the answer sheet. That way they won't have to read the text or spell the words." <p>But then, why make them do it at all? What was the possible purpose, the learning outcome, of laborously transferring random words from one sheet to another, <i>one letter at a time</i>? How is that an authentic assessment? How exactly did that teach this student the content or the spelling, when they couldn't actually read the sheet? <p>"But what do you want me to do? How can I teach the course if they don't fill in the worksheet?"<p>
If a student teacher had said that to me, I would have failed them on the spot. Worksheets are your only teaching strategy? You're done now! But it wasn't a student I was dealing with, so okay, how to explain that they had confused means and goals. The worksheet is supposed to help students achieve a learning outcome--but somewhere along the line, completing the sheet had <i>become</i> the goal for this teacher, a meaningless daily productivity that the teacher could point to to say, "my students are working and learning". But of course they weren't learning at all. <p>Well,not the content, anyway. They were learning that they hated that teacher's subject, that school is inherently boring, that work is tedious. If the purpose of schooling is to condition graduates to the tedium of the adult workplace, conditioning them to tolerate a 9-5 routine of pointless, alienating labour, then yeah, this teacher was doing just fine. But I don't think that's why we chose to become teachers.
<P>And don't get me started on some teachers' insistence on teaching cursive, when no adult under thirty <i>ever</i> uses cursive writing; and dysgraphic kids literally can't do it. It is exactly like demanding the kid in a wheelchair compete in the 100 meter race or fail phys. ed., but somehow, nothing deters these adults from pointlessly torturing and humiliating children with these learning disabilities.
<P>Schools as we know them were built around reading and writing. I think that's still important, but I'm confused why audiobooks and instructional video and the rest are not also considered valid if they help nonreaders achieve learning objectives. Why pride of place to just that one medium of print? Why steamroller over the 15% of kids who can't read or write by insisting that that is the only way to complete assignments? It's assessment abuse.
<P>Find other ways to find out what the student knows and can do. That is the point of any assessment. If a student cannot do the default assignment, find some <i>other</i> way to assess their knowledge and skills. The assessment is the means to the goal, not the goal. It's that simple.
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-67862861075292363462017-10-17T15:31:00.000-07:002017-11-22T10:41:43.054-08:00Bringing Notes to the ExaminationA meme downloaded from "S**t Academics Say" Oct17, 2017:<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEieNTvuCQT3YRF-u5lRTbiG0lEsr2NU1g_mx34XGtFRUCUprLREwsh1awiH24XxpnnfzUrTRugn31OyuOd69lhd2OYVP_DxYM1QFja-lx3afuF0aYqppN7hSKyYc1XKTVmj6YMn3PMafQM/s1600/21764938_2047746122113841_7643645955778312397_n.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEieNTvuCQT3YRF-u5lRTbiG0lEsr2NU1g_mx34XGtFRUCUprLREwsh1awiH24XxpnnfzUrTRugn31OyuOd69lhd2OYVP_DxYM1QFja-lx3afuF0aYqppN7hSKyYc1XKTVmj6YMn3PMafQM/s400/21764938_2047746122113841_7643645955778312397_n.jpg" width="256" height="400" data-original-width="614" data-original-height="960" /></a><P>
There are several points to be made here.
<P>First, good on the examiner for recognizing that was on them, not the student. I detest when an instructor makes a mistake and then tells a student, "well, that's not what I meant!" Unless mind reading is criteria in your psychic examination, it is inappropriate to hold students accountable for the instructor's intentions. If they got the literal answer to one's poorly worded question or followed one's poorly worded instructions literally, they get the mark or behaviour.
<P>Second, you have to love this student! That is out of the box thinking! Exactly what every discipline needs more of.
<p>Third, open book examinations are actually harder. Okay, if it's closed book for everyone else and open book for you, that does give one a slight advantage, but not as much as most people assume. There is relatively little knowledge that we need to memorize, as opposed to understanding and having available to us on our computers or google or etc. In most disciplines, one ends up memorize the important facts because that's <i>easier</i> than looking them up every time. If the fact is one you have to look up, it is by definition one that did not come up enough to be worth memorizing. Exams should be testing understanding, not just rote memorization. If the exam is testing higher orders of cognition (analysis, synthesis, evaluation and so on) then making information available to students makes for a better test of skills than the usual rote memorization that many exams seem to be geared towards.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-39877045927928170452017-04-13T14:45:00.000-07:002017-04-13T14:45:22.509-07:00Science FairsMy brother-in-law, who is an excellent physics teacher, spent a lot of years founding, running and judging science fairs. Science fairs, done correctly, are an excellent learning tool. <P>But um...<P> I feel the need to provide an alternative, student-eye view of science fairs:<P>
<a href=https://www.youtube.com/watch?v=mQbK5ol7qS"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh1uMGU_BZSDmZwz2R0UPSkbspHKlhW5yJuvd6byAZhVcVUzjw2B-POss7fvbB6FpU4lZR3WssoMssZ3Ebw3LvT40xWJwPSwfCZG7jon29i1fPBXKGRUnEFOBbm45M2K2xvftQK7IRMv7kq/s1600/science+fair.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh1uMGU_BZSDmZwz2R0UPSkbspHKlhW5yJuvd6byAZhVcVUzjw2B-POss7fvbB6FpU4lZR3WssoMssZ3Ebw3LvT40xWJwPSwfCZG7jon29i1fPBXKGRUnEFOBbm45M2K2xvftQK7IRMv7kq/s400/science+fair.jpg" width="400" height="226" /></a></A>
<P>I think my brother-in-law's science fairs worked better because, in part, they were not compulsory, but intended for those who were actually interested in science and in participating. (The other part is that my brother-in-law is kind of an outstanding teacher, so, you know, don't necessarily try this at home, or your school, unless you actually care as much as my brother-in-law.)Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-39043393033530623602017-04-10T13:28:00.002-07:002017-04-10T13:28:54.564-07:00Group Work<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhT3MKmeDIK_95fg3EPOUMm1_FKU17SznIXuwuuxST62d35RxfOpy3yZcYu8_eDMLlWl_jnRN4LcMMnIO7gGQN9T376eTQRoPrCLeEOkLDRxtf1pIJfYkABjxwsR0aPDiSlZeIlTHDXwuig/s1600/chickengroupwork.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhT3MKmeDIK_95fg3EPOUMm1_FKU17SznIXuwuuxST62d35RxfOpy3yZcYu8_eDMLlWl_jnRN4LcMMnIO7gGQN9T376eTQRoPrCLeEOkLDRxtf1pIJfYkABjxwsR0aPDiSlZeIlTHDXwuig/s400/chickengroupwork.jpg" width="382" height="400" /></a><P>
Pretty much my experience of group work: good students who want a good mark have to carry the unmotivated because they do not want to take the hit on their grades, while there are essentially no consequences for one or two students doing nothing.
<P>There is a lot of lip service given to using group work to teach collaborative skills, but the cartoon reflects what students actually learn; i.e., that group work is a fraud. As I have stated before in this blog, group work can only contribute to learning if relevant theory on group dynamics and instruction in practical collaborative skills have been explicitly taught and assessed, either in the current course or a prerequisite. Even then, successful group work requires considerable preparation by the instructor to carefully structure tasks, distribute the workload equitably, and have clear and thoughtful assessment. I have seen this used appropriately in a few rare programs, but the true purpose of the vast majority of group work assigned is merely to reduce the instructor's marking load. Bah humbug!
<P>Given motivated students and topics students care about, small group (in-class, ungraded) discussion can work well, provided students are given structured activities (e.g., a series of questions to discuss) and a clear time limit (to stay focused).
<P>Any other group work that requires students to get together outside of class discriminates against students with long commutes, single moms, students working their way through college, mature students with elder care issues, minority students whose family or cultural expectations prohibit their participation outside of school hours, or etc.
<P>Group work for marks where the group processes are not directly observed and assessed by the instructor make it almost impossible to assign grades fairly.
<P>Where groups are allowed to chose themselves, 'A' students will strive to join together, excluding not just 'B' and 'C' students, but also anyone with a visible disability, member of a lower social class, any member of a cultural minority, and so on. Group work where group members are not assigned by the instructor are therefore inevitably sexist, racist, classist, abilist, and so on. Instructors who do not assign students to groups must recognize that the primary purpose of group work in their class is to ensure the reproduction of the current social order rather than to certify achievement based on talent and effort.
<P>Assigning students to work together in groups ensures that A students will be frustrated by having to do a greater share of the work to ensure a minimally acceptable grade and/or accept a significant 'hit' to their grade point average. Assigning students to work groups without adequate training in group collaboration skills and appropriate checks and balances on workload distribution and task assignment ensures group conflict, and an end product that is greater mess than the sum of the flaws introduced by each individual.
<P>I'm not a fan.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-30968179560149085722017-03-24T23:06:00.001-07:002017-03-24T23:06:53.918-07:00Detecting Plagiarism Tip 2A recent post by a colleague on an editing site made the point that
<blockquote>if text is copied and pasted into Word from e.g. Wikipedia, it can include non-breaking spaces (small raised circles instead of the usual dot seen with show/hide is turned on). These are practically impossible to type by mistake! Similarly, when text is copied and pasted from PDFs, odd line breaks/returns are imported—another give-away.</blockquote>
Thought I'd pass that along.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-10067503786607389852017-01-16T21:27:00.000-08:002017-01-16T21:27:16.199-08:00Plagiarism: Two Unsuccessful ExamplesIn a recent discussion of plagiarism with some editors, I was reminded of an example from my own teaching experience that I now relate here for your amusement.
<P>As a new prof I had the singular experience of an undergraduate handing in a paper to the course I was teaching on the sociology of education that, as it turned out, <i>I</i> had written when I had taken the same course a decade or so before. Unbeknownst to me, the paper must have been photocopied by a classmate of mine years before and entered into the frat files. The original title page must have long since been discarded by the frat boys as who knows how many times the paper had been recycled, so my student merrily retrieved it from the files, typed up a new cover page with his name, and handed it in to it's author. It took me a minute to recognize after all those years, but there was something about it that was strangely familiar. And as it occurred to me that it was in fact, <i>my</i> paper, I recognized that the typing had the cracked line through the 'e' that I had had on my typewriter that year. I actually went through the effort of digging through the garage to find the original paper, and yup, it was identical. So that was an 'F' for the student, and an anecdote for me.
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjZfJy7qF9-O-ovXyUKOn9Dv6UaERq4rc7PCsneZuUwgk9kEZ5w0pFNvimrXA3XMkFPfB5zxebNp1vM69cqivbLVOJ3WjAL9F5xK0obR0QNyenmbmZgOZk3SNtq9oXyXWqmD_gOIkY7LqSu/s1600/god.jpg" imageanchor="1" ><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjZfJy7qF9-O-ovXyUKOn9Dv6UaERq4rc7PCsneZuUwgk9kEZ5w0pFNvimrXA3XMkFPfB5zxebNp1vM69cqivbLVOJ3WjAL9F5xK0obR0QNyenmbmZgOZk3SNtq9oXyXWqmD_gOIkY7LqSu/s320/god.jpg" width="320" height="244" /></a>
<P>The other example that I recall from roughly the same period was a colleague of mine telling of the case of a seminary student in his PhD defense. The originally scheduled external examiner had called in sick, so the supervisor had located a replacement. "You're in luck," he had told the student, "Dr X from the University of Y in Germany is in Calgary for a conference and has agreed to fly up to sit in as your external. It's a great honor because he is apparently quite an expert on your topic." But of course, turns out he really was an expert because when he opened the student's dissertation, he discovered at once it was <i>his</i> dissertation translated from the German. Since one does not get a PhD in theology for translating someone else's doctoral thesis, that was another FAIL. But I have to say, great example of the direct intervention of God against someone unworthy of the doctor of theology, because how else to explain the coincidence? The poor bastard must have thought himself completely safe from discover (this being decades before the internet).
<P>Moral of the story: don't plagiarize or god will get you.
.Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0tag:blogger.com,1999:blog-5079304681802344059.post-8553382324432538342017-01-01T22:07:00.000-08:002017-03-24T22:31:57.123-07:00Index to Runté Student Assessment Blog
<small>(As of January, 2017)</small><p>
<B>Assessment Design / Test Construction: General Principles</B><BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/10/defining-learningassessment-objectives.html">Defining Learning Objectives for Assessment </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-test-blueprint.html"> Test Blueprints</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-assessing-values.html">Assessing Values </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-punctuality.html"> Punctuality</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-assesment-is-about-instruction-1st.html">Assessment is about Learning</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/s-there-appropriate-failure-rate.html">Appropriate Failure Rate </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/06/tricky-directions-in-test-questions.html">Directions in Test Questions </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/03/meme-bias.html">Bias 1</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-bias.html">Bias 2</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-scheduling-exams.html">Scheduling Exams </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-examination-organization-question.html">Question Order on an Examination </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-grade-deadlines.html">Grading Deadlines </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/03/memes-rote-memorization.html">Rote Memorization</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-item-writing_27.html">Item Writing 1 </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-item-writing.html"> Item Writing 2</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-item-writing.html"> Item Writing 3</a><BR>
<a href=http://runtestudentassessment.blogspot.ca/2011/11/wrong-answers.html>Wrong answers</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/10/great-examples-of-bad-test-questions.html">Examples of Poor Test Questions </a><p>
<B>Cheating</B><BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/11/cheating.html">Cheating </a><BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/11/detecting-plagiarism.html"> Detecting Plagiarism</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2017/01/plagiarism-two-unsuccessful-examples.html">Plagiarism: Two Unsuccessful Examples </a><p>
<B>Class Assignments</B><BR>
<a href="http://runtestudentassessment.blogspot.ca/2012/04/late-penalties.html">Late Penalties (for assignments) </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-grade-deadlines.html">Grading Deadlines </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-bias.html">Bias </a><BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/11/homework.html">Homework 2</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-homework.html"> Homework 1</a><br>
<a href="http://runtestudentassessment.blogspot.ca/2011/04/peer-evaluation-vs-passing-back.html">Peer Evaluation </a><BR>
<a href="http://runtestudentassessment.blogspot.ca/2011/04/peer-evaluation-vs-passing-back.html">"Passing Back" to Grade </a><Br>
<a href="http://runtestudentassessment.blogspot.ca/2015/12/silly-questions.html"> Silly Questions (How to Answer)</a><P>
<B>Essays Tests and Written Assignments</b><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-setting-writing-assignments.html">Setting Writing Assignments </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2016/12/meme-test-answer.html"> ESL Test Answer</a><p>
<B>Feedback to Students</b> <BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/08/meaningful-feedback.html"> Meaningful Feedback (on Written Assignments)</a><BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/08/displaying-student-work.html">Displaying Student Work </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-posting-student-work.html">Posting Student Work </a><br>
<a href="http://runtestudentassessment.blogspot.ca/2015/10/im-a-student-but-you-only-gave-me-c.html">Addressing Student Misconceptions of the Grading Process </a><p>
<B>Group Work</B><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-group-work.html"> Group Work</a><p>
<B>Internet Memes (Revisited)</b><BR>
These are cartoons or photos you may have seen circulated for humorous effect, but which raise valid points about assessment practices.<BR>
<a href="https://www.pinterest.com/sfeditor/assessment/">My Assessment Pinterest Board (Memes and Cartoons) </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/03/memes-rote-memorization.html">Rote Memorization</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/03/meme-bias.html">Bias </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/03/meme-test-anxiety.html"> Test Anxiety</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-homework.html"> Homework</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-posting-student-work.html">Posting Student Work </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-group-work.html"> Group Work</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/04/meme-assessing-values.html">Assessing Values </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-scheduling-exams.html">Scheduling Exams </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-test-blueprint.html"> Test Blueprints</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-examination-organization-question.html">Question Order on an Examination </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-grade-deadlines.html">Grading Deadlines </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-write-better-instructions.html">Write Better Instructions </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-item-writing_27.html">Item Writing </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/3-minutes-with-scott-mcleod.html">Three Minutes with Scott MacLeod </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-bias.html">Bias </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-punctuality.html"> Punctuality</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-item-writing.html"> Item Writing</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-setting-writing-assignments.html">Setting Writing Assignments </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-item-analysis.html"> Item Analysis</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2016/12/meme-test-answer.html"> ESL Test Answer</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2016/12/meme-test-answer.html"> ESL Students and Tests</a><p>
<B>Multiple Choice Tests</B><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-test-blueprint.html"> Test Blueprints</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-item-writing_27.html">Item Writing </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-examination-organization-question.html">Question Order on an Examination </a><br>
<a href="http://runtestudentassessment.blogspot.ca/2011/08/questions-answered_31.html">How many alternatives should a multiple-choice question have?</a><BR>
<a href="http://runtestudentassessment.blogspot.ca/2011/08/questions-answered.html">Where is the best spot for the correct answer?</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/meme-write-better-instructions.html">Write Better Instructions </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-scheduling-exams.html">Scheduling Exams </a><p>
<B>Oral Questions</B><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/taking-student-questions.html">Taking Student Questions </a><p>
<B>School Reform</B><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/06/3-minutes-with-scott-mcleod.html">Three Minutes with Scott MacLeod </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/inappropriate-large-scale-standardized.html">Large Scale Standardized Testing </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/12/is-teaching-profession.html"> Is Teaching a Profession?</a><p>
<B>Taking Tests</B><BR>
<A href="http://runtestudentassessment.blogspot.ca/2016/10/studying-for-tests.html"> Studying for Tests</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/10/techniques-for-taking-multiple-choice.html">Taking Multiple-Choice Tests </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/11/testwiseness-part-one.html"> Testwiseness Part I</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/11/why-teach-students-to-be-testwise.html">Testwiseness Part II: Why Teach Students to be Testwise </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/11/do-testwise-strategies-really-work.html">Testwiseness Part III: Do Testwise Techniques Work? </a><br>
<A href="http://runtestudentassessment.blogspot.ca/2016/11/techniques-for-taking-essay-tests.html">Taking Essay Tests </a><p>
<B>Test Anxiety</B></BR>
<a href="http://runtestudentassessment.blogspot.ca/2011/01/eam-anxisty.html"> Test Anxiety 1</a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/03/meme-test-anxiety.html"> Test Anxiety 2</a><br>
<A href="http://runtestudentassessment.blogspot.ca/2015/05/meme-exam-anxiety.html"> Test Anxiety 3</a><p>
<B>Test Results and Analysis</B><BR>
<a href="http://runtestudentassessment.blogspot.ca/2011/01/john-mighton-on-bell-curve.html">The Bell Curve (JohnMighton) </a><BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/07/meme-item-analysis.html"> Item Analysis</a><BR>
<B>Teaching Reading and Writing</B><BR>
<a href="http://runtestudentassessment.blogspot.ca/2015/08/teaching-and-evaluating-writing-part-1.html">Teaching and Evaluating Writing: Part I </a><BR>
Runté GoH speech <A href="https://secure-hwcdn.libsyn.com/p/d/f/a/dfa176ef1d159981/2016-04-GOH-Robert-Runte.mp3?c_id=14168785&expiration=1490421113&hwt=5095b300e6e3f3b12cc863c591184fe6">on Future of Writing Instruction and Publishing</a> (Audio)<BR>
<A href="http://runtestudentassessment.blogspot.ca/2015/08/reading-warrior.html">Teaching Reading</a><p>
Robert Runtéhttp://www.blogger.com/profile/14629421213549342874noreply@blogger.com0