Resources for engaging and assessing students with clickers
21 Sep
One of the questions I’m asked most often when I present about teaching with clickers is the “coverage” question: How do you cover all the content you need to in a course if you spend class time having students think about, vote on, and discuss clicker questions? All that active learning during class must mean you can’t cover all the same content, right?
Although I find the term “cover” problematic, I understand these questions. Particular in courses that are prerequisites for other courses, there’s a need to make sure students learn a certain (usually large) amount of material. In talking with faculty who teach with clickers, I’ve heard several different kinds of responses to the “coverage” question, ones I detail in my book. One response is to move some of the learning that would have taken place during class to out-of-class time. One way to do this is by having our students read their textbooks before class, which I’ve done in my math courses for several years now. This means that students come to class with some exposure and understanding of the material, which allows class time to be spent helping the students make sense of that material and go deeper via clicker questions and other active learning techniques.
However, since studies show that only about 30% of students will read their textbooks before class without some kind of incentive, it’s helpful to have students complete pre-class reading quizzes online. This semester, I’m having my students do so via our course blog. I post three or four open-ended questions about the textbook section we’ll be addressing in class. They respond to those questions in the comments below the blog post. (I’m using the Semi-Private Comments WordPress plugin to make sure student can’t see each others’ responses.) I grade them on effort, and the quizzes count toward a class participation grade. I’ve found these pre-class reading quizzes do the job well. I probably have between 80 and 90% of my students read the textbook before class and make at least some sense out of it judging by their responses to the reading quiz questions.
An added benefit to having students complete pre-class reading quizzes is that I can draw on student responses to open-ended quiz questions to create in-class clicker questions. Here’s an example:
Consider Question 1 on the Introductory Problems handout and Example 1 in Section 1.6. These two problems involve input-output relationships between different sectors of an economy. In what ways are these problems essentially different? Which of the following is the best answer to this question?
- The output from one sector in the example is entirely used up by the other sectors. In the handout, the output is only partly used and a net excess is provided.
- Example 1 asks for the total annual outputs of the coal, electric, and steel sectors. Whereas question 1 is looking for the production levels for an outside demand.
- In the original example, we’re solving the system to meet a single expectation from a foreign country of three demands, whereas the book’s example is looking to maximize the productivity. This means the book’s example has multiple solutions and we’re looking for the best of them, where as our original only has one.
- The two problems are different as the first is trying to find the initial inputs to achieve certain outputs while the second problem is about finding the market price.
The exact same question was posed on the pre-class reading quiz the night before as an open-ended question. The answer choices you see here actual student responses to that open-ended question. During class, I had my students respond to this clicker question, letting them know that four of them should recognize their own words in the answer choices.
The votes were split 30% / 0% / 43% / 26% among the four answer choices, which is a great distribution for generating discussion about the question. It helped that the most popular answer (#3) was partially incorrect. (The book example did not, in fact, deal with maximizing productivity.) The other two answers selected by the students (#1 and #4) are both correct, although #4 gets at the heart of the difference between the two examples more than #1 does.
Some of the students were bothered by the fact that this question doesn’t have a single correct answer. However, since I’m trying to help my students improve their ability to communicate mathematical and technical ideas, it’s worth spending time on a question like this one, where the quality of the explanation plays an important factor.
We had a funny moment when the student who supplied the popular but incorrect answer choice (#3) spoke up after we had discussed what that choice was incorrect. He didn’t directly own up to his answer, but instead said something like, “I think the student who gave that answer probably didn’t catch on to the fact that productivity wasn’t being maximized. He probably has a much better understanding of the example now.”
It can be challenging to write clicker questions with answer choices that align well with student understandings and misunderstandings of a topic. Taking the students’ very own responses as answer choices is one way to get around this. It also communicates to students that the pre-class reading quizzes are an integral part of their learning experience.
9 Responses for "Leveraging Pre-Class Reading Quizzes"
Great example, Derek. I’ve found myself doing the same thing even in precalculus. The questions are often less open-ended than your example, but I’ve found using a question where I can say “These are the answers I saw on the reading responses last night.” gets me addressing their actual misconceptions rather than what I perceive them to be. This has proved especially helpful when I was astounded that there were misconceptions on what should be a basic topic.
I’m interested in trying out clickers since my university provides them to faculty and I love technology! But, since I’m doing a literature class, I am not sure how I can integrate clickers in a meaningful way. I could poll the students about the reading, e.g., which of the 8 short stories that we read this week did you like best?, but then what? I’m afraid I’d have to write a bunch of slides where I offered opinions that they could only (dis)agree with and that doesn’t seem too productive. Just more top-down, I’m-the-voice-of-authority stuff and in a large class of 40+ students, I do enough talking and students are pretty quiet already!
There are no true/false, right/wrong answers in our reading assignments…All of the examples I’ve found online of profs using clickers tend to be in other disciplines (social sciences, sciences, math, etc.)–in which concepts, problem sets, facts, and so on are being taught. I mean, if I have the students read a novel, their ultimate assignment is to write a paper about it, not to answer factual questions like “what year was Jane Austen born?”
Thanks for any feedback you & your readers can offer!!
Hi Gabrielle, thanks for stopping by the blog. I’m glad to hear you’re interested in using clickers. There aren’t many teaching in the humanities who use clickers, but I think that classroom response systems can work very well in humanities disciplines. You might check out my posts tagged with English or Critical Thinking for some ideas.
You’re right that asking opinion questions and easy factual recall questions might not be a great use of clickers in your discipline. However, asking students to interpret a text or passage, providing them with a few possible interpretations, then asking them to defend their interpretations might work. The clickers then serve as an activity that sets up a great discussion about evidence and critical thinking. Does that sound like it might work?
[...] Bruff in Teaching with Classroom Response Systems talks about his use of pre-class reading quizzes using clickers: All that active learning during class must mean you can’t cover all the same content, right? [...]
I’ll add another example here of non-technical class usage of clickers.
I am teaching a graduate seminar course on faculty roles and responsibilities – mainly based on readings and class discussion. 3 students each week use Blackboard in between class sessions to post questions for their peers about the readings and peers respond. Since I know that not all posts are being discussed by all the students, I prepare clicker questions based on the student-designed questions and some of the answer choices come from their responses. Its not all agree/disagree – but rather a course of action being suggested because of a certain type of evidence, or policy. Of course these are mature grad students so with a little prodding they get the work done and make reasonable attempts at responding to each other, so that makes the work easier.
Thanks for the tips. However, my university would charge at least $50 per clicker per student (and I’d have to pay out of pocket to upgrade my personal laptop so it could work with the clickers, their software, etc.) So basically, it seems like a lot of work and dinero for very little payoff in terms of learning in my humanities classes–I already pose questions and then break my students into small discussion groups for free (using the courses’ blackboard websites, the actual chalkboard, powerpoint displays).
Sure, Gabrielle, glad to help. You had asked about the nature of clicker questions you might ask in your discipline, which is why I focused on pedagogy. I understand that financial and logistic constraints can be issues, as well.
One thing the clickers do is aggregate student responses quickly and automatically. That’s harder to do with other (digital and non-digital) technologies, although if your students have laptops in the class, you could use Blackboard’s quiz and survey tools for that purpose, I guess.
I’ll also point out that for all the clicker vendors I know, the software the instructor uses is free for downloading from the vendor Web site.
[...] I’ll occasionally use one of the pre-class reading quiz questions as a clicker question during class, copying a few select student quiz responses in as answer choices to the multiple-choice clicker [...]
[...] describe the rationale, use, and implementation of pre-class reading quizzes in my math courses. As I’ve mentioned on this blog, I ask my students to read their textbook before coming to class as a first encounter with the [...]
Leave a reply