A New Blog, More or Less

Short Version: I’ve consolidated my two blogs (derekbruff.com and derekbruff.com/teachingwithcrs) into a single blog that I’m calling Agile Learning. Look for new blog posts there, not here, and update your RSS reader accordingly.

Long Version: I started blogging back in 2008 with a blog focused on teaching with classroom response systems (“clickers”). I had just finished writing my book on that subject, and I wanted to continue exploring the topic. The blog gave me a venue for doing so, one that invited colleagues new and old to share ideas and perspectives.

After two years of blogging about almost nothing but classroom response systems, I found myself wanting to write about different topics, so I set up a separate blog where I could write about other topics that interested me. Over time, I found myself blogging less frequently about classroom response systems, and I found managing two separate blogs to be more trouble than it was worth. Moreover, I’ve been wanting to switch Web hosts for a while now. So I’m combining the two blogs into a single blog, Agile Learning, on my new Web host with a new domain name, derekbruff.org.

All my old blogs posts have been imported to new site, including all 219 posts from the “Teaching with Classroom Response System” blog. You’ll also find posts on other kinds of educational technology, visual thinking, student motivation, faculty development, how people learn, social media, and more.

Why the switch from .com to .org? Mostly because it made the Web host switch a lot easier, although I’ll admit I was influenced by the fact that three-quarters of the Digital Campus podcast crew uses .org domains.

What’s not yet on the new blog? Links in old blog posts still point to derekbruff.com. I’ll keep derekbruff.com live for at least a few more weeks, but it will eventually just mirror derekbruff.org. Also, many of the hundred-or-so categories I’ve been using on the clickers blog have been converted to tags, and I haven’t added a tag cloud to the new site yet. And there’s some non-blog content on derekbruff.com that needs to get moved over to the .org site. I’ll work on these tasks as I have time.

For more on the new site, including the reason for the name “Agile Learning” and some comments on its layout, check out the new site’s About page. And if you notice anything wonky about the new site, please let me know.

Image: “Moving Day,” Heather Weaver, Flickr (CC)

Posted in Uncategorized | Leave a comment

Clickers in the News

Classroom response systems have certainly made some headlines lately, probably because the start of the fall semester is a good time for news outlets to run stories on education. Since I’ve been too busy to blog about each of the stories below as they hit, I’ll make do with this news roundup…

  • Costly Clickers: Some Students Now Being Asked to Buy Device” by Samantha Ruiz, The Collegian, August 29 – This story appeared in the student newspaper of the University of Texas at Brownsville. In the past, clickers were provided to students free of charge, but with more faculty using clickers, the university did what many have done and moved to a financial model where students purchase clickers themselves. Some students appear to be upset over this, probably because of statements like this from instructors on the value of clickers: “Using the clickers makes the grading process easier.” As I’ve written before, if you’re using clickers to make your life easier, students aren’t going to want to pay for them. Fortunately, other instructors at Brownsville have the right idea:

[Michael] Lehker [, chair of Biomedicine,] said the clickers allow him to notice which students need help, give everyone a chance to participate in class, and provide immediate results.

“Usually in class discussions, the outspoken ones dominate the discussion, but with clickers, everyone pretty much has the same voice,” he said.

…He is able to see how many people got a certain question wrong and what areas he needs to place more focus on.

  • Don’t Lecture Me” by Emily Hanford, American RadioWorks, September 1 – If you’re not familiar with the Force Concept Inventory or the work of Eric Mazur, please, stop reading this post and go listen to this excellent radio documentary! Seriously, go there now. I’ll wait. I was blown away by the quality of storytelling in this documentary. I’ve heard Eric Mazur tell his “confessions of a converted lecturer” story many times, and Ms. Hanford shared it in this piece in a concise and compelling way. She worked in the story of the Force Concept Inventory, as well! Anyone who listens to this documentary and still thinks that lecturing is the best way to teach first-semester physics (or any other science course, for that matter) isn’t listening very well. Bonus: The second half describes efforts by the fledgling University of Minnesota Rochester to completely reinvent how higher education is done. Great stuff.
  • In Classroom of Future, Stagnant Scores” by Matt Richtel, New York Times, September 3 – In this lengthy piece, Mr. Richtel tackles the finding that some K12 schools that have invested heavily in educational technology (including clickers) have found that their students’ scores on standardized tests haven’t improved. This article has received a ton of attention, with many commentators pointing out problems with the idea that stagnant test scores are a problem for these tech-savvy schools. Scott McLeod’s response was the best that I read, although the responses by David Wees and Clive Thompson are also excellent. Thompson, for instance, does a great job describing three uses of technology in education to accomplish learning activities that are difficult or impossible without technology. That’s the kind of educational technology thinking that I like best, and I was impressed that it came from someone outside of education. And over on Twitter, @EDTECHHULK, pointed out one big problem with the low-test-scores argument in his usual succinct style:

ARIZONA SCHOOL USE EDTECH! TEST SCORES NOT IMPROVE! BUT STUDENTS WIN ESSAY CONTEST! WHAT THAT SAY ABOUT TESTS?! http://t.co/BMDNSt8
@EDTECHHULK
EDTECH HULK

  • With Cheating Only a Click Away, Professors Reduce the Incentive” by Jie Jenny Zou, Chronicle of Higher Education, September 4 – Cheating with clickers typically refers to student A bringing student B’s clicker to class so that it appears that student B is present, when student B is really back in the dorm, snoozing. I’ve blogged about cheating with clickers in the past, and it’s a concern that many faculty seem to have. Ms. Zou from the Chronicle interviewed me this summer about the issue, and she did a great job capturing my thoughts on the matter in this piece. Although there are various clever methods of catching cheaters (see the comments on the Chronicle article for examples), reducing the incentive to cheat is the best approach. Make sure your clicker questions don’t contribute much to a student’s grade (5, maybe 10 percent), and make sure you use your clicker questions in ways that help students learn. If it’s just about the points, then students are likely to try to game the system.
  • Going Paperless: Students Make the Switch to E-Textbooks” by Lauren Jansen, Vanderbilt Hustler, September 5 – Closer to home, I was interviewed by a former student of mine for a piece in the local student newspaper on technology in the classroom. There’s a bit in the story about e-textbooks, but it’s mostly about the laptops-in-the-classroom issue. Lauren did a great job conveying a few key ideas I shared with her (the need for “change ups” in lectures, the opportunity to use student laptops for in-class collaboration, the challenge of teaching students information literacy), although I don’t think I referred to “inserting video clips” as a creative opportunity for student laptops in the classroom! There’s also a passing reference to the use of clickers as a positive use of tech in the classroom.

Image: “A Happy Place,” Dustin Diaz, Flickr (CC)

Posted in Cheating, News Article, Peer Instruction, Student Learning, Student Participation, Student Perceptions | 1 Comment

Creating Times for Telling with Clicker Questions?

At that How People Learn workshop yesterday, I shared the idea of asking clicker questions you expect a good number of students to answer incorrectly as a way to create a “time for telling” where students are ready to hear and understand an explanation or mini-lecture on a particular topic. This is a pretty standard use of clickers and one that I describe in all of my workshops on teaching with clickers.

Yesterday, however, this use of a clicker question struck at least one person in the room as a de-motivation. Her read on the idea (or perhaps the experience of it, since I used the technique during the workshop) was that it communicated the message to students that they’re ignorant and the professor has all the right answers.

Maybe I just botched my use of this technique in the workshop (and thereby giving her the wrong impression), but, like I’ve said, I talk about this technique a lot, and I’ve never heard this criticism of it. The “time for telling” idea itself comes from a good source (Daniel Schwartz and John Bransford), but perhaps the use of that idea with clickers is more complicated than I thought.

What’s your take on asking students clicker questions you expect them to answer incorrectly as a way of creating times for telling? Ever hear any pushback on that as counterproductive?  (For a few thoughts on these questions, check out the discussion over on Google Plus.)

Image: “doh,” by hobvias sudoneighm, Flickr (CC)

Posted in Student Perceptions, Time for Telling | 4 Comments

Privacy Implications of Demographic Questions?

I’ve heard a few questions lately about the privacy questions of collecting student demographic data with clickers, largely as a result of the vendor i>clicker adding this feature to their system. The two specific concerns I’ve heard are the following:

  1. Let’s say you ask your students a series of demographic questions (gender, major, class year) followed by a series of opinion questions, maybe about sensitive topics like race or politics. Your plan is to parse out the responses to the opinion questions using some of the demographic variables to shed some additional light on student perspectives. However, given the demographic questions you use, you inadvertently uniquely identify one or more of your students, say the only female, junior math major in your class. Even though your students responded to the questions anonymously, you can now see exactly how that female, junior math major responded to your opinion questions. Have you violated this student’s privacy?
  2. You ask your students whether or not they have done drugs in the last week. You use your clickers in anonymous mode, but it’s clear that some of your students are drug users. Then one of your students commits a crime while under the influence a couple of weeks later. Might you or your institution be held liable for not acting on the information that there were drug users in your class?

This is a new area for me, in that I haven’t heard much discussion about how to handle these kinds of issues from faculty using clickers in the past. What’s your response to these scenarios? Are there other privacy issues that might arise from the use demographic clicker questions?

Image: “Privacy,” Rob Pongsajapan, Flickr (CC)

Posted in Student Perspective | 3 Comments

The Wisdom of Crowds: Clickers, Crowdsourcing, and Educational Technology (#Clickers2011)

Here’s the Prezi from my keynote at the Clickers 2011 conference today:

Posted in Uncategorized | Leave a comment

Backchannel (and Me) in the New York Times

A couple of weeks ago I was interviewed by New York Times reporter Trip Gabriel for a story on the use of “backchannels” in education. A backchannel is a second conversation stream in a classroom or at a conference, typically one leveraging digital tools to complement the lecture or spoken discussion on the “frontchannel.” If you’ve been to an academic conference lately, you might have noticed that some of the conversation happening during keynotes and sessions happened on Twitter. That’s an example of a backchannel.

Teachers in K-12 and higher education contexts are beginning to explore the use of backchannels in the classroom via Twitter as well as other systems, like TodaysMeet. I’ve written a book on teaching with clickers, and I see backchannel as another type of classroom response system, one that complements the use of clickers. I’ve been blogging about backchannel for some time, and it was those blog posts that caught the attention of Trip Gabriel, the NYT reporter.

Mr. Gabriel’s article, “Speaking Up in Class, Silently, Using Social Media,” was published last week, and it includes a couple of brief quotes from me:

When Derek Bruff, a math lecturer and assistant director of the Center for Teaching at Vanderbilt University, suggests fellow professors try backchannels, “Most look at me like I’m coming from another planet,” he said.

“The word on the street about laptops in class,” Dr. Bruff added, is that students use them to tune out, checking e-mail or shopping. He said professors could reduce such activity by giving students something class-related to do on their mobile devices.

Although I talked about many other aspects of backchannel with Mr. Gabriel, I’ll admit that the line about “coming from another planet” was probably the catchiest thing I said to him! I’ve given up trying to explain Twitter to faculty in workshops that aren’t specifically about Twitter–it’s just too alien of a medium for faculty not already using Twitter to easily wrap their heads around.

Unfortunately, the comments on the article on the New York Times site reflected this “I don’t get it” perspective.  Here’s an excerpt from the comment that’s received the most “reader recommendations”:

I’m speechless. How many ways can this be wrong? It needs to be explained to teacher Erin Olson that teachers should be encouraging students to extricate themselves from all the electronic gadgetry and to pay attention.

This comment must have been left by someone who hasn’t participated in a robust and interesting backchannel. When I attend a keynote talk at a conference, I’ll often tweet about the most interesting points made by the speaker, and I’ll sometimes respond to comments made about the talk by others on the backchannel. That’s not some form of distraction or even multitasking–it’s active listening. I think it’s great that teachers are encouraging students to listen actively in similar ways in the classroom.

Here’s another negative comment, this one from a user identified only as “M.”:

Part of our jobs as educators is to teach effective communication in multiple forms – listening, speaking, and writing. If technology allows a substitution for verbal communication, it is a failure.

As I wrote in my comment on the NYT site, it’s important to realize that a backchannel isn’t a substitution for spoken discussion, it’s an enhancement to spoken discussion. Instead of hearing from just a handful of students, you can hear from all students, even the quiet ones. That’s a great source of feedback on student learning for the teacher. And often having the chance to float a thought on the backchannel (and perhaps receiving an encouraging response) helps a student become more willing to contribute to the spoken discussion.

This notion that a new teaching modality is somehow a “substitution” for an established teaching modality is one that Barry Dahl debunks very effectively in a recent blog post:

Nowhere in the article did it say that the students used this backchannel technique every day  for class, or that it was the only way that most students could communicate in class, or that it had replaced their opportunity (or requirements) to speak out loud during class. In fact, there didn’t seem to be any reason to jump to that conclusion at all, but they most certainly seemed to do so. All the chatter about “students will never learn how to speak out loud” is the biggest bunch of hooey I’ve ever heard.

As Barry goes on to point out, there’s nothing wrong with teachers having more tools in their toolbox to accomplish their instructional goals. Also, if educators should “teach effective communication in multiple forms” (as M. wrote), shouldn’t that include online communication? Isn’t knowing how to navigate a Facebook or Twitter conversation part of what we mean by information literacy? Students need to learn to speak out loud, sure, but they also need to learn how to “speak” online.

On that note, I’ll mention here what others (including Ira Socol) have mentioned about the comments left on the NYT site. Many (not all, but many) of the negative comments were left by people not providing their real names–even though some of them criticize teachers for letting students “hide” behind the anonymity a backchannel supposedly provides. Moreover, few of the negative comments include responses to other comments. That is, most consist of comments left by people who apparently didn’t read the earlier comments on the article and certainly weren’t engaging in discussion others commenting on the piece. That’s pretty shallow online discussion–just the kind of shallow discussion some of the negative comments rail against.

The fact that many of those opposed to the use of backchannel in the classroom aren’t very good at participating in stimulating and robust online conversations isn’t really surprising, of course. If they knew how to participate online in productive ways, they would likely appreciate how valuable those kinds of online conversations could be in the classroom. Too bad their teachers didn’t have backchannel tools available–they might be more engaged digital citizens today!

Not all the comments on the NYT site were negative, of course. Nicholas Provenzano, one of the teachers mentioned in the article, left a great comment that used a cooking metaphor for teaching:

I like to look at my classroom and the way I set it up like a recipe for a wonderful meal… Every year I get new dinner guests with a host of special needs. My goal as the master chef is to create meals (lessons) that are appetizing to all of my students. Feeding the same thing to different people because others liked it is very short sighted.  Teachers that are willing to go out on a limb and try new things to reach different types of students should be applauded.

If you’re interested in learning about productive uses of backchannel in education, take a look at my past posts on the subject, particularly the ones profiling Gardner Campbell’s use of backchannel to involve an off-site librarian in class discussions and Monica Rankin’s use of backchannel to enhance small-group discussions in her history course. Also, the K12 teachers profiled in the NYT piece will be answering reader questions soon; you’re invited to post your questions for them.

Image: “The New York Times,” jphilipg, Flickr (CC)

Posted in Backchannel, Class-Wide Discussion, Free Response, High-Tech Options, K12, News Article, Student Participation | 4 Comments

Hitting the Road: Clickers Conference (Houston) & Higher Ed Conference (Ireland)

I’ve giving a keynote at two conferences in early June. The first is the Clickers Conference 2011 in Houston, Texas, June 3-4, hosted by i>clicker. My talk is titled “The Wisdom of Crowds: Clickers, Crowdsourcing, and Educational Technology.” Here’s the abstract:

Social media are used by ordinary citizens across the Mideast to tell the world about protests, crackdowns, and revolutions.  Free and open source software like Linux is developed, debugged, and enhanced by computer programmers around the world donating their time.  Wikipedia’s English version contains over 3.6 million articles that are edited and expanded by over 150,000 active contributors.  What makes these kinds of technology-powered “crowdsourcing” work so well?  In this talk, we’ll explore the principles behind successful crowdsourcing activities, see how those principles can help us use clickers more effectively in our classrooms, and discuss other educational technologies, such as backchannels and prediction markets, that complement clickers and leverage some of these same principles.

This looks to be a great conference. Jim Julius of San Diego State University is giving the other keynote, “Clickers Are an Interim Technology. T or F? Discuss.” Also presenting are Roger Freedman (UC-Santa Barbara) on the inverted classroom; Perry Samson (University of Michigan), inventor of Lecture Tools; Doug Duncan (University of Colorado-Boulder), author of the first book on clickers; and Sidneyeve Matrix (Queens University), speaking on social and mobile technology. The full conference agenda is available, and registration and more info is available on the conference website.

After one night back in Nashville, I’m heading to Ireland for the NAIRTL Annual Conference and Galway Symposium on Higher Education.NAIRTL is the National Academy for Integration of Research, Teaching, and Learning, and it’s hosting its annual conference in conjunction with the annual Galway Symposium this year. The theme of the conference is “Engaging Minds: Active Learning, Participation, and Collaboration in Higher Education”–right up my alley! I’ll give a version of my “Wisdom of Crowds” keynote. As for other speakers at the conference, frankly, I don’t know them! But I’m looking forward to getting to know the Ireland higher education community.

Look for some livetweeting from both conferences, assuming I can figure out how to get my Droid to work in Ireland…

Image: “Suitcase,” Sarah Macmillan, Flickr (CC)

Posted in Conference | Leave a comment

Cheating, Facebook, Clickers, and More – Problems in a Harvard Life Sciences Course

I’ve been following the coverage of the alleged mass cheating in Harvard University’s Life Sciences 1b course. The Crimson, Harvard’s student newspaper, ran a story about the course last week titled “LS1b Staff Investigates Cheating on Facebook.” Students in this course formed a Facebook group called LS1b that eventually had over 300 members. Everyone seems to agree that students used the group to gripe about the course, but there’s less consensus over other uses of the group. Apparently, some students came to the teaching staff and told them that other students were using the group to cheat during in-class quizzes. The teaching staff then let all the students in the course know that they had been alerted to this alleged cheating, then they changed the grading scheme for the course so that the in-class quizzes no longer contributed to students’ grades.

Reading the stories and comments posted on The Crimson website about LS1b, it’s clear to me that this course has a whole mess of issues. Here are a few that jumped out at me:

  • Cheating – It would appear that at least some cheating during in-class quizzes was happening in this course. What’s not clear is how that cheating took place. Did students compare answers by whispering to their neighbors? Showing their neighbors their answer sheets? Sharing answers on the Facebook group? Googling answers for themselves? Given the teaching staff’s concern about cheating, I can’t imagine that many students had their laptops open during these quizzes, but that doesn’t mean they weren’t accessing Facebook or Google on their phones.
  • Fear of Technology - Of course, it doesn’t mean they were, either. I think it’s a fundamental attribution error to assume that students in a Facebook group for this course were necessarily using it to cheat. Students were using technology to connect with each other on a scale not possible without that technology, but that doesn’t mean they were somehow less ethical than students in the past. They just have access to new tools for communication and collaboration. In fact, students might have been less willing to cheat on Facebook than they would in person since their interactions on Facebook were more likely to be observed or recorded.
  • Large Class Size – It’s not clear from The Crimson articles how many students are in this class, but I would guess it’s over 200 given the size of the Facebook group. It’s particularly hard to catch cheaters in a class this large, even with teaching staff patrolling the aisles during quizzes. Large classes also make it more difficult for instructors to create rapport with students, which is unfortunate, since some level of rapport helps greatly in tense situations like the one in LS1b. Here’s a comment on The Crimson article to that effect: “If the course were taught in smaller groups, and enough individual attention to students was available, these problems would not have occurred.”
  • Unclear Directions - Not only were students accused of cheating on quizzes, but they were also accused of cheating on clicker questions, called “breakouts.” Students were actively encouraged to discuss some of the clicker questions with their peers (in classic peer instruction style), but preceptor Casey Roehrig “explained that collaboration during breakouts was encouraged for discussion-based questions only. But some breakouts were meant to test solely the students’ understanding of the material.” If certain clicker questions are meant to be answered independently by students while others are to be answered in groups, that needs to be made very clear to students. From the outside, it’s impossible to know if the directions given by teaching staff were unclear or if some students misinterpreted the directions they were given. (There’s a “fear of technology” issue here, too. If students were encouraged to collaborate on some clicker questions, why shouldn’t they be allowed to do so online though a Facebook group?)
  • Unhappy Students – As I mentioned above, it’s pretty clear that the Facebook group was used by students to complain about the course. Venting to friends about a tough test, poor lecture, or frustrating grading policy is certainly fine, but venting to 300 friends about these things in a Facebook group has a potentially larger effect. Sometimes online forums can foster mob mentalities, in which small problems perceived by a few quickly snowball into complaints from many. On the other hand, sometimes online forums can help participants realize that what they thought was just their personal perception is actually a viewpoint shared by many. In the former case, the LS1b Facebook group might have contributed to student unhappiness. In the latter case, however, the Facebook group might have just made more visible unhappiness that was already there. In either case, it’s probably in the best interests of the students and the course for the teaching staff to respond in some way to student complaints about the course.
  • Changing the Grading Scheme Midstream – The result of the allegations of cheating has led the LS1b teaching staff to change their grading scheme with only a few days left in the semester. The “breakout” clicker questions will now contribute only 1% to the overall course grade, and the in-class quizzes won’t count for anything at all. I certainly understand the need to respond to the allegations of cheating, and reducing the impact of the assessments during which cheating might have occurred is one way to go about this. However, this seems somewhat unfair to the students who didn’t cheat but did work hard to do well on those quizzes. Had they known those quizzes would end up not counting, they might have spent the time studying for the quizzes differently, perhaps preparing for graded assignments in other courses. While I don’t approach the syllabus as a contract to the extent that some instructors do, I’m certainly cautious of changing course policies midstream.

The story of Life Sciences 1b is a fascinating one, in part because it brings up so many issues that I see and hear in other teaching contexts regularly. What are you thoughts? Have the teaching staff responded appropriately to the allegations of cheating? Is there a “fear of technology” embedded in their responses? Are the students not taking adequate responsibility for their behavior in this course?

Image: “tangles,” Lisa Bruce, Flickr (CC)

Posted in Biological Sciences, Cheating, Grading Schemes, News Article, Peer Instruction, Quizzes | 2 Comments

Clickers in Psychology: Change-Ups, Recaps, and Times for Telling

The Educational Support Team at the School of Arts and Social Sciences (ESTSASS) at the City University London recently posted a six-minute video interview with psychology instructor Kielan Yarrow about the ways in which he teaches with clickers. I can’t figure out how to embed the video here, so go watch it on the ESTSASS site, then come back here.

Dr. Yarrow identifies a few uses of clicker questions in his biological psychology and cognitive neuroscience courses:

  • By asking a clicker question every eight slides or so during his lecture, Yarrow helps students maintain their attention during class. See this classic article by Joan Middendorf and Alan Kalish for reasons why this is so important: “The ‘Change-Up’ in Lectures.”
  • These “recapping” questions give Yarrow’s students a chance to test themselves on the content he’s just lectured on, which is useful to their learning. Plus, it gives Yarrow some feedback on how well the students followed his explanations. He’s not able to test them on every aspect of the content, but he can assess their understanding of one or two key ideas.
  • From experience Yarrow knows that students are likely to misunderstand certain concepts. He constructs “leading” clicker questions where common misconceptions are among the wrong answers. When students miss these questions, this gives Yarrow a chance to explain this misconceptions. Below is the “time for telling” example question seen in the video. The second option was the most popular one with 76% of the votes. However, the fourth option was the correct one. Only 15% of the students selected this answer.

The geniculostriate pathway carries information from the right eye to…

  1. The frontal lobe
  2. The left-hand side of the occipital lobe
  3. The hippocampus
  4. Both sides of the occipital lobe
  • Yarrow will sometimes ask a clicker question at the beginning of a lecture that he expects many students to answer incorrectly. This, too, creates a time for telling by engaging student interest in the subsequent lecture.
  • Since clickers allow students to respond to questions anonymously, Yarrow finds them useful for gathering mid-semester feedback on his courses and his teaching. He’ll ask a few clicker questions to follow up on points students make on more-traditional mid-semester surveys.

There’s no mention in the video of student discussion of clicker questions in small groups or as a class. With the right kinds of questions, ones that are challenging but not too challenging, clicker questions can go a long way toward fostering student discussion during class. Given the ways Kielan Yarrow talks about using clickers in this video, I’m guessing that he would be open to a little experimentation with peer instruction in his teaching.

(Hat tip to Sharon Flynn!)

Image: “Signaling,” Kai Schreiber, Flickr (CC)

Posted in Background Knowledge Probes, Case Study, Conceptual, Formative Assessment, Instructional Improvement, Psychology, Time for Telling, Video | Leave a comment

The Backchannel – Dealing with Distraction, Incivility, and Unfairness (#EDUSprint)

This week the EDUCAUSE Learning Initiative (ELI) is organizing a five-day “sprint” on mobile computing in higher education. Yesterday, I blogged about the use of mobile devices (cell phones, smart phones, laptops, and such) as “super clickers,” part of a classroom response system that supports not just multiple-choice questions but also free-response questions. Today I’ll focus on the use of mobile devices to support student-to-student communication and collaboration in the classroom, the second of the five types of mobile learning I identified in a previous blog post.

While there are many ways of implementing this type of mobile learning, I’ll blog today about one I know well, the backchannel. In particular, I’m thinking about the use of mobile devices to allow students to participate in a synchronous, online discussion about course content during class. For some concrete examples of backchannel use in higher ed, check out my posts on uses of Twitter by Monica Rankin and Gardner Campbell. (And for a very different, non-backchannel approach to mobile learning type 2, read about how I used Prezi Meeting for in-class, collaborative debate mapping last semester.)

I’ve blogged several times about Cliff Atkinson’s book The Backchannel, and I’ll now continue that series by looking at some of the risks involved with running a backchannel (via Twitter or some other mechanism) during class. For some context, see my review of the book, nine classroom uses of the backchannel I identified based on Chapter 3 of Atkinson’s book, some thoughts on the prevalence of backchannels in college classrooms based on Chapter 1, and a couple of ways to manage the backchannel during class based on Chapter 2.

In Chapter 4, Atkinson puts on his “black hat” and describes some of the cautions speakers (at conferences and elsewhere) should have about backchannels, whether or not those speakers invite backchannel participation. I’ll reframe Atkinson’s cautions for the higher education context.

The Risk of Incivility – Atkinson notes that since comments made on the backchannel are more public than comments whispered to one’s neighbor during a presentation, the backchannel can amplify the effects of negative comments. To make matters worse, comments made online are often less “filtered” than those made face-to-face and they often have less context, leading to misunderstandings.

I can see professors worrying about student incivility on the backchannel a great deal. Might we see some of the same rude comments on a class backchannel that we see sometimes on RateMyProfessor? If students are allowed to contribute to the class backchannel anonymously, then, yes, there’s a risk of incivility. If, however, students are required to “own” their backchannel comments, I think the risk diminishes greatly.

Also, a one-off conference keynote, in which the speaker and the audience are together for one session and then go their separate ways, is likely to encourage more trollish behavior than in a course setting, where the instructor and students form a community of sorts that lasts for weeks or months. Of course, a backchannel blow-up that happens at one point in the semester could have lasting consequences for that community, so it’s important that instructors interested in experimenting with backchannel tools work to establish a reasonable rapport with their students up front.

The Risk of Distraction and Confusion – Atkinson points out that it can be distracting for a speaker to look out over her audience and see a bunch of faces pointed down at their smart phones. Likewise, audience members can distract themselves by paying more attention to the backchannel than to the speaker. Some audience members using their mobile devices to participate in the backchannel might end up surfing the Web instead. And someone with a laptop (or an iPad with the clicking noise turned on while typing) can distract other audience members nearby.

I’m pretty active on Twitter when I attend conferences, and I’m mindful of the criticism often leveled at those who tweet during sessions–that they’re not paying attention or that they’re trying to multi-task, which, as psychologists keep telling me, is impossible. However, many of those who tweet during conferences are actually engaged in what I would call active listening, identifying key points in the presentation and taking notes on those key points by sharing them on Twitter. Often the “live tweeting” I do during presentations is primarily for myself, so that I’ll have some handy notes to reference after the talk. Any benefit my Twitter followers gain from my tweets is bonus.

That being said, the distraction issue is one that I know professors are very sensitive to. Many professors worry that students who bring laptops into class for note-taking purposes end up distracting themselves by checking Facebook, watching ESPN, or shopping for shoes. (Almost every time I see an article on this issue, shoe shopping is mentioned. Apparently, that’s the distraction of choice for some students.) Having students use laptops and other mobile devices to participate in a backchannel isn’t likely to diminish that worry!

On the other hand, I’ve heard from several instructors who encourage mobile device use in the classroom that when students are given something on-topic and productive to do with their devices during class, they spent much less time using those devices for off-topic purposes. On some level, I think students realize that the device they have with them is capable of so much more than just helping them take notes. They want to use it for something interactive, something that helps them stay engaged (or at least awake). If the instructor doesn’t give them some tools for doing so, they find their own ways to leverage all that computing power, which apparently involves shoe shopping.

Although I’m arguing here that the risk of distraction is overestimated by many, I also see the need to develops ways to mitigate this risk. See my previous post on “backchannel breaks” for one approach.

The Risk of Unfairness – Atkinson raises a few ways in which the backchannel might be unfair to those involved. Since a presenter often doesn’t have the mental bandwidth to monitor the backchannel while presenting, there can be perspectives raised on the backchannel that the presenter misses, leaving the presenter out of the conversation. Some audience members can weigh in on a presentation before the presenter has time to clarify his or her points, which can be unfair, as well. Those in the audience not on the backchannel can feel left out of the conversation, and even those engaged in the backchannel can feel left out if a few vocal participants drown out other perspectives.

Given the position of power most instructors hold in the classroom, I’m less worried about the risk of unfairness to the instructor coming from the backchannel than I am the risk of unfairness to students. I recently led a workshop on using crowdsourcing tools to leverage the diversity in one’s class for student learning, and I talked a bit about the backchannel (in the form of Google Moderator) as one such tool. A few participants in this workshop pushed back on my ideas, arguing that some of the crowdsourcing tools I mentioned, including backchannel tools, can marginalize students with minority perspectives, particularly on controversial topics like race, gender, politics, or religion. This unfairness is a legitimate concern, one that instructors should attend to.

One of the ideas I shared in that workshop is the notion of “the long tail.” In the college classroom, certain perspectives on any given topic are going to be held by many students, while other perspectives are going to be held by only a few students. While the more common perspectives may get more “air time” during class in a discussion, it’s important to recognize that there’s often great value in the “long tail” perspectives, that is, those minority perspectives that sometimes don’t get surfaced during class. While some of these perspectives might get lost in a busy backchannel conversation, it’s worth noting that they often don’t get shared at all in a more traditional discussion. Every student can contribute a thought to the backchannel at the same time; only one student at a time can share his or her thought verbally with the class in a traditional discussion. Thus, the backchannel provides a tool for making those “long tail” perspectives more visible during class.

That assumes, of course, that students feel comfortable sharing “long tail” perspectives with their peers and, to some extent, with their instructor. This concern is why the anonymity provided by clickers is so important. A student can vote for answer choice A, B, C, or D without having to worry what his peers might think about that selection. Allowing students to contribute to a backchannel discussion anonymously is one way to make it safer for students to share minority perspectives. I noted above that anonymous discussions run a greater risk of incivility, however. Having backchannel comments anonymous to students but identified to instructors might be a way to balance these two risks. Each class context is different, however. One instructor might find more value in completely anonymous comments (anonymous even to the instructor), while another might find more value in having students identify themselves with each comment.

I linked to the website for Chris Anderson’s book, The Long Tail, above. Anderson argues that a long tail market (say, books sold on Amazon, where there are lots and lots of titles that don’t sell many copies) works best when the market has ways to search the long tail and “promote” long tail items to greater prominence. For example, when you buy a very popular book on Amazon, Amazon might recommend a related “long tail” book you might also like. If enough customers see that recommendation and act on it, that “long tail” book can become a bestseller. As Anderson writes, that’s exactly what happened to Joe Simpson’s book Touching the Void, which owes much of its success to John Krakauer’s book Into Thin Air and Amazon’s recommendation feature.

All that to say, you don’t want “long tail” perspectives shared by your students to get lost in the backchannel. You need to have mechanisms by which these perspectives can be made more visible and integrated into the class discussion. That might involve an amplification tool that many backchannel systems use to allow participants to “vote up” peer contributions they like. Such a tool would allow a minority perspective that’s particularly insightful to get more attention. On the other hand, a minority viewpoint that isn’t “voted up” gets lost in the backchannel that much more thoroughly, so having someone (the instructor, a TA, a designated student) monitor the “long tail” of students comments, looking for valuable perspectives not getting enough attention, might be necessary.

The Risk of Chaos – As Atkinson describes this risk, it’s something of a combination of the other risks he mentions. He tells the story of an on-stage interview of Facebook founder Mark Zuckerberg at the 2008 South by Southwest Interactive Festival, in which audience members used the Twitter backchannel to vent their frustration quite colorfully at the interviewer, who didn’t seem to be asking Zuckerberg the tough questions. I’ve heard this kind of mob mentality blowup called “tweckling” (Twitter + heckling) and “harshtagging” (harsh + hashtagging). Those silly words don’t really express how traumatic this kind of audience backlash can be. Check out danah boyd’s description of her keynote at the 2009 Web2.0 Expo to see what I mean.

As I mentioned above, given the power differential between instructors and students, I don’t think there’s any great risk of a backchannel blowup in most college classrooms. I see two exceptions, however:

  • Instructors who are in some way “other” than their students (a female instructor in a male dominated field, a professor of color on a largely white college campus, and so on) don’t have the same power relationship to their students that some instructors have. There’s lots of literature on the experiences of these instructors that’s relevant here, but suffice it to say, such an instructor might want to take extra care when implementing a backchannel in the classroom.
  • A backchannel initiated and organized by the students, not the instructor, has greater potential for blowing up during or after class. Imagining looking out at your students, not knowing that a third of them are ripping into you on Facebook while you lecture. (Given what I know of students’ social media use, it would be on Facebook, not Twitter.)

It’s this latter scenario that Atkinson addresses in the remainder of Chapter 4. He points out some of the ways that conference audiences, at least, are changing and coming to expect more participation and more interaction. They’re walking into hotel ballrooms with smart phones and tablets, ready to participate in a backchannel conversation whether the keynote speaker wants them to or not. Atkinson advises speakers to learn about the backchannel and, since they can’t shut it down, start taking advantage of it.

I don’t know if the same change is happening among college students, but I suspect elements of it are already in place. Surveys indicate that about half of college students in the US have Web-enabled smart phones. And they’re certainly used to living in a participatory culture. They might start pushing back against attempts to ban mobile devices in the classroom and start organizing their own backchannels on Facebook or elsewhere. I’m not trying to scare anyone here. I’m just arguing that as our students’ expectations for technology use in the classroom change, we should learn about those expectations and look for ways to leverage those expectations to help students learn.

What about you? Do you see these potential risks for backchannel use in the college classroom? What methods do you suggest for dealing with these risks?

Image: “Black Hat on a Rack,” arbyreed, Flickr (CC)

 

Posted in Backchannel, Book, Faculty Development, High-Tech Options, Student Participation | 3 Comments