Gamification: A semester in the trenches

My reasons for wanting to use gamification strategies in my large Intro to Education course were obvious: student accountability, timely and continuous feedback, and better motivation to do otherwise rudimentary activities. I learned pretty quickly that implementing gamification strategies was more difficult than I initially thought. First, I had to figure out the instructional design aspects of gamification. How many points are different experiences worth? What do I count and what do I leave out? Second, I had to figure out how to keep track of all of this and communicate it back to the students. As I have written about before, I used Google Sheets to do this.

Overall, I would say I am pleased with how my first attempt at gamification turned out. Was it perfect? No way. Did the students like it? Mostly, but I'm sure I will hear from those who didn't on my course evaluations. Did these strategies help me reach my course goals? Absolutely! Class attendance was the best it has ever been in the 3 years I've taught the course. I regularly had over 90% of the students completing the weekly readings every week. That is unbelievable! I actually had students competing to complete extra credit so they could move to the top of the leaderboard. I did not see that one coming. Even though the course outcomes associated with these gamification strategies were successful, I learned a lot about how to do it better next semester. I will discuss these lessons in more detail.

More Competition

One of my goals in using gamification strategies in my class was to increase engagement and not give students a laundry list of things to do every week. Well, the way I structured the points, it turned out to be just what I was trying to avoid. Every week the students had to complete a module (video and/or reading + short quiz) before class on Monday. Then they went to schools on Wednesday, and there were points associated with that. On Friday, they participated in small group discussion, which had even more points. Everything was recorded on a big spreadsheet, and students were ranked on a leaderboard. What I discovered was that most of the students completed all of the requirements each week. Basically, there was no way to really move UP the leaderboard. Students could only move DOWN if they failed to complete a requirement. Believe it or not, that is not very competitive, and therefore, isn't all that much fun.

There were minimal opportunities for students to do extra and move up the leaderboard, but they were in fact so minimal that it hardly made a difference. This didn't keep the students from trying to get more points here and there, which was my first clue that there needs to be more competition. Some ideas I am playing with include:

  • Using Kahoot for discussion questions
  • Students voting for "best" responses to questions
  • Competitions between discussion groups (attendance, challenges, completion rate, etc.)
  • Challenges during class

I do not want to overdo this, but I think a little more competition would make this aspect of the class a lot more fun.

Reboot

Another flaw in my approach this semester was that the "game" lasted all semester. I gave the students monthly feedback in the form of a points sheet, which led many of them to just see it as a big assignment. I would venture to guess that they viewed this experiment as a big ole' laundry list because I treated it like one. In the end, there was no way for students who had gotten behind early in the semester to make corrections and do better the next time around. Students could recognize the impact of their choices on their point total and start to do better, but it did not erase early mistakes. This goes against the nature of most competitive endeavors, where players can overcome early mistakes later in the competition and keep themselves in the game.

I am thinking about splitting the game up into three smaller games this spring, and starting the points and leaderboard over each time. This will allow students who get off to a bad start to do better the next time. I can still keep track of completed assignments and attendance for the purposes of grading, but I will link other incentives to the leaderboard. What are the incentives? I have no idea, but I have a few weeks to think about it.

Better Feedback

Another issue I ran into this semester was getting feedback to the students on a weekly basis. I did pretty well at first, then some of my TAs got behind on entering scores and I went a few weeks without sending updates to the class. Once everything was updated and I got around to sending the updates, some of the students were like, "Whoa! How did I lose all these points?! I thought I was doing OK!" And I was like, "How can you not know if you missed class or an assignment?!" And they were like, "Hey man, we're too busy to remember all that!" And I was like ... OK, you get the point.

This observation has less to do with the game itself and more to do with giving more timely, detailed feedback. Some of the students felt like they were in the dark all semester and did not know they had missed 6, 7, or 8 classes until the end of the semester. I was never the kind of student to miss class, but I can see how it might be easy to lose track over such a long period of time.

I have a plan for keeping the spreadsheet updated better, but it is not really worth writing about here. Needless to say, I think weekly updates will help quell some of the panicky e-mails at the end of the semester.

What am I missing?

I am pretty sure my second attempt at gamification will go much better than the first, and I'm looking forward to putting some of these ideas into practice. For those of you who have been doing this for awhile, what are your suggestions? Am I missing something obvious? Am I making assumptions with potentially disastrous consequences? I would love to hear from the true game masters!

Schoolification

Pac-Man (1980), will go on show at MoMA in New York in 2013 I have been thinking about gamification a lot lately. I teach a really big class full of energetic undergraduates, and I want to make the class better. It is already pretty darn good, but there is always room for improvement. One way to do this is to add game elements to some of the more mundane aspects of the course.

As an aspiring Teaching and Learning scholar, I dug into the literature on gamification and game-based learning (and trust me, there is A LOT of it!) to investigate possible frameworks and suggestions for a successful implementation of game-based learning. One framework that has been really helpful for me as I plan some game-based elements into my course was proposed by Bunchball, a corporate gamification company. As stated in one of their white papers, there are 6 elements that serve as the building blocks to all successful games. Coincidentally, these game elements interact with game dynamics that are associated with basic human desires that tend to motivate and engage people within a gaming experience.

[table id=1 /]

When I look at this table, I see many similarities and natural applications to education. The way the education system is currently structured, there is already a pretty heavy dose of competition, achievement, reward, and status. There is also some possibility for self-expression and altruism, depending on the way a course is set up. So, I understand that education and gamification go hand-in-hand quite naturally.

So what happens when an instructor takes activities that students might naturally enjoy and make them just another assignment? I call this "schoolification," which is when a teacher deflates student interest in an activity or project by assigning points, a grade, or any other requirement that students might otherwise resist.

The first time I encountered schoolification, before I even had a name for it, was in a conference presentation where a professor described his use of Facebook in his classes. Each student in the class had to join his group on FB, they were required to comment on his posts, and they would "lose points" if they didn't do either of those things. My first thought was, wow, that's a great way to make students hate Facebook. Take something they like, make them use it in a way they don't want, then hold their grade over their head of they don't do it.

If the instructor is not careful, I think the same thing can happen with blogs, digital stories, flipped lessons, and cooperative learning (or any other activity for that matter). Students have to be held accountable for their professionalism, but how do we do this without schoolifying activities they might otherwise enjoy? This is a challenge I would like to learn more about.

How do you hold students accountable for their participation in class activities without schoolifying those activities that are intended to be engaging and fun.

Gradenomics

It's that time of year again, when I spend a lot of time reflecting on the semester and academic year. I have already posted once about this, and I have at least two more ideas incubating in my mind. The idea that came to me today as I graded final exams, calculated final averages, and entered final grades into "the system" is that universities - or perhaps my university - put a lot of emphasis on finals. This led me to consider whether or not there TOO much emphasis on final exams. As it is now, we set aside an entire week, shuffle the schedule, and give each professor 2.5 hours to administer the exam. Yet, I have not given a comprehensive final since my 2nd year of teaching higher education. Is this really worthy of its own week?

My first college teaching assignment was as a Master's student, and I taught public speaking. It was a massive faculty-directed, TA-taught course where they basically told us what to do. We had some freedom to teach any way we wanted, but we had to give the same assignments and grade using the same rubric. If our overall GPA was too high, we got a personal note from the course director telling us to grade harder. We also had to give a comprehensive final, which seemed totally ridiculous for a public speaking class.

Since those days, I have jockeyed between giving a final project (portfolio, paper, etc.) and giving the last test during the final time slot. My current university is adamant about professors doing something during finals week, so I have been using that time to give the last exam. I have also used this time to have students present their final projects, but it just seems contrived to me and seems to always fall a little flat. Some of the more adventurous faculty have the students bring food and they have a party.

My point is, there is a certain amount of hype associated with finals that I am starting to think is unnecessary. Whereas my students typically cram for the first two exams, they spend days and days studying for the last exam. And what is the payoff? Actually, the course average was lower than the second exam even though the exams were about at the same level of difficulty. I have exams weighted so that each test accounts for about 13% of the final grade. I did this a few semesters ago because I wanted the exams to mean something. Before I weighted the exam scores, a student could do poorly on exams and still eek out a decent grade by getting some of the "sit-and-get" grades, such as attendance or participation. Basically, taking the exam counted the same toward the course average as showing up to lecture and surfing Pinterest for an hour. So, what does this mean in terms of the last exam's impact on the overall grade? Here are some points to consider (remember, this is based on a scale where each exam contributes 13%, or 39% total, toward the overall grade):

  • 35 out of 53 students got a score on the final within 2 percentage points of their current average. Mathematically, this had absolutely no impact on the final grade. For example, if a student was sitting at 91.21% and got a 93% on the final, the overall average was raised to 91.55% (I'm making these numbers up, of course, but they are pretty accurate to what I observed). Unless a student was a fraction of a percentage point from the next grade, this had no impact. It was just damage control.
  • If a student scored 10 percentage points higher or lower on the final than the overall average, it meant a difference of 1 percentage point either way. In fact, this held true for every 10 percentage point differential. For example, getting a 75% on the test would lower the average from 85 to 84. That also means that getting a 100% on the test would only raise the average from a 85 to 87 (and that is a generous estimate). This is the difference between a B and B+, which is hardly the Hail Mary the students think it is.
  •  9 out of 53 students went down one grade based on their final exam score, and each of them was 1 point or less from the borderline. That is, they went from a B+ to a B, but they started at  87.1% not 89.9%.
  • Only one student went UP a grade based on the final exam score, and the starting average was already less than a percentage point from the cutoff.

Are you confused yet?

I am not advocating students completely blowing off a final because it won't make a difference in the long run. Students should always give their best effort no matter what. I also know that students spend just about as much time eating junk food and complaining about their professors during "dead days" as they do studying. I am just wondering if we should put so much emphasis on that one week when it's really the students' body of work throughout the semester that compiles their course average.

I am curious to know how others handle finals, and if they have more (or less) of an impact in your courses than what I have described? How are finals handled in other disciplines? Should they be more high-stakes, or are they just hype?

Dealing with Disappointment

I have been teaching for nearly 20 years, and I have seen just about everything. Throughout the many life changes I have experienced in that time, teaching, oddly enough, has been one of the constants in my life. Early in my career I would stay late at school and come home to an empty apartment. Soon enough, I was finding ways to have lunch with my wife over our short lunch breaks. Then I was rushing home after teaching so I could spend time with my babies. Now I have to be creative in order to balance my teaching with things like baseball, gymnastics, theater classes, church, committees, writing, and staying connected to family. During all this time, students have come and gone from my classes, hopefully taking something with them that will help in their life journey.

Teaching requires a lot of creativity and problem solving because no matter what is happening in your life, you have to try to do your best for the students. In my career I have had to deal with crazy parents, over-scheduled meetings which force me to plan my lessons late into the night, hectic travel schedules for the sports I coached, sleepless nights, unexpected family crises, unpredictable weather, and disruptions to the school day. All in all, I would say I have done a pretty good job of paddling and finding the current. There is, however, one aspect of teaching with which I have not dealt very well.

Disappointment.

Maybe it's because I expect myself to be perfect. Or amazing. Or brilliant. Perhaps I spend too much time comparing myself to my peers and wanting to be the big fish in the pond. I already know I put too much stock in my course evaluations and Rate My Professor and any other metric I can find to evaluate my worth as a teacher, so maybe that feeds my disappointment. It could be that my expectations are too high, and while I perceive the response to a good class to be a standing ovation, my students are just anxious to meet their friends for lunch. No matter what the cause - and it's probably a complex mix of those factors I already listed, along with some I haven't identified - disappointment has always been a tough pill to swallow.

For the better part of this semester, I have been dealing with disappointment: in myself, in my students, in the fact that I didn't foresee some of the problems with one of the classes I have been teaching. Since the third week of the semester, things took a downward turn and despite my attempts to make the class better it has not been enough to make it a positive experience for anyone involved. Like I said, very disappointing.

It would be easy to wrap myself in self-pity, curl up in bed, close my eyes, and just wait for the semester to end. Trust me, I have considered that many times, and perhaps in small ways I have done some of that. However, as the self-reflective navel-gazer that I am, the ultimate question is this: What do I plan on doing about it? Other than venting to a few colleagues, which I have done more than I care to admit, I can't help but abstract some lessons from my disappointing semester.

Disappointment reminds me that I care.

If teaching and teaching future teachers about teaching was not a big deal to me, this would be easy to shrug off. Blame the students and move on. But this does matter to me and I understand the importance of what I am doing. No one is guaranteed that living out their passions or purpose or calling will be without setbacks. The setbacks actually remind us how closely our calling, purpose, and passion are woven in with our very being.

Disappointment reveals areas to get better.

Do you know which of my classes have historically gone the worst for me? Those which follow a class which has gone really well. If I think I have reached superstar status, where is the incentive to do things better, to be self-reflective, or try new ideas? There is no such thing as cruise control in teaching, and just because a certain approach or teaching style worked with one class does not mean it will work the next time. As long as I am teaching, there will be aspects of my practice that need to be revised, refined, or removed. It's hard to see those things when I am blinded by my own awesomeness.

Disappointment reinforces what is constant.

Even though I have to adapt every class based on the unique dynamics created by the students and circumstances, there are some elements of instructional practice that should never be compromised. High (yet reasonable) expectations. Timely feedback. Positive teacher to student relationships. Close monitoring of student engagement. Consistency. Fairness. Preparation. These make up the foundation of a healthy, vibrant class. I may be stuck with a class full of disengaged, apathetic, know-it-all students (speaking in general terms, of course ... not any particular class), but that should not change those core elements of effective teaching. If anything, the tougher the students, the more I should lean into those aspects of teaching that have been proven over time. Don't play off your students' responses because chances are they stayed up too late, woke up minutes before class, and put off their assignment until the last minute. As a baseline, my teaching must be one of the constants in their lives.

Honestly, I am thankful things did not go as well as I had hoped this semester (in one class at least ... the others went great). I have a lot to learn, a lot to improve, and a long way to go. Adversity causes everyone to either wilt or get stronger, and I choose the latter. The day I think otherwise about my teaching is probably a sign it's time to choose a new career. Thank you, disappointment, for the not-so-gentle reminder.

All In: The New LMS

Today I attended a presentation sponsored by Apple about the changing role of mobile technologies in higher education, particularly colleges of education. This is of particular importance to my college right now because we are beginning to talk a lot about how and why to use different types of technology in our courses. Many faculty have been using technology for many years in their courses, but we are starting to see a shift in the role of technology in terms of how students access and use information. The presentation today, given by John Landis, Ph.D., was very much in line with the conversations I have been having with some of my colleagues over the past few months.

I will be honest, Dr. Landis' presentation was impressive. He is a great storyteller and is current on the trends and predictions sweeping through both K-12 and higher education. He understands that technology has traditionally been used to help teachers do what they've always done more efficiently or faster. He knows that students these days can get the same content traditionally transmitted from the instructor on any device, anywhere, at any time. And it's usually a lot more interesting. None of this was new to me, but it was still delivered in a fresh and relevant way. Landis presented a blend of theories, examples, and demos, primarily from his MacBook and iPad Mini, and the technology worked like a champ. He mirrored his iPad display using an Apple TV, and could switch pretty quickly to his MacBook Air to demo other programs. As a pretty heavy tech user, I was impressed that he was able to change speeds in so many different ways without so much as a hiccup.

What this presentation made very clear to me, however, was something I have been mulling over for quite some time. It is this idea that in order to fully leverage the benefits of one device, you must fully employ all of the devices in that particular ecosystem. In this way, Apple is actually becoming a device-based LMS. Just like Blackboard or Moodle have a suite of tools under the hood, Apple has an array of powerful tools that can really change the way teachers and students approach learning. The catch, however, is that one must buy in to the whole ecosystem in order to really see these benefits. For example:

  • I can create a customized, multimedia iBook on my MacBook for free, but it only really handles Mac-based media (.mov, Keynote, Pages, etc.).
  • Only my students with an iPad can download the multimedia version of the book and get the full benefit. Students running Mavericks can also read the book on their Mac, but students with Android or Windows devices are left behind.
  • I can mirror my iPad to my MacBook using AirServer, but it's not stable and does not work over my schools WiFi. If I want to really mirror my iPad, I need an Apple TV.
  • I can sync content across devices with a variety of tools, but the only way to sync ALL of my content is with iCloud, which is only for Mac.

The point is, each tool Dr. Landis showed us does amazing things. I want to try everything he showed us (except for the stuff I am already doing ... I want to keep doing it). But the only way to leverage the capabilities of each tool is to use it as part of the Apple Ecosystem (a term he used repeatedly). Apples are meant to work with other Apples, and there is really no motivation to make them work with Android (Google) or Windows. My workarounds, as I have found, are much more complex than the typical tech-using teacher is willing to mess with. I have found a way to teach from my iPad without using AirServer, which is a pretty awful replacement for an Apple TV. I use Google Docs to host and share course files, which works pretty well most of the time, but it's not as slick as content aggregated in an iBook. I have founds ways to do the things I want to do, but it's always a little more work when I am doing this across devices and outside "the ecosystem."

My take-away message is that Apple, Google, and Windows really are trying to create a system, and already have, where users must be "all in" in order to reap the benefits of their technology. More than ever, their tools only really play well with their own family members, and it is becoming increasingly difficult to lead a balanced digital life across platforms. With the exception of a few apps like Evernote or Google Drive, content on your device stays on your device.

I have no idea which ecosystem TCU will join, but I think they will eventually need to decide. These companies, which control the market, are leaving us very little choice otherwise.

Teaching Naked: The workshop, not the dream

Last week, I attended a workshop hosted by our teaching excellence center called Teaching Naked. This is a catchy title for both Jose Antonio Bowen's book and workshops, but I find it a little ironic considering the content from his presentation. When I think of "teaching naked," I think of eliminating all adornments and superfluous elements from the class. I had a professor at UVa, Dr. John Sanderson, who taught this way. For an entire semester, he taught our Tests and Measures class without the use of PowerPoint, a LMS, or any other instructional tools. He showed a couple of short video clips on the VHS player, and he would occasionally bring some handouts. Most of his diagrams were written on the board when we arrived, and the majority of the class was discussion and lecture. It was an engaging class and quite helpful in my development as a researcher. I had already taken Stats I when I took Dr. Sanderson's class, and he did a nice job of filling in the gaps of what I had missed the first time. He truly taught naked. On the other hand, Dr. Bowen's workshop centered on using A LOT of technology. His approach to teaching could best be described as the "flipped classroom." He presents students with a variety of media to watch, think about, and learn outside of class, then uses class time to engage students in activities that require face-to-face human interaction. I like this approach to teaching and hope to emulate it with the same skill as Dr. Bowen, but I do not consider it "naked." In fact, it is quite heavily adorned with a host of social media tools, to the extent that I wondered how a students, or the professor, would keep up with it all. He talked about e-mail, Twitter, Socrative, Facebook groups, Google Hangouts, Skype, YouTube, Merlot, and several other tools. What he did not talk about at any point in the talk was PowerPoint. In fact, the take-away message from the workshop was, "Stop delivering boring lectures using PowerPoint and start engaging your class more ... during class time."

Some of Dr. Bowen's ideas were not new to me. Socrative, Twitter, YouTube videos, Google Docs. I use each of these tools in different ways to support my teaching and keep students connected to the class. Other ideas where, quite honestly, not ever going to be part of my workflow: Facebook groups, Skype, or MOOC's. But I did take away some ideas I would like to implement either this semester or in the spring. I have already taken one suggestion, which is to send student materials related to class electronically after class is over. This way, they are not reading the paper instead of listening. I also would like to try broadcasting a Google Hangout session live sometime before the next paper is due. I have responded to nearly 30 e-mails in the last two days, each of which ask essentially the same 3-4 questions. I will give the Hangout a try and see if anyone joins in to ask questions that everyone can hear the answer to. This also lets me record the session, so students who miss can watch it later. I have never been that open to devoting time in the evenings in this way, but after spending at least two hours in the last couple of days responding to e-mails, I like the idea of reducing this down to an hour. Show up, let the students ask their questions, and get them to work.

In addition to some new ideas to apply to my teaching, the hour and a half spent listening to Dr. Bowen speak was quite enjoyable. He's funny, intelligent, and has some very keen insight into the way students think and approach school. I haven't decided yet if I will read his book, but I will definitely look through his website for some new ideas. In no time, I will be teaching naked too!

TCU Lyceum 2013

Last week I had the opportunity to speak about educational technology to a group of 26 principals from around the state. When I say a "group of principals," what I really mean is "some of the very best principals" in the state. All of the superintendents in the state were contacted and asked to recommend their highest performing principals for the TCU Educational Leadership Lyceum 2013, and these principals were among those recommended and accepted. To say I was intimidated would be a huge understatement. I have taught classes to large groups of people virtually everyday for nearly 10 years, so it would stand to reason that I was up for this task. The truth is, I analyzed, planned, re-analyzed, over-planned, and perseverated over this presentation for weeks.

I will be the first to admit my presentation was kind of all over the place. I started with something about the past and future of educational technology ("Let's start by talking about the invention of fire ..."), then I mentioned something about the myths and actual findings of ed. tech. research, and I ended by showing them a few tools/activities that I like to use in my classes. Since this was my first presentation like this, I made the common rookie mistake of trying to do too much within such a short time frame. The presentation was scheduled for 3 hours, which seemed like a lot of time, but once I got the participants involved in some activities, it flew by. As usual, I left the presentation with a pretty good idea for what went well and what I would do differently if I were to get this opportunity again.

Here are my main lessons from this experience:

  1. Less is more. People can only remember a certain amount of information, and they are probably more likely to remember a handful of compelling activities than a bunch of information.
  2. There are no style points. Actually there could be, but if they distract from the One of the main mistakes I made was trying to switch between too many programs. I was projecting my main points using the Broadcast feature in SlideShark. I was mirroring the display of my iPad using AirServer when I wanted to demonstrate something. I was pulling information from several different browser tabs. It got confusing for me, which means it was definitely overload for the participants.
  3. Use activities to illustrate a point rather than making them the point. I knew this as I planned the presentation, and I still gravitated to this error like a moth to a porch light. I usually like to arrange a presentation around 3-4 big ideas, and I have activities that make them come to life. This time, I did that for 2 out of 4 of my main points, so it should come as no surprise that only half of my main points went over well. Anyone who has done this sort of thing for awhile knows you can't just show people tools. One fourth of the audience is two steps ahead and bored, one fourth is with you, and half of them are totally lost. I had to re-learn this lesson the hard way.

Overall, I feel very fortunate to have been included on the program for this amazing group of principals. Their energy and love for students was evident in just the brief time I was with them. They asked great questions and willingly participated in the activities I had set up for them. Many of them followed along and took notes on their personal devices, which I believe increases the probability some of these ideas will live on beyond the short workshop. I am also thankful for my colleagues at TCU who invited me to be part of their team. I look forward to many more excellent experiences in the future.

It's not you, it's me

For several years, I have asked students to fill out a Student Information Survey at the beginning of the semester. I adapted the same survey from semester to semester, but it essentially consisted of the same questions. Sometimes it was worth a grade, other times not. Sometimes I made the fields required, sometimes not. Since I have typically taught tech-integration courses for the past several years, most of my questions were technical in nature. I wanted to know such things as their current tech setup (type of computer/OS, access to other devices, etc.), experience with current tech trends (social, mobile, Cloud, gaming, etc.), the intensity of their love/hate relationship with tech, and how their teachers in the past have used it. I also asked a a couple of questions about how they learned best and about any teaching experience they had. Overall, this Student Information Survey was not very exciting, but it helped me establish a baseline for what I was dealing with. Now that I do not teach tech integration classes anymore, I have found my current survey needs to be updated as well. For one thing, I have started calling it a "questionnaire," which may just be a semantic issue, but it seems to capture what I am actually doing. The most notable change, however, is the questions themselves. Instead of getting descriptive data, I want the students to be introspective about themselves as learners. Based on a few studies I have read lately, I have learned that student evaluations of their professors are based more on their self-concepts as learners than on the efficacy and characteristics of the professor. For example, one study I looked at used a hierarchical regression analysis to investigate the relationship between students' academic self-efficacy and professor characteristics. The result of this study showed that students with high academic self-efficacy tended to give high ratings to professors with characteristics such as content expertise, professionalism, and disagreeableness (i.e., argues, challenges, steps on toes). On the other hand, students with low academic self-efficacy tended to give high ratings to such professor characteristics as compassion, helpfulness, and student-centeredness (though I personally find that trait to be problematic). The Social Exchange Theory is alive and well in the classroom.

In essence, the college classroom is no different than life in general: People evaluate others based on how they feel about themselves.

In response to this belief about my students, I want them to think a little more deeply about themselves as learners and unpack some of the jargon they tend to throw around. One example of psycho-babble jargon students tend to use is "engaged." For example, when I ask the question, "When do you learn best?" they will often respond by saying, "When I am engaged in my learning." My first response is, "Well, yeah, that's kind of how learning works. It's not a passive process." But I have really started to think more deeply about what students mean by "engaged." I always assumed engagement was a trait of the learner, as in, I am listening, taking notes, asking questions, participating in the discussion: I am in engaged.  Based on my experience in one class last semester, however, I suspect many students have a completely different vision for what "engaged" means. I now believe they see this as a trait of the instructor, as in, you are doing things in class that I deem worthy of my attention. The professor is engaging the students. It all comes down to locus of control. In a perfect world, both of these conceptualizations of "engaged" are true, and the professor is carefully thinking about how to present ideas in an organized and compelling way, while using strategies to draw the students into the process. At the same time, the students buy into this and are internally motivated to participate. Both parties fully understand their role in the process and take it seriously. Of course, I have no idea if any of this actually true, or if I just obsessed about it way too much and displaced a lot of my own insecurities onto the students.

This is why I am asking new questions. I want to know how my students evaluate themselves as learners, how they describe "engaged learning," and how they know if they have learned something or not. I am also including a question that asks them to rate themselves at multi-tasking. This item alone will probably explain 90% of the variance in test scores. In case you have never read my reflections on teaching college students, I believe multi-tasking is a horse apple dipped in a cow pie and sprinkled with bird droppings.

My purpose in asking these questions is two-fold. First, I want my students to honestly think about themselves as learners. I am not expecting light bulbs or fireworks, but I do want to push this issue to the forefront. Second, I want to know their (mis)conceptions about learning and teaching so I can address it. Once I know what they think about these important concepts, I can show them research that either confirms or refutes their beliefs. More importantly, it gives me the opportunity to make the class not just informational, but also transformational. Any time a person has the chance to reflect and say, "I used to think ..., but now I know ..." it opens the door to personal growth. Isn't that what all teachers hope to engender in their classrooms?

So, what strategies or activities do you use to learn about your students? How do you use that information? Is it valuable? Take a minute to let me know what you think.