Starpoint School Coffee Hour: Technology Boundaries during COVID-19

I had the opportunity to speak to the parents and teachers at Starpoint School at TCU about strategies for creating boundaries around technology while kids are doing school from home during COVID-19. Every parent I know has expressed frustration with the drastic increase in screen time their kids are getting due to online school and more free time than usual. I talked to them about establishing rules, putting filters on the home network, and putting restrictions on individual devices.

Gamification: A semester in the trenches

My reasons for wanting to use gamification strategies in my large Intro to Education course were obvious: student accountability, timely and continuous feedback, and better motivation to do otherwise rudimentary activities. I learned pretty quickly that implementing gamification strategies was more difficult than I initially thought. First, I had to figure out the instructional design aspects of gamification. How many points are different experiences worth? What do I count and what do I leave out? Second, I had to figure out how to keep track of all of this and communicate it back to the students. As I have written about before, I used Google Sheets to do this.

Overall, I would say I am pleased with how my first attempt at gamification turned out. Was it perfect? No way. Did the students like it? Mostly, but I'm sure I will hear from those who didn't on my course evaluations. Did these strategies help me reach my course goals? Absolutely! Class attendance was the best it has ever been in the 3 years I've taught the course. I regularly had over 90% of the students completing the weekly readings every week. That is unbelievable! I actually had students competing to complete extra credit so they could move to the top of the leaderboard. I did not see that one coming. Even though the course outcomes associated with these gamification strategies were successful, I learned a lot about how to do it better next semester. I will discuss these lessons in more detail.

More Competition

One of my goals in using gamification strategies in my class was to increase engagement and not give students a laundry list of things to do every week. Well, the way I structured the points, it turned out to be just what I was trying to avoid. Every week the students had to complete a module (video and/or reading + short quiz) before class on Monday. Then they went to schools on Wednesday, and there were points associated with that. On Friday, they participated in small group discussion, which had even more points. Everything was recorded on a big spreadsheet, and students were ranked on a leaderboard. What I discovered was that most of the students completed all of the requirements each week. Basically, there was no way to really move UP the leaderboard. Students could only move DOWN if they failed to complete a requirement. Believe it or not, that is not very competitive, and therefore, isn't all that much fun.

There were minimal opportunities for students to do extra and move up the leaderboard, but they were in fact so minimal that it hardly made a difference. This didn't keep the students from trying to get more points here and there, which was my first clue that there needs to be more competition. Some ideas I am playing with include:

  • Using Kahoot for discussion questions
  • Students voting for "best" responses to questions
  • Competitions between discussion groups (attendance, challenges, completion rate, etc.)
  • Challenges during class

I do not want to overdo this, but I think a little more competition would make this aspect of the class a lot more fun.

Reboot

Another flaw in my approach this semester was that the "game" lasted all semester. I gave the students monthly feedback in the form of a points sheet, which led many of them to just see it as a big assignment. I would venture to guess that they viewed this experiment as a big ole' laundry list because I treated it like one. In the end, there was no way for students who had gotten behind early in the semester to make corrections and do better the next time around. Students could recognize the impact of their choices on their point total and start to do better, but it did not erase early mistakes. This goes against the nature of most competitive endeavors, where players can overcome early mistakes later in the competition and keep themselves in the game.

I am thinking about splitting the game up into three smaller games this spring, and starting the points and leaderboard over each time. This will allow students who get off to a bad start to do better the next time. I can still keep track of completed assignments and attendance for the purposes of grading, but I will link other incentives to the leaderboard. What are the incentives? I have no idea, but I have a few weeks to think about it.

Better Feedback

Another issue I ran into this semester was getting feedback to the students on a weekly basis. I did pretty well at first, then some of my TAs got behind on entering scores and I went a few weeks without sending updates to the class. Once everything was updated and I got around to sending the updates, some of the students were like, "Whoa! How did I lose all these points?! I thought I was doing OK!" And I was like, "How can you not know if you missed class or an assignment?!" And they were like, "Hey man, we're too busy to remember all that!" And I was like ... OK, you get the point.

This observation has less to do with the game itself and more to do with giving more timely, detailed feedback. Some of the students felt like they were in the dark all semester and did not know they had missed 6, 7, or 8 classes until the end of the semester. I was never the kind of student to miss class, but I can see how it might be easy to lose track over such a long period of time.

I have a plan for keeping the spreadsheet updated better, but it is not really worth writing about here. Needless to say, I think weekly updates will help quell some of the panicky e-mails at the end of the semester.

What am I missing?

I am pretty sure my second attempt at gamification will go much better than the first, and I'm looking forward to putting some of these ideas into practice. For those of you who have been doing this for awhile, what are your suggestions? Am I missing something obvious? Am I making assumptions with potentially disastrous consequences? I would love to hear from the true game masters!

Schoolification

Pac-Man (1980), will go on show at MoMA in New York in 2013 I have been thinking about gamification a lot lately. I teach a really big class full of energetic undergraduates, and I want to make the class better. It is already pretty darn good, but there is always room for improvement. One way to do this is to add game elements to some of the more mundane aspects of the course.

As an aspiring Teaching and Learning scholar, I dug into the literature on gamification and game-based learning (and trust me, there is A LOT of it!) to investigate possible frameworks and suggestions for a successful implementation of game-based learning. One framework that has been really helpful for me as I plan some game-based elements into my course was proposed by Bunchball, a corporate gamification company. As stated in one of their white papers, there are 6 elements that serve as the building blocks to all successful games. Coincidentally, these game elements interact with game dynamics that are associated with basic human desires that tend to motivate and engage people within a gaming experience.

[table id=1 /]

When I look at this table, I see many similarities and natural applications to education. The way the education system is currently structured, there is already a pretty heavy dose of competition, achievement, reward, and status. There is also some possibility for self-expression and altruism, depending on the way a course is set up. So, I understand that education and gamification go hand-in-hand quite naturally.

So what happens when an instructor takes activities that students might naturally enjoy and make them just another assignment? I call this "schoolification," which is when a teacher deflates student interest in an activity or project by assigning points, a grade, or any other requirement that students might otherwise resist.

The first time I encountered schoolification, before I even had a name for it, was in a conference presentation where a professor described his use of Facebook in his classes. Each student in the class had to join his group on FB, they were required to comment on his posts, and they would "lose points" if they didn't do either of those things. My first thought was, wow, that's a great way to make students hate Facebook. Take something they like, make them use it in a way they don't want, then hold their grade over their head of they don't do it.

If the instructor is not careful, I think the same thing can happen with blogs, digital stories, flipped lessons, and cooperative learning (or any other activity for that matter). Students have to be held accountable for their professionalism, but how do we do this without schoolifying activities they might otherwise enjoy? This is a challenge I would like to learn more about.

How do you hold students accountable for their participation in class activities without schoolifying those activities that are intended to be engaging and fun.

Gradenomics

It's that time of year again, when I spend a lot of time reflecting on the semester and academic year. I have already posted once about this, and I have at least two more ideas incubating in my mind. The idea that came to me today as I graded final exams, calculated final averages, and entered final grades into "the system" is that universities - or perhaps my university - put a lot of emphasis on finals. This led me to consider whether or not there TOO much emphasis on final exams. As it is now, we set aside an entire week, shuffle the schedule, and give each professor 2.5 hours to administer the exam. Yet, I have not given a comprehensive final since my 2nd year of teaching higher education. Is this really worthy of its own week?

My first college teaching assignment was as a Master's student, and I taught public speaking. It was a massive faculty-directed, TA-taught course where they basically told us what to do. We had some freedom to teach any way we wanted, but we had to give the same assignments and grade using the same rubric. If our overall GPA was too high, we got a personal note from the course director telling us to grade harder. We also had to give a comprehensive final, which seemed totally ridiculous for a public speaking class.

Since those days, I have jockeyed between giving a final project (portfolio, paper, etc.) and giving the last test during the final time slot. My current university is adamant about professors doing something during finals week, so I have been using that time to give the last exam. I have also used this time to have students present their final projects, but it just seems contrived to me and seems to always fall a little flat. Some of the more adventurous faculty have the students bring food and they have a party.

My point is, there is a certain amount of hype associated with finals that I am starting to think is unnecessary. Whereas my students typically cram for the first two exams, they spend days and days studying for the last exam. And what is the payoff? Actually, the course average was lower than the second exam even though the exams were about at the same level of difficulty. I have exams weighted so that each test accounts for about 13% of the final grade. I did this a few semesters ago because I wanted the exams to mean something. Before I weighted the exam scores, a student could do poorly on exams and still eek out a decent grade by getting some of the "sit-and-get" grades, such as attendance or participation. Basically, taking the exam counted the same toward the course average as showing up to lecture and surfing Pinterest for an hour. So, what does this mean in terms of the last exam's impact on the overall grade? Here are some points to consider (remember, this is based on a scale where each exam contributes 13%, or 39% total, toward the overall grade):

  • 35 out of 53 students got a score on the final within 2 percentage points of their current average. Mathematically, this had absolutely no impact on the final grade. For example, if a student was sitting at 91.21% and got a 93% on the final, the overall average was raised to 91.55% (I'm making these numbers up, of course, but they are pretty accurate to what I observed). Unless a student was a fraction of a percentage point from the next grade, this had no impact. It was just damage control.
  • If a student scored 10 percentage points higher or lower on the final than the overall average, it meant a difference of 1 percentage point either way. In fact, this held true for every 10 percentage point differential. For example, getting a 75% on the test would lower the average from 85 to 84. That also means that getting a 100% on the test would only raise the average from a 85 to 87 (and that is a generous estimate). This is the difference between a B and B+, which is hardly the Hail Mary the students think it is.
  •  9 out of 53 students went down one grade based on their final exam score, and each of them was 1 point or less from the borderline. That is, they went from a B+ to a B, but they started at  87.1% not 89.9%.
  • Only one student went UP a grade based on the final exam score, and the starting average was already less than a percentage point from the cutoff.

Are you confused yet?

I am not advocating students completely blowing off a final because it won't make a difference in the long run. Students should always give their best effort no matter what. I also know that students spend just about as much time eating junk food and complaining about their professors during "dead days" as they do studying. I am just wondering if we should put so much emphasis on that one week when it's really the students' body of work throughout the semester that compiles their course average.

I am curious to know how others handle finals, and if they have more (or less) of an impact in your courses than what I have described? How are finals handled in other disciplines? Should they be more high-stakes, or are they just hype?

Dealing with Disappointment

I have been teaching for nearly 20 years, and I have seen just about everything. Throughout the many life changes I have experienced in that time, teaching, oddly enough, has been one of the constants in my life. Early in my career I would stay late at school and come home to an empty apartment. Soon enough, I was finding ways to have lunch with my wife over our short lunch breaks. Then I was rushing home after teaching so I could spend time with my babies. Now I have to be creative in order to balance my teaching with things like baseball, gymnastics, theater classes, church, committees, writing, and staying connected to family. During all this time, students have come and gone from my classes, hopefully taking something with them that will help in their life journey.

Teaching requires a lot of creativity and problem solving because no matter what is happening in your life, you have to try to do your best for the students. In my career I have had to deal with crazy parents, over-scheduled meetings which force me to plan my lessons late into the night, hectic travel schedules for the sports I coached, sleepless nights, unexpected family crises, unpredictable weather, and disruptions to the school day. All in all, I would say I have done a pretty good job of paddling and finding the current. There is, however, one aspect of teaching with which I have not dealt very well.

Disappointment.

Maybe it's because I expect myself to be perfect. Or amazing. Or brilliant. Perhaps I spend too much time comparing myself to my peers and wanting to be the big fish in the pond. I already know I put too much stock in my course evaluations and Rate My Professor and any other metric I can find to evaluate my worth as a teacher, so maybe that feeds my disappointment. It could be that my expectations are too high, and while I perceive the response to a good class to be a standing ovation, my students are just anxious to meet their friends for lunch. No matter what the cause - and it's probably a complex mix of those factors I already listed, along with some I haven't identified - disappointment has always been a tough pill to swallow.

For the better part of this semester, I have been dealing with disappointment: in myself, in my students, in the fact that I didn't foresee some of the problems with one of the classes I have been teaching. Since the third week of the semester, things took a downward turn and despite my attempts to make the class better it has not been enough to make it a positive experience for anyone involved. Like I said, very disappointing.

It would be easy to wrap myself in self-pity, curl up in bed, close my eyes, and just wait for the semester to end. Trust me, I have considered that many times, and perhaps in small ways I have done some of that. However, as the self-reflective navel-gazer that I am, the ultimate question is this: What do I plan on doing about it? Other than venting to a few colleagues, which I have done more than I care to admit, I can't help but abstract some lessons from my disappointing semester.

Disappointment reminds me that I care.

If teaching and teaching future teachers about teaching was not a big deal to me, this would be easy to shrug off. Blame the students and move on. But this does matter to me and I understand the importance of what I am doing. No one is guaranteed that living out their passions or purpose or calling will be without setbacks. The setbacks actually remind us how closely our calling, purpose, and passion are woven in with our very being.

Disappointment reveals areas to get better.

Do you know which of my classes have historically gone the worst for me? Those which follow a class which has gone really well. If I think I have reached superstar status, where is the incentive to do things better, to be self-reflective, or try new ideas? There is no such thing as cruise control in teaching, and just because a certain approach or teaching style worked with one class does not mean it will work the next time. As long as I am teaching, there will be aspects of my practice that need to be revised, refined, or removed. It's hard to see those things when I am blinded by my own awesomeness.

Disappointment reinforces what is constant.

Even though I have to adapt every class based on the unique dynamics created by the students and circumstances, there are some elements of instructional practice that should never be compromised. High (yet reasonable) expectations. Timely feedback. Positive teacher to student relationships. Close monitoring of student engagement. Consistency. Fairness. Preparation. These make up the foundation of a healthy, vibrant class. I may be stuck with a class full of disengaged, apathetic, know-it-all students (speaking in general terms, of course ... not any particular class), but that should not change those core elements of effective teaching. If anything, the tougher the students, the more I should lean into those aspects of teaching that have been proven over time. Don't play off your students' responses because chances are they stayed up too late, woke up minutes before class, and put off their assignment until the last minute. As a baseline, my teaching must be one of the constants in their lives.

Honestly, I am thankful things did not go as well as I had hoped this semester (in one class at least ... the others went great). I have a lot to learn, a lot to improve, and a long way to go. Adversity causes everyone to either wilt or get stronger, and I choose the latter. The day I think otherwise about my teaching is probably a sign it's time to choose a new career. Thank you, disappointment, for the not-so-gentle reminder.

All In: The New LMS

Today I attended a presentation sponsored by Apple about the changing role of mobile technologies in higher education, particularly colleges of education. This is of particular importance to my college right now because we are beginning to talk a lot about how and why to use different types of technology in our courses. Many faculty have been using technology for many years in their courses, but we are starting to see a shift in the role of technology in terms of how students access and use information. The presentation today, given by John Landis, Ph.D., was very much in line with the conversations I have been having with some of my colleagues over the past few months.

I will be honest, Dr. Landis' presentation was impressive. He is a great storyteller and is current on the trends and predictions sweeping through both K-12 and higher education. He understands that technology has traditionally been used to help teachers do what they've always done more efficiently or faster. He knows that students these days can get the same content traditionally transmitted from the instructor on any device, anywhere, at any time. And it's usually a lot more interesting. None of this was new to me, but it was still delivered in a fresh and relevant way. Landis presented a blend of theories, examples, and demos, primarily from his MacBook and iPad Mini, and the technology worked like a champ. He mirrored his iPad display using an Apple TV, and could switch pretty quickly to his MacBook Air to demo other programs. As a pretty heavy tech user, I was impressed that he was able to change speeds in so many different ways without so much as a hiccup.

What this presentation made very clear to me, however, was something I have been mulling over for quite some time. It is this idea that in order to fully leverage the benefits of one device, you must fully employ all of the devices in that particular ecosystem. In this way, Apple is actually becoming a device-based LMS. Just like Blackboard or Moodle have a suite of tools under the hood, Apple has an array of powerful tools that can really change the way teachers and students approach learning. The catch, however, is that one must buy in to the whole ecosystem in order to really see these benefits. For example:

  • I can create a customized, multimedia iBook on my MacBook for free, but it only really handles Mac-based media (.mov, Keynote, Pages, etc.).
  • Only my students with an iPad can download the multimedia version of the book and get the full benefit. Students running Mavericks can also read the book on their Mac, but students with Android or Windows devices are left behind.
  • I can mirror my iPad to my MacBook using AirServer, but it's not stable and does not work over my schools WiFi. If I want to really mirror my iPad, I need an Apple TV.
  • I can sync content across devices with a variety of tools, but the only way to sync ALL of my content is with iCloud, which is only for Mac.

The point is, each tool Dr. Landis showed us does amazing things. I want to try everything he showed us (except for the stuff I am already doing ... I want to keep doing it). But the only way to leverage the capabilities of each tool is to use it as part of the Apple Ecosystem (a term he used repeatedly). Apples are meant to work with other Apples, and there is really no motivation to make them work with Android (Google) or Windows. My workarounds, as I have found, are much more complex than the typical tech-using teacher is willing to mess with. I have found a way to teach from my iPad without using AirServer, which is a pretty awful replacement for an Apple TV. I use Google Docs to host and share course files, which works pretty well most of the time, but it's not as slick as content aggregated in an iBook. I have founds ways to do the things I want to do, but it's always a little more work when I am doing this across devices and outside "the ecosystem."

My take-away message is that Apple, Google, and Windows really are trying to create a system, and already have, where users must be "all in" in order to reap the benefits of their technology. More than ever, their tools only really play well with their own family members, and it is becoming increasingly difficult to lead a balanced digital life across platforms. With the exception of a few apps like Evernote or Google Drive, content on your device stays on your device.

I have no idea which ecosystem TCU will join, but I think they will eventually need to decide. These companies, which control the market, are leaving us very little choice otherwise.