Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

A Year of Spaced Repetition Software in the Classroom

96 Post author: tanagrabeast 04 July 2015 10:30PM

Last year, I asked LW for some advice about spaced repetition software (SRS) that might be useful to me as a high school teacher. With said advice came a request to write a follow-up after I had accumulated some experience using SRS in the classroom. This is my report.

Please note that this was not a scientific experiment to determine whether SRS "works." Prior studies are already pretty convincing on this point and I couldn't think of a practical way to run a control group or "blind" myself. What follows is more of an informal debriefing for how I used SRS during the 2014-15 school year, my insights for others who might want to try it, and how the experience is changing how I teach.

Summary

SRS can raise student achievement even with students who won't use the software on their own, and even with frequent disruptions to the study schedule. Gains are most apparent with the already high-performing students, but are also meaningful for the lowest students. Deliberate efforts are needed to get student buy-in, and getting the most out of SRS may require changes in course design.

The software

After looking into various programs, including the game-like Memrise, and even writing my own simple SRS, I ultimately went with Anki for its multi-platform availability, cloud sync, and ease-of-use. I also wanted a program that could act as an impromptu catch-all bin for the 2,000+ cards I would be producing on the fly throughout the year. (Memrise, in contrast, really needs clearly defined units packaged in advance).

The students

I teach 9th and 10th grade English at an above-average suburban American public high school in a below-average state. Mine are the lower "required level" students at a school with high enrollment in honors and Advanced Placement classes. Generally speaking, this means my students are mostly not self-motivated, are only very weakly motivated by grades, and will not do anything school-related outside of class no matter how much it would be in their interest to do so. There are, of course, plenty of exceptions, and my students span an extremely wide range of ability and apathy levels.

The procedure

First, what I did not do. I did not make Anki decks, assign them to my students to study independently, and then quiz them on the content. With honors classes I taught in previous years I think that might have worked, but I know my current students too well. Only about 10% of them would have done it, and the rest would have blamed me for their failing grades—with some justification, in my opinion.

Instead, we did Anki together, as a class, nearly every day.

As initial setup, I created a separate Anki profile for each class period. With a third-party add-on for Anki called Zoom, I enlarged the display font sizes to be clearly legible on the interactive whiteboard at the front of my room.

Nightly, I wrote up cards to reinforce new material and integrated them into the deck in time for the next day's classes. This averaged about 7 new cards per lesson period.These cards came in many varieties, but the three main types were:

  1. concepts and terms, often with reversed companion cards, sometimes supplemented with "what is this an example of" scenario cards.
  2. vocabulary, 3 cards per word: word/def, reverse, and fill-in-the-blank example sentence
  3. grammar, usually in the form of "What change(s), if any, does this sentence need?" Alternative cards had different permutations of the sentence.

Weekly, I updated the deck to the cloud for self-motivated students wishing to study on their own.

Daily, I led each class in an Anki review of new and due cards for an average of 8 minutes per study day, usually as our first activity, at a rate of about 3.5 cards per minute. As each card appeared on the interactive whiteboard, I would read it out loud while students willing to share the answer raised their hands. Depending on the card, I might offer additional time to think before calling on someone to answer. Depending on their answer, and my impressions of the class as a whole, I might elaborate or offer some reminders, mnemonics, etc. I would then quickly poll the class on how they felt about the card by having them show a color by way of a small piece of card-stock divided into green, red, yellow, and white quadrants. Based on my own judgment (informed only partly by the poll), I would choose and press a response button in Anki, determining when we should see that card again.

End-of-year summary for one of my classes

[Data shown is from one of my five classes. We didn't start using Anki until a couple weeks into the school year.]

Opportunity costs

8 minutes is a significant portion of a 55 minute class period, especially for a teacher like me who fills every one of those minutes. Something had to give. For me, I entirely cut some varieties of written vocab reinforcement, and reduced the time we spent playing the team-based vocab/term review game I wrote for our interactive whiteboards some years ago. To a lesser extent, I also cut back on some oral reading comprehension spot-checks that accompany my whole-class reading sessions. On balance, I think Anki was a much better way to spend the time, but it's complicated. Keep reading.

Whole-class SRS not ideal

Every student is different, and would get the most out of having a personal Anki profile determine when they should see each card. Also, most individuals could study many more cards per minute on their own than we averaged doing it together. (To be fair, a small handful of my students did use the software independently, judging from Ankiweb download stats)

Getting student buy-in

Before we started using SRS I tried to sell my students on it with a heartfelt, over-prepared 20 minute presentation on how it works and the superpowers to be gained from it. It might have been a waste of time. It might have changed someone's life. Hard to say.

As for the daily class review, I induced engagement partly through participation points that were part of the final semester grade, and which students knew I tracked closely. Raising a hand could earn a kind of bonus currency, but was never required—unlike looking up front and showing colors during polls, which I insisted on. When I thought students were just reflexively holding up the same color and zoning out, I would sometimes spot check them on the last card we did and penalize them if warranted.

But because I know my students are not strongly motivated by grades, I think the most important influence was my attitude. I made it a point to really turn up the charm during review and play the part of the engaging game show host. Positive feedback. Coaxing out the lurkers. Keeping that energy up. Being ready to kill and joke about bad cards. Reminding classes how awesome they did on tests and assignments because they knew their Anki stuff.

(This is a good time to point out that the average review time per class period stabilized at about 8 minutes because I tried to end reviews before student engagement tapered off too much, which typically started happening at around the 6-7 minute mark. Occasional short end-of-class reviews mostly account for the difference.)

I also got my students more on the Anki bandwagon by showing them how this was directly linked reduced note-taking requirements. If I could trust that they would remember something through Anki alone, why waste time waiting for them to write it down? They were unlikely to study from those notes anyway. And if they aren't looking down at their paper, they'll be paying more attention to me. I better come up with more cool things to tell them!

Making memories

Everything I had read about spaced repetition suggested it was a great reinforcement tool but not a good way to introduce new material. With that in mind, I tried hard to find or create memorable images, examples, mnemonics, and anecdotes that my Anki cards could become hooks for, and to get those cards into circulation as soon as possible. I even gave this method a mantra: "vivid memory, card ready".

When a student during review raised their hand, gave me a pained look, and said, "like that time when...." or "I can see that picture of..." as they struggled to remember, I knew I had done well. (And I would always wait a moment, because they would usually get it.)

Baby cards need immediate love

Unfortunately, if the card wasn't introduced quickly enough—within a day or two of the lesson—the entire memory often vanished and had to be recreated, killing the momentum of our review. This happened far too often—not because I didn't write the card soon enough (I stayed really on top of that), but because it didn't always come up for study soon enough. There were a few reasons for this:

  1. We often had too many due cards to get through in one session, and by default Anki puts new cards behind due ones.
  2. By default, Anki only introduces 20 new cards in one session (I soon uncapped this).
  3. Some cards were in categories that I gave lower priority to.

Two obvious cures for this problem:

  1. Make fewer cards. (I did get more selective as the year went on.)
  2. Have all cards prepped ahead of time and introduce new ones at the end of the class period they go with. (For practical reasons, not the least of which was the fact that I didn't always know what cards I was making until after the lesson, I did not do this. I might able to next year.)

Days off suck

SRS is meant to be used every day. When you take weekends off, you get a backlog of due cards. Not only do my students take every weekend and major holiday off (slackers), they have a few 1-2 week vacations built into the calendar. Coming back from a week's vacation means a 9-day backlog (due to the weekends bookending it). There's no good workaround for students that won't study on their own. The best I could do was run longer or multiple Anki sessions on return days to try catch up with the backlog. It wasn't enough. The "caught up" condition was not normal for most classes at most points during the year, but rather something to aspire to and occasionally applaud ourselves for reaching. Some cards spent weeks or months on the bottom of the stack. Memories died. Baby cards emerged stillborn. Learning was lost.

Needless to say, the last weeks of the school year also had a certain silliness to them. When the class will never see the card again, it doesn't matter whether I push the button that says 11 days or the one that says 8 months. (So I reduced polling and accelerated our cards/minute rate.)

Never before SRS did I fully appreciate the loss of learning that must happen every summer break.

Triage

I kept each course's master deck divided into a few large subdecks. This was initially for organizational reasons, but I eventually started using it as a prioritizing tool. This happened after a curse-worthy discovery: if you tell Anki to review a deck made from subdecks, due cards from subdecks higher up in the stack are shown before cards from decks listed below, no matter how overdue they might be. From that point, on days when we were backlogged (most days) I would specifically review the concept/terminology subdeck for the current semester before any other subdecks, as these were my highest priority.

On a couple of occasions, I also used Anki's study deck tools to create temporary decks of especially high-priority cards.

Seizing those moments

Veteran teachers start acquiring a sense of when it might be a good time to go off book and teach something that isn't in the unit, and maybe not even in the curriculum. Maybe it's teaching exactly the right word to describe a vivid situation you're reading about, or maybe it's advice on what to do in a certain type of emergency that nearly happened. As the year progressed, I found myself humoring my instincts more often because of a new confidence that I can turn an impressionable moment into a strong memory and lock it down with a new Anki card. I don't even care if it will ever be on a test. This insight has me questioning a great deal of what I thought knew about organizing a curriculum. And I like it.

A lifeline for low performers

An accidental discovery came from having written some cards that were, it was immediately obvious to me, much too easy. I was embarrassed to even be reading them out loud. Then I saw which hands were coming up.

In any class you'll get some small number of extremely low performers who never seem to be doing anything that we're doing, and, when confronted, deny that they have any ability whatsoever. Some of the hands I was seeing were attached to these students. And you better believe I called on them.

It turns out that easy cards are really important because they can give wins to students who desperately need them. Knowing a 6th grade level card in a 10th grade class is no great achievement, of course, but the action takes what had been negative morale and nudges it upward. And it can trend. I can build on it. A few of these students started making Anki the thing they did in class, even if they ignored everything else. I can confidently name one student I'm sure passed my class only because of Anki. Don't get me wrong—he just barely passed. Most cards remained over his head. Anki was no miracle cure here, but it gave him and I something to work with that we didn't have when he failed my class the year before.

A springboard for high achievers

It's not even fair. The lowest students got something important out of Anki, but the highest achievers drank it up and used it for rocket fuel. When people ask who's widening the achievement gap, I guess I get to raise my hand now.

I refuse to feel bad for this. Smart kids are badly underserved in American public schools thanks to policies that encourage staff to focus on that slice of students near (but not at) the bottom—the ones who might just barely be able to pass the state test, given enough attention.

Where my bright students might have been used to high Bs and low As on tests, they were now breaking my scales. You could see it in the multiple choice, but it was most obvious in their writing: they were skillfully working in terminology at an unprecedented rate, and making way more attempts to use new vocabulary—attempts that were, for the most part, successful.

Given the seemingly objective nature of Anki it might seem counterintuitive that the benefits would be more obvious in writing than in multiple choice, but it actually makes sense when I consider that even without SRS these students probably would have known the terms and the vocab well enough to get multiple choice questions right, but might have lacked the confidence to use them on their own initiative. Anki gave them that extra confidence.

A wash for the apathetic middle?

I'm confident that about a third of my students got very little out of our Anki review. They were either really good at faking involvement while they zoned out, or didn't even try to pretend and just took the hit to their participation grade day after day, no matter what I did or who I contacted.

These weren't even necessarily failing students—just the apathetic middle that's smart enough to remember some fraction of what they hear and regurgitate some fraction of that at the appropriate times. Review of any kind holds no interest for them. It's a rerun. They don't really know the material, but they tell themselves that they do, and they don't care if they're wrong.

On the one hand, these students are no worse off with Anki than they would have been with with the activities it replaced, and nobody cries when average kids get average grades. On the other hand, I'm not ok with this... but so far I don't like any of my ideas for what to do about it.

Putting up numbers: a case study

For unplanned reasons, I taught a unit at the start of a quarter that I didn't formally test them on until the end of said quarter. Historically, this would have been a disaster. In this case, it worked out well. For five weeks, Anki was the only ongoing exposure they were getting to that unit, but it proved to be enough. Because I had given the same test as a pre-test early in the unit, I have some numbers to back it up. The test was all multiple choice, with two sections: the first was on general terminology and concepts related to the unit. The second was a much harder reading comprehension section.

As expected, scores did not go up much on the reading comprehension section. Overall reading levels are very difficult to boost in the short term and I would not expect any one unit or quarter to make a significant difference. The average score there rose by 4 percentage points, from 48 to 52%.

Scores in the terminology and concept section were more encouraging. For material we had not covered until after the pre-test, the average score rose by 22 percentage points, from 53 to 75%. No surprise there either, though; it's hard to say how much credit we should give to SRS for that.

But there were also a number of questions about material we had already covered before the pretest. Being the earliest material, I might have expected some degradation in performance on the second test. Instead, the already strong average score in that section rose by an additional 3 percentage points, from 82 to 85%. (These numbers are less reliable because of the smaller number of questions, but they tell me Anki at least "locked in" the older knowledge, and may have strengthened it.)

Some other time, I might try reserving a section of content that I teach before the pre-test but don't make any Anki cards for. This would give me a way to compare Anki to an alternative review exercise.

What about formal standardized tests?

I don't know yet. The scores aren't back. I'll probably be shown some "value added" analysis numbers at some point that tell me whether my students beat expectations, but I don't know how much that will tell me. My students were consistently beating expectations before Anki, and the state gave an entirely different test this year because of legislative changes. I'll go back and revise this paragraph if I learn anything useful.

Those discussions...

If I'm trying to acquire a new skill, one of the first things I try to do is listen to skilled practitioners of that skill talk about it to each other. What are the terms-of-art? How do they use them? What does this tell me about how they see their craft? Their shorthand is a treasure trove of crystallized concepts; once I can use it the same way they do, I find I'm working at a level of abstraction much closer to theirs.

Similarly, I was hoping Anki could help make my students more fluent in the subject-specific lexicon that helps you score well in analytical essays. After introducing a new term and making the Anki card for it, I made extra efforts to use it conversationally. I used to shy away from that because so many students would have forgotten it immediately and tuned me out for not making any sense. Not this year. Once we'd seen the card, I used the term freely, with only the occasional reminder of what it meant. I started using multiple terms in the same sentence. I started talking about writing and analysis the way my fellow experts do, and so invited them into that world.

Even though I was already seeing written evidence that some of my high performers had assimilated the lexicon, the high quality discussions of these same students caught me off guard. You see, I usually dread whole-class discussions with non-honors classes because good comments are so rare that I end up dejectedly spouting all the insights I had hoped they could find. But by the end of the year, my students had stepped up.

I think what happened here was, as with the writing, as much a boost in confidence as a boost in fluency. Whatever it was, they got into some good discussions where they used the terminology and built on it to say smarter stuff.

Don't get me wrong. Most of my students never got to that point. But on average even small groups without smart kids had a noticeably higher level of discourse than I am used to hearing when I break up the class for smaller discussions.

Limitations

SRS is inherently weak when it comes to the abstract and complex. No card I've devised enables a student to develop a distinctive authorial voice, or write essay openings that reveal just enough to make the reader curious. Yes, you can make cards about strategies for this sort of thing, but these were consistently my worst cards—the overly difficult "leeches" that I eventually suspended from my decks.

A less obvious limitation of SRS is that students with a very strong grasp of a concept often fail to apply that knowledge in more authentic situations. For instance, they may know perfectly well the difference between "there", "their", and "they're", but never pause to think carefully about whether they're using the right one in a sentence. I am very open to suggestions about how I might train my students' autonomous "System 1" brains to have "interrupts" for that sort of thing... or even just a reflex to go back and check after finishing a draft.

Moving forward

I absolutely intend to continue using SRS in the classroom. Here's what I intend to do differently this coming school year:

  • Reduce the number of cards by about 20%, to maybe 850-950 for the year in a given course, mostly by reducing the number of variations on some overexposed concepts.
  • Be more willing to add extra Anki study sessions to stay better caught-up with the deck, even if this means my lesson content doesn't line up with class periods as neatly.
  • Be more willing to press the red button on cards we need to re-learn. I think I was too hesitant here because we were rarely caught up as it was.
  • Rework underperforming cards to be simpler and more fun.
  • Use more simple cloze deletion cards. I only had a few of these, but they worked better than I expected for structured idea sets like, "characteristics of a tragic hero".
  • Take a less linear and more opportunistic approach to introducing terms and concepts.
  • Allow for more impromptu discussions where we bring up older concepts in relevant situations and build on them.
  • Shape more of my lessons around the "vivid memory, card ready" philosophy.
  • Continue to reduce needless student note-taking.
  • Keep a close eye on 10th grade students who had me for 9th grade last year. I wonder how much they retained over the summer, and I can't wait to see what a second year of SRS will do for them.

Suggestions and comments very welcome!

Comments (25)

Comment author: gwern 05 July 2015 03:50:59PM 14 points [-]

I look forward to a post about how year 2 goes!

Also, have you considered trying to mesh SRS more with the various quizzes and tests you have to give? It seems like that's a nearly 'free' source of additional reviews (for each test/quiz, stick on a few bonus questions which are leeches/due that day).

Comment author: tanagrabeast 05 July 2015 05:45:10PM *  12 points [-]

I don't give nearly as many tests and quizzes as you might think, as they are costlier than commonly appreciated. Not only do I have to write them and score them, I have to dedicate precious, precious class time to them. Lots of class time, because we have to wait for everyone to finish, and in my classes some students will always take forever. More than that, even, because if I give anything that smells like formal assessment, I'm required to send students with accommodations to a special testing room where they can get extra help and time. So not only do I have to work out the logistics on that, some of my most needy students might be missing from my class for an extra day.

My testing minimalism raises some eyebrows. I get away with it because my students consistently beat expectations on the tests people care about the most.

You're absolutely right, though, about assessments acting as an additional review. I do give some regular "take-home quizzes" in the form of vocab/terminology matching sheets or crosswords just to have something to put in the grade book.

Also, that team-based review game we play on the interactive whiteboard has very high overlap with my Anki deck. This did help keep some vocab words that were languishing on the bottom of the Anki deck in circulation. Not every class has the same leeches and due cards on a given day, though, so it's not really practical to tweak the game that precisely.

By the way, gwern, let me thank you directly for your web page about spaced repetition. This experiment never would have happened without it. My "heartfelt presentation" is basically the CliffsNotes version of your research, and I attribute you at the end of it.

Comment author: gwern 05 July 2015 11:47:01PM 5 points [-]

I'm pleased to hear that. I've always felt that the classroom (or equivalents such as MOOCs) is ultimately where spaced repetition needs to happen the most. There's only so many gains from using it on one's own, in isolation.

Comment author: richard_reitz 05 July 2015 09:49:36AM *  9 points [-]

Before we started using SRS I tried to sell my students on it with a heartfelt, over-prepared 20 minute presentation on how it works and the superpowers to be gained from it. It might have been a waste of time. It might have changed someone's life. Hard to say.

I'm less skeptical. You say that you got a few students to use Anki which, while probably not life-changing, is probably significantly life-impacting. If my tenth grade English teacher had introduced Anki to me... well, right now, I'm reteaching myself introductory biology (5 on the AP exam), introductory chemistry (5 on the AP exam) and introductory psychology (A in the college course) because I forgot the content of each of these courses because I lacked Anki. I obviously don't know everything you do in your classroom, but it's entirely plausible that, rather than being a waste of time, introducing your students to Anki might have been (on average) the most impactful 20 minutes of teaching you did all year; you just may not see all the benefit in your classroom.

Comment author: tanagrabeast 05 July 2015 05:10:53PM 7 points [-]

If I were currently teaching honors students I would also be less skeptical. My district persistently pushes its honors and AP offerings in a way that leads to an evaporative cooling of work ethic in the lower classes. I think I only had a handful of students using Anki on their own because pretty much everyone with enough ambition to have been persuaded by me was in honors.

Not seeing the benefits of what I do in the classroom goes with the territory. I do plan to give the presentation again when we start back up in a few weeks.

Comment author: richard_reitz 05 July 2015 06:23:24PM 2 points [-]

In my high school career, I took precisely one non-honors/AP course when alternatives were present. Recalling my classmates... yeah, I'm now as skeptical as you are.

(I had successfully repressed those memories until now. Thanks so much for the reminder ;)

Any chance your success might influence your colleagues?

Comment author: tanagrabeast 05 July 2015 06:33:53PM 5 points [-]

There is talk of me giving some training on it, yes.

Teachers are so different from each other, though, and we easily become set in our ways. I'll count myself lucky for getting even a few to try it, and some of those may be doomed to fail because of their very different styles.

That said, the foreign language department, at least, should have a way easier time capitalizing on SRS than I did. I'll try to give them some extra attention.

Comment author: ChristianKl 05 July 2015 10:13:05AM 1 point [-]

When I was in school and I thought I needed a memorizing tool I was ignorant and went for Phase6. If a teacher would have recommended Anki to me, I would have used Anki.

Comment author: satt 05 July 2015 07:02:28PM 8 points [-]

There are already some comments complimenting this post, but I wanna amplify the choir and say I really like this post. It's a great write-up. You clearly thought about the most sensible way to try introducing SRS to your classroom (and hearing about how SRS works in a classroom is great, because that's more informative than hearing about how SRS works for an individual LW poster who's probably more motivated than schoolkids). You tracked which aspects of it worked well and which didn't, and adjusted what you did accordingly. And your write-up acknowledges the aspects that didn't work so well, rather than focusing exclusively on the aspects that did.

Comment author: Michelle_Z 06 July 2015 06:02:15PM 6 points [-]

I wish my high school teachers had done this.

A+

Comment author: Gunnar_Zarncke 05 July 2015 12:08:42AM 6 points [-]

Awesome. I will immediately forward this to some of my teacher friends. You definitely could have bragged about this in the bragging thread!

Comment author: bogus 05 July 2015 04:30:44PM 3 points [-]

SRS is meant to be used every day. When you take weekends off, you get a backlog of due cards.

Actually, I think what SRS does (at least Anki) in such cases is quite smart, if not quite optimal. Yes, it nudges you to clear the backlog ASAP, lest you forget those marginal items entirely. But then if you do recall an item despite the delay, it gives you improved credit for that memory, so you'll be seeing it less frequently. So, all things considered, you can ignore the nudge after some point, with very limited side effects.

Also, the reason you get a backlog in the first place (with no introduction of new items) is that Anki implicitly seeks to implement something close to a mastery-learning strategy. You don't "learn" something only to put it away after some test and let things fade away from your memory - you're supposed to remember everything you've ever put in the deck. I'm not sure how appropriate this is in a language-learning context, since after all there's no such thing as a "complete" vocabulary. But it's definitely good for more formal, rigorous subjects, where forgetting something can spell disaster.

Comment author: tanagrabeast 05 July 2015 06:22:55PM 3 points [-]

I don't disagree with any of this. Overall, Anki is very smart about how it prioritizes. The only behavior I really question is the one I highlighted in my "Triage" section:

if you tell Anki to review a deck made from subdecks, due cards from subdecks higher up in the stack are shown before cards from decks listed below, no matter how overdue they might be.

Comment author: John_Maxwell_IV 05 July 2015 01:08:10PM 3 points [-]

Great post!

Never before SRS did I fully appreciate the loss of learning that must happen every summer break.

FYI, I remember reading that this loss of learning actually levels off some 3 weeks in to the summer or so, but I can't remember the source. (If this is true, you can imagine that year-round school, where the summer break is split in to several 4-week segments throughout the year, would be a terrible idea.)

Unrelated question for you, since you're a high school teacher. Based on my limited reading about the US education system, I perceive a downward spiral that goes as follows:

  1. Being a teacher is a thankless job: the pay is mediocre, the hours are long, the students disruptive and ungrateful, etc.

  2. Because of this, people are reluctant to become teachers and the occupation tends to attract folks who lack better options.

  3. Because of this, some teachers aren't very good, and students and parents learn this.

  4. These low-quality teachers lead to the prestige of the occupation going down. As teachers lose respect, the job becomes more thankless, reinforcing (1).

According to this theory, Teach for America helps by making teaching in to a high-prestige occupation that you'll want to put on your resume.

Do you have thoughts? Does this seem accurate?

Also, I'm gonna be obnoxious and ask you what you think of Paul Graham's essay on English classes since you're an English teacher.

Comment author: tanagrabeast 05 July 2015 06:12:29PM 6 points [-]

Because of this, people are reluctant to become teachers and the occupation tends to attract folks who lack better options.

It has not been my experience that people go into teaching because they lack better options. You're right that it's a hard job and the pay isn't commensurate. This means, though, that there are almost always "better options".

People go into teaching because they like to teach. Some want to feel like they're making a difference. Some like the challenge of it. It's complicated. Yes, many regret the decision and then feel trapped in education. But they usually make it out eventually.

What I will say, though, is that our country doesn't get nearly enough of its very smartest to think seriously about teaching kids, especially if the subject they could teach is one that's easy to get an exciting and high-paying job doing instead.

According to this theory, Teach for America helps by making teaching in to a high-prestige occupation that you'll want to put on your resume.

In my experience, American teachers generally do enjoy a certain amount of prestige with a wide cross-section of the population. But it's mostly a kind of "moral" prestige that comes from that combination of low pay and difficult conditions. Many people see teachers the same way they see charity workers. This perversely helps keep salaries low, I think, because there's a sense that teachers shouldn't be in it for the money.

Teachers have an appreciation day, you know. Of course, I have a stand-up comedy bit about how you know you're getting shafted if there's an appreciation day in your honor...

Also, I'm gonna be obnoxious and ask you what you think of Paul Graham's essay on English classes since you're an English teacher.

I love Paul Graham's writing, and that essay in particular. But he's operating several meta levels higher than my student writers, and at least one level higher than me. I might get two or three students a year who need to stop worrying so much about structure and follow their guts more. The rest just need to master the traditional 5-paragraph essay so they can pass the state test and survive the rest of high school.

Comment author: ChristianKl 05 July 2015 07:17:31AM 3 points [-]

(To be fair, a small handful of my students did use the software independently, judging from Ankiweb download stats)

How about asking them for that information? It would give you the information. It would show them that you care about them using it.

Comment author: tanagrabeast 05 July 2015 05:03:08PM *  15 points [-]

That's a fair question with a surprisingly complicated answer.

Before I get to it, let me explain that I had a weekly ritual for reminding them about the potential for personal Anki use and the value I placed on it. Every Monday morning started with a written reminder on the board and an oral reminder from me that the class deck had been updated, uploaded, and was now ready for them to download. I invited them to pull out their phones and download the latest deck at that time, and gave them a couple of minutes to do it. Depending on the season, I would also remind them that "Anki is school EZ MODE", and "Anki is our study guide" for the mid-term, final, etc.

Of course, way more phones came out than were ever downloading my deck, but I felt the cost was acceptable.

This brings up another limitation of Anki: the fact that it costs 25$ on iOS. From a survey I gave the year before, I know that more than half of my students use iPhones. I made sure they knew they could be using it for free on their desktops, linking their desktop profiles to Ankiweb, and studying for free from their phone's web browser... but that smells like effort. Effort AND cost? They rejected it out of principle, offended by the suggestion.

Anyway, I didn't directly poll my students because I felt like I already knew the answer from the downloads and didn't feel it was worth the risk of lowering the prestige of Anki further. You see, by about 6 weeks in there were maybe 1 or 2 students per class still downloading. If I asked the class to "raise your hand if you're using Anki on your own" those 1 or 2 people would have felt like losers, and maybe not even raised their hands. The same effect would have been only moderately reduced with a written survey, because the first thing students do after a survey is ask their peers what they wrote. Either way, they would have gotten the impression that "nobody is using Anki on their own". You know how studies show that teens think their peers are having way more sex than they really are? I chose to let my students think their peers were getting way more Anki. Never underestimate the power of social proof on teenagers.

Another fun dilemma: It occurred to me that whole-class Anki use was probably cannibalizing personal Anki use. I suspect that many of the ~25 people who downloaded my deck during the first two weeks soon stopped because it felt redundant. I was left to choose between two scenarios:

Scenario 1: We use Anki together in class, and about 110 of my ~180 students get something out of it, but only 3 people get the most of it by using it on their own.

Scenario 2: We don't use Anki in class. 25 students (optimistically) get the most out of Anki. Nobody else gets anything from it.

Even if I felt like total learning was higher in Scenario 2, I'm strongly incentivized to choose option 1. I know who those 25 students would be. They were destined to pass the state test and get As in my class with or without Anki.

Guess which scenario looks better on my annual performance review?

Comment author: ChristianKl 05 July 2015 08:54:35PM 2 points [-]

That's a great answer :)

Comment author: RomeoStevens 05 July 2015 02:34:58AM 3 points [-]

This is a great post and has inspired me to make an Anki deck for concepts that i want to be more cognitively available, motivation hacks, useful conceptual tools that i know of but don't yet use often, etc.

Comment author: rathereasy 05 July 2015 06:48:37PM 2 points [-]

Amazing experiment! I'm a software developer with a passion for writing educational software to help teachers like yourself. I have a masters in computer science and I've worked at Google. I'm looking for passionate teachers to collaborate with to improve the student learning experience through technology. Maybe we can work together to build something that can better suit the needs of teachers. If this sounds like something you'd be into, send me a message: jacqueslenormand @ _ AT _ @ gmail.com

Comment author: Siyan 27 August 2015 09:15:23PM 1 point [-]

Hi!

Not sure if this idea will be helpful or not, but I teach languages, and so I review vocab a lot. I use mini whiteboards in class, and this means that everybody has to write down what they think the answer is, turn it around, and show it to me. I generally play this as a game, i.e. the whole team must have the same answer to get a point (or to get a move on whatever game you're playing), this encourages all students to participate which might help motivate that reluctant middle section. :)

Comment author: tanagrabeast 28 August 2015 04:03:59AM 1 point [-]

I spent the better part of a year teaching Spanish as a long-term sub for teachers on maternity leave, and made extensive use of their mini whiteboards. I loved them. They forced everyone to engage, and gave me a clear picture of which misconceptions needed correction.

When it comes to mini whiteboards, though, I found that there's a sweet spot for the length and complexity of responses. Anything too short or simple doesn't justify the time it takes to wait for everyone to write it on their boards. Anything too long and it doesn't fit on the boards and/or can't be easily read by me.

Spanish, with what, to Americans, feels like backwards syntax and weirdly complex conjugation, routinely fell into that sweet spot, where a phrase or short sentence conveyed a great deal.

English hardly ever seems to hit that same spot. Occasionally, if we're covering conventions/grammar issues, perhaps, but not often enough, so here's what I've been doing more of for that type of lesson:

After going over each concept, we do multiple choice slides. Students select their answers with those same 4-colored cards they use during Anki time. I have them get their colors ready but not hold them up until I say so. This is very fast, easy to read at a glance, and still lets me identify areas that need clarification. The trick is to produce really good multiple choice options that will help tease out these problem spots.

If I were teaching foreign language right now I'm sure I would still be using the mini boards. I would also be trying very hard to get my students to use Duolingo, the gamified language-learning SRS that Spanish teachers and their students keep raving about to me.

Comment author: [deleted] 09 July 2015 02:36:20PM 1 point [-]

You really should post it to Main!

Comment author: [deleted] 05 July 2015 04:12:50PM 1 point [-]

Lucky people! Our lessons lasted 45 min each. It doesn't seem to allow for Anki use.

Comment author: [deleted] 28 August 2015 07:13:47AM 0 points [-]

I think you might want to try Cerego -- it's an srs program built specifically for use by teachers.