cicatriz comments on Who Wants To Start An Important Startup? - LessWrong

41 Post author: ShannonFriedman 16 August 2012 08:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (407)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 17 August 2012 07:44:48AM 7 points [-]

Related idea: semi-computerized instruction.

To the best of my (limited) knowledge, while there are currently various computerized exercises available, they aren't that good at offering instruction of the "I don't understand why this step works" kind, and are often pretty limited (e.g. Khan Academy has exercises which are just multiple choice questions, which isn't a very good bad format). One could try to offer a more sophisticated system - first, present experienced teachers/tutors with a collection of the problems you'll be giving to the students, and ask them to list the most common problems and misunderstandings that the students tend to have with such problems. Then attempt to build a system which will recognize the symptoms of the most common misunderstandings and attempt to provide advice on them, also offering the student the opportunity to ask it themselves using some menu system or natural language parser. (I know some existing academic work along these lines exists, I think applying Bayes nets to build up a model of the students' skills and understanding, but I couldn't find the reference in the place where I thought that I had read it.)

Of course, there will frequently be situations where your existing database fails to understand the student's need. So you combine this with the chance to ask help online, either on a forum with other students, or one-on-one with a paid tutor in an interactive chat session. As the students' problems are resolved, the maintainers follow the conversations and figure out a way for the system to recognize the new problems in the future, either automatically or via the "ask a question" menus.

In particular, the system would be built so that having e.g. forgotten some of the prerequisites in a previous course wouldn't be a problem - if that happened, the system would just automatically lead you to partially rehearse those concepts enough that you could apply them to solve the current problem. At the same time, it could be designed that all of the previous knowledge was being constantly drawn upon, thus providing a natural method for spaced repetition.

This method is naturally most suited for math-like subjects with clear right/wrong answers. But if one wanted to get really ambitious, they could eventually expand the system so as to create a single unified school course that taught everything that's usually taught in high school, abandoning the artificial limits between subjects. E.g. a lesson during which you traveled back in time to witness an important battle (history), helped calculate the cannon ball trajectories for one of the sides (physics), stopped to study a wounded soldier and the effects of the wounds on his body (human biology), and then finally helped the army band play the victory song (music)... or something along those lines. Ideally, there'd be little difference between taking a school lesson and playing a good computer game.

Comment author: cicatriz 17 August 2012 04:19:03PM 4 points [-]

There is an academic field around this called intelligent tutoring systems (http://en.wikipedia.org/wiki/Intelligent_tutoring_system). The biggest company with an ITS, as far as I know, is Carnegie Learning, which provides entire K-12 curricula for it: books, teacher training, software. CL has had mixed evaluations in the past, but I think a fair conclusion at this point is that ITS significantly improves learning outcomes when implemented in an environment where they are able to use software as it's intended to be used (follow the training, spend enough time, etc).

As far as I know there isn't anything quite like this in a widely deployed online system with community discussion as you suggest. Grockit (http://grockit.com) is a social test prep site that is familiar with the ITS community and uses some principles. Khan Academy is continuing to improve, but I can't say whether they will reach the state of the art as far as intelligent tutors go. I'd say there's definitely an opportunity for more ITS in online learning now, but it isn't easy to build.

The Wikipedia article is OK. One example of a recent paper is http://users.wpi.edu/~zpardos/papers/zpardos-its-final22.pdf which also shows some of the human work that goes into modeling the knowledge domain for an ITS.