Learning project: introduction

Past & Prologue

So, one of the great projects that have been rattling around in my head for some time has recently come back into the front burner of my brain again: computer-assisted learning. Jess has more or less been constantly thinking of this for the last decade+, from a rather different viewpoint — the writing of documentation and tutorials, especially around DBIx::Class and Catalyst. I think my current ideas are worthy of implementation, and I think that without building an active community around them, the project will falter, and that’d be a shame. So, enough of the past / prologue for the moment…

Synopsis

The basic idea goes like this: first, ask questions to determine what the student does and does not know.
Then, point them at something to read or watch, which requires only things that they do know, and will teach them things that they do not know. Now, since that basic idea is a bit … vague, a more detailed, and less formal English sketch of the system will follow.

Sketch

1: Knowledges. Knowledges are things like “conjugation of Latin verbs”, “how to spell conjugation”, “SQL data definition language”, “sines that you should remember while doing trig”. Rather specific things that a reasonable human can learn in 15 minutes, if they understand the other knowledges that it is based on.

2: Questions. Questions are how we assess knowledges. Each question has, in addition to the obvious, a set of knowledges that it is related to, with strengths. When a student gets a paticular question right, we are more confident of their knowledge in each of the related categories. Contrarywise, if a student gets a question wrong, we are more confident in their lack of knowledge. That is, for each student and each knowledge, we track not just a score, but a confidence interval. Somewhat sadly, for reasons of ease of implementation, we will likely start with multiple-choice questions, though I’d ideally like to have some system which would allow for more free-form answers, be less subject to luck, and to confirm-rather-then-determine behavior.

3: Tutorials. These are, from one point of view, the entire point of the system. Each tutorial has a set of prerequisites, and a set of knowledges it is expected to improve. The actual content, I think, wouldn’t be a part of this site, but rather a link to it. That allows the easy use of existing content, a variety of forms of content (interactive applets, youtube videos, blog entries, blocks of text, etc), and allows the content authors to use whatever tools they like to create their content.

4: Students. From another point of view, these are the entire point of the system — it’d be a bit useless without users. As, I suppose, is true with any such description, students are well-described above. We track their score in each knolwedge, along with a confidence interval. Once we’re confident that they meet the prerequisites, we start showing them some tutorials that we believe may fill in holes in their knowledges.

Solicitiation

Now, what I want from you guys… First, holes. Poke holes in my design above. What are we forgetting about?
Secondly, hope. Tell me you’d like to use such a system, tell me you’d like to translate it, to write content for it, to create bug reports, and to fix them, to style and make it look pretty… Thirdly, content. This should probably wait a bit, but it’s always good to get a good feel for the concrete when you are still working on the abstract layers. Fourthly, algorithms. What’s the best way to create a level and confidence interval off of a series of questions like this. Can we dynamically tweak question difficulties and/or tutorial parameters based upon results? How should we determine what question is best to ask next?

Looking forward to reading interesting, intriguing, informative, and introspective responses.

4 Comments

Have you had a look at existing theory and practice of computer-assisted learning? It would be rather dull to reinvent the wheel or to ignore previous results. Your technical-abstract viewpoint is useful to design a system but to design it in a usable way, one should better know some basics of learning theory.

You might want to look at item response theory. I found this blog post gives a nice introduction.

Also, you may be able to adapt or get inspiration from the LON-CAPA system. It’s written in Perl. I don’t really know much about ed-tech, but there are several people and projects trying to grow that area.

(P.S. This post needs a title.)

Maybe you could look at Moodle (the software package) that does the e-learning stuff and is very popular. Any form of e-learning is more about the content than anything else and that is where your focus should really be. Existing packages can solve the problem without reinventing the wheel. You could write plugins to Moodle to adjust the way certain things are viewed but the rest of the infrastructure is already present including quizzes, scoring, video tutorials etc. etc.

However, if this is a pet project to just build software that might already exist then that is your choice.

I am certainly interested in discussing this; your proposal seems a bit rough still. What is your background / in which environment are you planning to build something? (Is this rather a hobby-style project of yours or is it embedded in a university study / business? I hope not to sound judgemental.)

About “knowledges”. There are many definitions of “knowledge”, also depending on where on Earth you are living. Your definition is certainly an interesting one.

A propos moodle: moodle is rather courseware than learning platform.

Probably have a look at https://www.khanacademy.org/

Leave a comment

About theorbtwo

user-pic Adventures in eclectic geekery.