How much of one ten-minute lesson is still there in the people you taught three days later, and does changing one thing about how it is revised keep more of it?
Organisations spend enormous sums on training that nobody checks three days afterwards, and the field that does check — instructional design and learning measurement — is paid precisely because forgetting is expensive and invisible. A trainer who can show a retention curve instead of a satisfaction form is worth more than one who cannot, in schools, in hospitals, in factories and in software companies. The method here is the standard method: identical content, identical questions, identical gap, one variable changed, and the limits reported rather than buried.
Two acts. Find, then fix.
Every EAD project runs the same shape. The first act produces a number nobody in the room could previously state. The second act changes exactly one thing and proves whether that number moved.
A one-page costed problem statement carrying five lines: who was taught, the mean immediate score, the mean score at seventy-two hours, the percentage lost, and what that loss is worth in minutes of teaching per week and hours or rupees per year at the rate teaching is actually paid for here. Beside it sits a two-point line for the group, marked with the number of people and the exact gap in hours.
Two lines on one chart, one per group, each running from the immediate score to the seventy-two-hour score, with the number of people on each, the retained percentage for each, the difference between them, and a written list of every way the two groups were not alike.
What actually gets measured
Every step, written out
Twenty steps in total — ten to find the number, ten to fix it. Pick the route that matches what your school actually has.
-
Choose the ten minutes
40 minutesPick one small, self-contained, neutral thing you can teach completely in ten minutes, and write the script.- List five candidate topics you could teach fully in ten minutes: a knot, the rules of a card game, how a lock works, the parts of a bicycle brake, five words of a language nobody in the room speaks.
- Strike out any topic that appears on somebody's syllabus this term, and any topic touching belief, politics, family or money.
- Write the ten-minute script word for word in the notebook, including the examples and the exact order, so the second group hears the identical lesson.
- Read the script aloud twice against a clock with a second hand and cut or pad until it lands between nine and eleven minutes both times.
- Write one sentence on why this topic is safe to test: it touches no mark, no belief and nobody's private life.
Write down: The chosen topic, the safety sentence, and the full script with both timed lengths recorded.Finished when: The script runs to time twice in a row and contains nothing about anybody's beliefs, family, ability or graded work.Commonest mistake: Choosing something you know well and improvising around the script. Improvisation means the two groups get different lessons, and then nothing you measure afterwards means anything. -
Write the five questions
45 minutesBuild one master test sheet with its marking key, so the identical paper can be given twice.- Write five short questions that can only be answered by somebody who received this lesson, one mark each, with no half marks anywhere.
- Write the marking key on its own page, stating exactly what earns a mark and what does not, before a single answer exists.
- Copy the master sheet out by hand once per person for the first test and again for the second, with a code box at the top and no name line.
- Give one copy to a person who has not had the lesson; their score tells you how much of your test can simply be guessed.
- Write both test moments on the calendar now: immediately after teaching, and exactly seventy-two hours later to the hour.
Write down: The master sheet, the marking key page, the untaught person's score, the count of copies made, and the two fixed test moments.Finished when: Somebody who never had the lesson scores near zero, and the key decides every mark without you having to think.Commonest mistake: Copying the sheet from memory the second time and changing a word. Copy every sheet from the one master; a reworded question is a different question and the comparison dies with it. -
Ask and consent
40 minutesRecruit at least five people, take consent in words, and give everybody a code instead of a name.- Find at least five people who can give you ten minutes now and five more minutes in three days, and ask each one face to face.
- Read the consent sentence at the top of the sheet aloud to each person: this is a study about forgetting, not about you; your score is never shown to anyone; you can stop at any moment and I will destroy your answers.
- Give each person a code, tell them what it is, and write the code-to-name key on a folded page kept apart from the sheets.
- Record consent as a tick, a code and a date, and note that consent will be asked for again at the second test.
- Write one neutral line per person on things that could affect the result: prior knowledge, reading comfort, the language of the lesson.
Write down: The consent record by code and date, the folded code page kept apart, and the one-line profile of each participant.Finished when: Five or more people have consented aloud, hold a code, and know they can stop; no name sits anywhere near a score.Commonest mistake: Recruiting only the people who are good at tests because they are easy to ask. Write down who you asked and who declined, because a group of five willing friends is a limit you must report, not hide. -
Teach and test now
45 minutesDeliver the ten minutes from the script and test everybody immediately.- Teach from the script without adding examples, without answering extra questions, and time every session against the clock.
- Hand out the copied sheets the moment the lesson ends, with no discussion in between and the participants seated apart.
- Check each sheet carries a code and not a name before you collect it, and put the collected sheets straight into the envelope.
- Mark every sheet against the key page and write the score against the code in the notebook, never against a name.
- Tell everybody truthfully that there is nothing to revise and that they should carry on as normal.
Write down: The immediate score out of five for each code, the timed length of each session, and any deviation from the script.Finished when: Every code has a first score, the sessions ran within one minute of each other, and every collected sheet is anonymous.Commonest mistake: Answering one good question during the lesson and giving that person extra content. Write the deviation down and report it rather than pretending the lesson was identical when it was not. -
Test at seventy-two hours
40 minutesGive the identical five questions again after exactly three days, unannounced, and measure the drop.- Wait the full seventy-two hours without reminding anybody, handing out anything or discussing the topic in front of them.
- Ask each person again whether they are willing, and record anybody who declines as a withdrawal, removing their first score and destroying their sheet.
- Hand out the second set of copies from the same master, identical questions in the identical order, and mark to the same key.
- Ask each person one question afterwards and write the answer down: have you thought about this or talked about it since.
- Work out the drop for each code longhand, then the group means, then the second mean as a percentage of the first.
Write down: The second score per code, the per-person drop, the group mean at both moments, the retained percentage, and the real gap in hours for anybody tested late.Finished when: You can state one number aloud: the percentage of the immediate score still there after three days.Commonest mistake: Letting the gap slip to five days because somebody is busy. Test at seventy-two hours, or write the real gap in hours beside that person's score, because a mixed gap makes the two groups incomparable later. -
Name the loss
50 minutesFinish the costed problem statement on one page and choose the single change you will test.- Write five lines: who was taught, the immediate mean, the three-day mean, the percentage lost, and what that loss is worth in minutes of teaching per week and in hours or rupees per year at the rate teaching is actually paid for here.
- Draw the group's two points on squared paper to a stated scale, labelled with the number of people and the exact gap in hours, with the finding as the title.
- List three possible changes: a two-minute recap at day one, one practice question at day one, the learner explaining the lesson back at the end, a written summary in their own words.
- Choose one and write: 'The second group gets X and nothing else changes; I expect retention to rise from A per cent to B per cent.'
- Read the page aloud to one person who was not involved, and write down the first thing they did not understand.
Write down: The one-page costed problem statement, the three candidate changes, the chosen change as one testable sentence, and the known limit stated in advance.Finished when: Somebody who was not there reads the page once and repeats your percentage-lost figure back correctly.Commonest mistake: Changing the topic as well as the revision because the first lesson felt weak. One variable moves; if the lesson was weak, it stays exactly as weak for the second group. -
Match the second group
40 minutesRecruit and consent a second, comparable group of at least five, and record honestly how they differ from the first.- Recruit at least five people who had no contact with the first group's lesson and who have not heard the topic discussed.
- Read the same consent sentence aloud, record consent by code and date, and use a separate letter series so the two groups are never mixed up.
- Write the same one-line profile for each person: prior knowledge, reading comfort, language of the lesson.
- Rule two columns on one page, one group each, and write every way the groups are not alike under a heading that says 'limits'.
- Write both test moments and the exact moment of the change on the calendar, and copy out the sheets for both tests from the same master.
Write down: The second group's consent record, profiles, the two-column comparison of the groups, and the written list of differences.Finished when: Five or more people have consented, hold codes in a separate series, and the ways the groups differ are written down before any teaching happens.Commonest mistake: Claiming the groups are the same because they are the same size. Same size is not same group; write what actually differs and say plainly that it limits what you can conclude. -
Teach group two
45 minutesDeliver the identical ten minutes to the second group and test immediately with the identical sheets.- Read the same script word for word, timed against the same clock, adding nothing and answering no extra questions.
- Deliver the change here if it belongs at teaching time, such as the learner explaining it back or writing a summary in their own words, and time that separately.
- Hand out the copied sheets the moment the lesson ends, collect them into the envelope, and check every sheet carries a code.
- Mark against the same key page and write the scores in the notebook under the second group's codes.
- Compare the two immediate means longhand and write one line on whether the groups started level; if they did not, say so now rather than at the end.
Write down: The second group's immediate score per code, the timed session length, the time taken by the change, and the comparison of the two immediate means.Finished when: Every code in the second group has a first score, and you have stated in writing whether the two groups started level.Commonest mistake: Teaching the second group better because you have had practice. Read the script; a lesson delivered more warmly the second time is a second variable you cannot separate out. -
Change and retest
50 minutes across three daysDeliver the change at the agreed moment, retest at seventy-two hours, and draw the two curves side by side.- Deliver the change exactly as written and at the agreed hour, timing it and recording who received it and who was missed.
- Test at exactly seventy-two hours from the lesson, asking consent again and recording any withdrawal.
- Mark to the same key, then draw both groups on one sheet of squared paper as two lines from immediate to seventy-two hours, each labelled with its number of people.
- Write the difference in retained percentage between the groups as a number, and say plainly whether five people per group can settle it.
- List every confounder: different people, a different day of the week, one group taught in a noisier room, somebody who discussed the topic with a friend, a lesson that ran a minute long.
Write down: The second group's seventy-two-hour scores, both retained percentages, the two-line chart, the difference between them, and the confounder list.Finished when: You can state both retained percentages, the difference between them, and at least two reasons that difference might not be caused by your change.Commonest mistake: Reporting the difference as proof. With five people per group a difference can easily be the people rather than the method, so report the number and the uncertainty in the same breath. -
Share and reflect
60 minutesPublish the finding without naming anybody, defend it to real people, and record what you would keep.- Deliver the defence out loud in under three minutes to three people who sign and date the page: the topic, both groups, the two curves, the one change, the difference and the limits, using codes and never names.
- Read the one-page explainer to three people who teach or train and write down what each of them said.
- Hand the two-curve page to the teacher or trainer you interviewed with one question: what would you have controlled that I did not.
- Tell every participant their own result privately if they want it, tell them nobody else has seen it, and burn or tear up the code page in front of one witness.
- Complete the relations ledger with ten names, roles, dates and what each person replied.
Write down: The defence, signed and dated by its witnesses, the one-page explainer, the note recording that the code page was destroyed, and the relations ledger holding ten relationships.Finished when: Ten relationships are logged with dates and replies, and no participant's score can be traced back to a name by anybody, including you.Commonest mistake: Showing the curves with a name or a recognisable description beside a low score. Codes only, in the defence, the explainer and the ledger, with no exceptions for people who say they do not mind.
-
Choose the ten minutes
40 minutesPick one small, self-contained, neutral thing you can teach completely in ten minutes, and write the script.- List five candidate topics you could teach fully in ten minutes: a knot, the rules of a card game, how a lock works, the parts of a bicycle brake, five words of a language nobody in the room speaks.
- Strike out any topic that appears on somebody's syllabus this term, and any topic touching belief, politics, family or money.
- Write the ten-minute script word for word in Google Docs, including the examples and the exact order, so the second group hears the identical lesson.
- Read the script aloud against the phone stopwatch twice, and cut or pad until it lands between nine and eleven minutes both times.
- Write one sentence on why this topic is safe to test: it touches no mark, no belief and nobody's private life.
Write down: The chosen topic, the safety sentence, and the full script with both timed lengths recorded.Finished when: The script runs to time twice in a row and contains nothing about anybody's beliefs, family, ability or graded work.Commonest mistake: Choosing something you know well and improvising around the script. Improvisation means the two groups get different lessons, and then nothing you measure afterwards means anything. -
Write the five questions
45 minutesBuild the test once, with its marking key, so it can be given twice without changing a word.- Write five short questions that can only be answered by somebody who received this lesson, one mark each, with no half marks anywhere.
- Write the marking key beside them, stating exactly what earns a mark and what does not, decided before a single answer exists.
- Build the questions once in Google Forms with a participant-code box at the top, no name field, and the question order fixed.
- Give the form to one person who has not had the lesson; their score tells you how much of your test can simply be guessed.
- Put both test moments in the calendar now: immediately after teaching, and exactly seventy-two hours later to the hour.
Write down: The five questions, the marking key, the form link, the untaught person's score, and the two fixed test moments.Finished when: Somebody who never had the lesson scores near zero, and the key decides every mark without you having to think.Commonest mistake: Writing questions answerable by common sense. If the untaught person scores three out of five, your test measures general knowledge rather than your lesson, so rewrite the questions before anybody is taught. -
Ask and consent
40 minutesRecruit at least five people, take consent in words, and give everybody a code instead of a name.- Find at least five people who can give you ten minutes now and five more minutes in three days, and ask each one face to face.
- Read the consent wording aloud to each person: this is a study about forgetting, not about you; your score is never shown to anyone; you can stop at any moment and I will destroy your answers.
- Give each person a code, tell them what it is, and write the code-to-name page separately from every other file.
- Record consent as a tick, a code and a date, and note that consent will be asked for again at the second test.
- Write one neutral line per person on things that could affect the result: how much of the topic they already knew, how comfortably they read, whether the lesson is in their first language.
Write down: The consent record by code and date, the code page kept apart, and the one-line profile of each participant.Finished when: Five or more people have consented aloud, hold a code, and know they can stop; no name sits anywhere near a score.Commonest mistake: Recruiting only the people who are good at tests because they are easy to ask. Write down who you asked and who declined, because a group of five willing friends is a limit you must report, not hide. -
Teach and test now
45 minutesDeliver the ten minutes from the script and test everybody immediately.- Teach from the script without adding examples, without answering extra questions, and time every session on the stopwatch.
- Hand out the form the moment the lesson ends, with no discussion in between and no talking between participants.
- Watch that each person enters their code rather than their name, and check the responses carry no names before you go further.
- Mark every answer against the key and enter the score against the code in Google Sheets.
- Tell everybody truthfully that there is nothing to revise and that they should carry on as normal.
Write down: The immediate score out of five for each code, the timed length of each session, and any deviation from the script.Finished when: Every code has a first score, the sessions ran within one minute of each other, and no name appears in the response sheet.Commonest mistake: Answering one good question during the lesson and giving that person extra content. Write the deviation down and report it rather than pretending the lesson was identical when it was not. -
Test at seventy-two hours
40 minutesGive the identical five questions again after exactly three days, unannounced, and measure the drop.- Wait the full seventy-two hours without reminding anybody, sending the material or discussing the topic in front of them.
- Ask each person again whether they are willing to be tested, and record anybody who declines as a withdrawal, removing their first score.
- Give the identical form, identical questions, identical order, and mark to the same key you wrote in step two.
- Ask each person one question afterwards and write the answer down: have you thought about this or talked about it since.
- Calculate the drop for each code, then the group means, then the second mean as a percentage of the first.
Write down: The second score per code, the per-person drop, the group mean at both moments, the retained percentage, and the real gap in hours for anybody who was not tested on time.Finished when: You can state one number aloud: the percentage of the immediate score still there after three days.Commonest mistake: Letting the gap slip to five days because somebody is busy. Test at seventy-two hours, or write the real gap in hours beside that person's score, because a mixed gap makes the two groups incomparable later. -
Name the loss
50 minutesFinish the costed problem statement on one page and choose the single change you will test.- Write five lines: who was taught, the immediate mean, the three-day mean, the percentage lost, and what that loss is worth in minutes of teaching per week and in hours or rupees per year at the rate teaching is actually paid for here.
- Draw the group's two points as one line in Datawrapper, labelled with the number of people and the exact gap in hours, titled with the finding rather than with the word 'chart'.
- List three possible changes: a two-minute recap at day one, one practice question at day one, the learner explaining the lesson back at the end, a written summary in their own words.
- Choose one and write the sentence: 'The second group gets X and nothing else changes; I expect retention to rise from A per cent to B per cent.'
- Write two lines underneath: what must stay identical for the comparison to hold, and the one difference between the groups you already know you will have to report.
Write down: The one-page costed problem statement, the three candidate changes, the chosen change as one testable sentence, and the known limit stated in advance.Finished when: Somebody who was not there reads the page once and repeats your percentage-lost figure back correctly.Commonest mistake: Changing the topic as well as the revision because the first lesson felt weak. One variable moves; if the lesson was weak, it stays exactly as weak for the second group. -
Match the second group
40 minutesRecruit and consent a second, comparable group of at least five, and record honestly how they differ from the first.- Recruit at least five people who had no contact with the first group's lesson and who have not heard the topic discussed.
- Read the same consent wording aloud, record consent by code and date, and give this group codes in a separate series so the two are never mixed up.
- Write the same one-line profile for each person: prior knowledge, reading comfort, language of the lesson.
- Set the two group profiles side by side and write down every way the groups are not alike, in a section titled 'limits' rather than buried in a footnote.
- Fix both test moments in the calendar and the exact moment the one change will be delivered.
Write down: The second group's consent record, profiles, the side-by-side comparison of the two groups, and the written list of differences.Finished when: Five or more people have consented, hold codes in a separate series, and the ways the groups differ are written down before any teaching happens.Commonest mistake: Claiming the groups are the same because they are the same size. Same size is not same group; write what actually differs and say plainly that it limits what you can conclude. -
Teach group two
45 minutesDeliver the identical ten minutes to the second group and test immediately with the identical questions.- Read the same script word for word, timed on the same stopwatch, adding nothing and answering no extra questions.
- Deliver the change here if the change belongs at teaching time, such as the learner explaining it back or writing a summary in their own words, and time that separately.
- Hand out the identical form the moment the lesson ends, with codes and no names.
- Mark against the same key, entering scores in the same sheet under the second group's codes.
- Compare the two immediate means and write one line on whether the groups started level; if they did not, say so now rather than at the end.
Write down: The second group's immediate score per code, the timed session length, the time taken by the change, and the comparison of the two immediate means.Finished when: Every code in the second group has a first score, and you have stated in writing whether the two groups started level.Commonest mistake: Teaching the second group better because you have had practice. Read the script; a lesson delivered more warmly the second time is a second variable you cannot separate out. -
Change and retest
50 minutes across three daysDeliver the change at the agreed moment, retest at seventy-two hours, and put the two curves side by side.- Deliver the change exactly as written and at the agreed hour, timing it and recording who received it and who was missed.
- Test at exactly seventy-two hours from the lesson, asking consent again and recording any withdrawal.
- Mark to the same key, then chart both groups in Datawrapper as two lines from immediate to seventy-two hours, each labelled with its number of people.
- State the difference in retained percentage between the groups as a number, and say plainly whether five people per group can settle it.
- List every confounder: different people, a different day of the week, one group taught in a noisier room, somebody who discussed the topic with a friend, a lesson that ran a minute long.
Write down: The second group's seventy-two-hour scores, both retained percentages, the two-line chart, the difference between them, and the confounder list.Finished when: You can state both retained percentages, the difference between them, and at least two reasons that difference might not be caused by your change.Commonest mistake: Reporting the difference as proof. With five people per group a difference can easily be the people rather than the method, so report the number and the uncertainty in the same breath. -
Share and reflect
60 minutesPublish the finding without naming anybody, defend it to real people, and record what you would keep.- Record a defence video of no more than three minutes: the topic, both groups, the two curves, the one change, the difference and the limits, using codes and never names.
- Show the one-page explainer to three people who teach or train and write down what each of them said.
- Send the two-line chart to the teacher or trainer you interviewed with one question: what would you have controlled that I did not.
- Tell every participant their own result privately if they want it, tell them nobody else has seen it, and destroy the code-to-name page in front of one witness.
- Complete the relations ledger with ten names, roles, dates and what each person replied.
Write down: The defence video, the one-page explainer, the note recording that the code page was destroyed, and the relations ledger holding ten logged relationships.Finished when: Ten relationships are logged with dates and replies, and no participant's score can be traced back to a name by anybody, including you.Commonest mistake: Showing the chart with a name or a recognisable description beside a low score. Codes only, in the video, the explainer and the ledger, with no exceptions for people who say they do not mind.
What the student hands in
Nine pieces. Together they are the folder a parent can sit down and read.
The expert they have to find
Ten logged relationships are required before this project can be marked. One of them is an expert, and this is who.
A teacher, a corporate or vocational trainer, a private tutor or a learning researcher — somebody who has to make material stick and finds out when it does not.
How to find one
Any nearby school or college staff room at the end of the day, asked through the office. Training departments at hospitals, banks and factories employ trainers who run the same course repeatedly. University education departments publish staff emails. A private tutor who has taught the same material for years will answer the retention question faster than anybody.
What to say
Hello, my name is [name]. I taught five people the same ten minutes and tested them straight away and again three days later. A large part of it had gone, and the number surprised me. Could you spare fifteen minutes this week to tell me what I measured wrongly? I will send my five questions first.
What to ask
- When you teach something once, how much do you expect to be there three days later, and what makes you think that?
- What do you do differently for the material you cannot afford to have forgotten?
- How would you check whether your teaching worked, if nobody gave you a test to use?
- What makes a test question a fair test of a lesson rather than a test of general knowledge?
- If you had two small groups and one change between them, what would you be most worried about in the comparison?
The defence
Eight of the twenty marks. A student who cannot answer these has not finished, however good the artefact is.
- Would the second group have remembered more anyway without your change, and how do you know?
- Your two groups were different people. Name every way they differed and tell me which difference could have produced your whole result on its own.
- Five people per group. Convince me that is enough to say anything, and tell me what number would have satisfied you.
- Somebody in the second group says they thought about the topic on day two. What does that do to your finding, and what did you do about it?
How far a student can take it
If you want to go further
Run a third group with a second revision change and put all three curves on one axis, keeping every other condition identical.
When it goes wrong
- If nobody will be taught by you - then teach the ten minutes to people who already owe you five minutes, such as the family you live with and one neighbour, and report plainly that a convenience sample is what you had.
- If your two groups look the same - then report the null result, check first whether the change was actually delivered to every person and at the agreed hour, and put the delivery record beside the chart.
- If you could not test at seventy-two hours - then record the real gap in hours for every person, use the same real gap for the second group, and report the gap you used rather than the gap you meant to use.
- If you run out of time - then keep both groups and shorten nothing about the method, dropping the third teaching session or the stretch rather than the seventy-two-hour test, because without the second test there is no finding at all.
Before you start
- Consent every time, in words, before every session and before every test. Each person is told that this is a study about forgetting rather than about them, what will happen to their answers, and that they may stop at any moment, refuse the second test, or ask for their answers to be destroyed, with no reason given and nothing said about it afterwards.
- Scores stay private. Everybody becomes a code before anything is written down; no name goes on an answer sheet, into a form or onto a chart; nobody sees anybody else's score; nobody is ranked, compared aloud, told they did badly or told who scored highest. The page linking codes to names stays with you, out of sight, and is destroyed when the project ends.
- Never test anybody on work they are being formally graded on. Choose a small neutral topic that touches no real mark anywhere, because a poor result here must never reach a report, a file or a mark book. The topic is never personal, religious or political, and no question asks about anybody's beliefs, family, income or ability.
- No pressure and no rewards that make refusal awkward. At the second test, ask again rather than assuming, and record anybody who declines as a withdrawal, removing their first score from the analysis and saying so in the report.
Run this with a class
Both booklets are free and complete — all twelve projects, 240 written steps, either route. The first year costs a school nothing, including training one teacher.
Get the booklets, free Talk to us