Position
Each "not known" below is a statement about this search, not about the world.
Against the existing reviews
- Firth 2021 and Brunmair 2019 (core) review interleaving as a laboratory effect; Murray 2025 reviews spacing in mathematics; none reviews the exercise set as a document.
- The EEF review counts classroom studies per strategy (Perry 2021): 12 for interleaving, 22 for worked examples. It does not ask how one sheet combines them.
- Du 2020 and Ericson 2022 review Parsons problems as an item type; Muldner 2022 places them among incomplete examples.
- Cooper 2006 and Bas 2017 review homework as an amount, not as a sequence.
- This review adds: the set read as one sequence of blocks, order and support side by side, solutions and copying in the same frame, and adoption counts.
Known
- Interleaving the types of a homework raised delayed classroom test scores: d = 0.79 at 30 days (Rohrer 2015), 1.05 at two weeks (Rohrer 2014, secondary), 0.83 in a cluster trial (Rohrer 2020, core).
- Spreading a type across several sets beats massing it, in mathematics too, though less inside courses (Murray 2025, secondary; Emeny 2021).
- More problems of one type in one session add little at a delay (Rohrer 2006; Gorgievski 2024).
- An example before a problem beats problems alone for novices (van Gog 2011, linked); removing worked steps gradually beats jumping from pairs to problems (Renkl 2002; Atkinson 2003; Renkl 2004, core).
- Adapting the fading to the learner beats a fixed schedule in a tutor (Salden 2009).
- Parsons problems are as effective as writing code and faster, in the studies of one group (Ericson 2017; Ericson 2018; Haynes 2021).
- Online homework with hints and teacher reports gave a small gain at state scale (Roschelle 2016).
- Copying homework rises toward deadlines and goes with lower exam scores (Palazzo 2010); solution sites grew during remote teaching (Lancaster 2021).
Not known
- Whether a whole set built from the measured parts beats the blocked textbook set: no study tests the combination.
- What share of a set should be interleaved: Rohrer 2015 illustrates a set of four same-type problems then eight interleaved ones, and no study varies the share.
- Whether easy-to-hard order inside a set helps, compared with mixed difficulty: no study found.
- When to release full solutions: before the attempt, after submission, or never. One two-cohort study (Rystrom 2005) and many opinions (Q/A threads).
- Whether hints written on paper (a folded hint before the folded solution) work as tutor hints do: every hint study found is in software.
- How much homework, in problems per type, for retention at a month: only Rohrer 2006 (3 against 9) varies it.
- Whether interleaving transfers outside mathematics and chemistry in classrooms (Perry 2021: almost only mathematics).
Where practice runs ahead of the evidence
- Variation sets are promoted by England's national centre for mathematics teaching (NCETM 2020); this search found no trial of the set design.
- Starred or graded difficulty labels are common (MathEd 2014f) and untested.
- Answers to odd-numbered exercises only (OpenStax 2026) is a convention with no study found.
- Mastery streaks (three correct in a row in ASSISTments skill builders, Roschelle 2016) are set by convention; the trial tested the whole homework system.
Where evidence is ignored by practice
- Interleaving raised scores in classroom trials, yet 9.7% of textbook problems are interleaved (Rohrer 2020b).
- Spacing and interleaving are judged less effective by the students who would use them (Hartwig 2022).
- Long blocks of one type persist, though a few problems per type per session gain as much (Rohrer 2006; Rohrer 2020c).
What this repository adds
- It reads the exercise set as a document with typed blocks, so a program can check its order: the tags of each problem's type and the position of each block.
- It names the baseline (the blocked set with an answer key at the end) and how to compare a shape against it (baseline).
- Its proposals are graded: measured where a trial tested the part, convention where only practice holds it (shapes and checks).
- It does not claim a new result or the state of the art.