The Most Counterintuitive Finding in Learning Science
If you had one hour to study for a certification exam, how should you spend it? Most people would say: re-read notes, review flashcards, or watch a video. They would be wrong.
The most effective thing you can do with that hour is take a practice test.
This is the testing effect (also called retrieval practice), and it is one of the most robust findings in cognitive psychology. Over 100 years of research, from Abbot (1909) to Roediger and Karpicke (2006), consistently shows that the act of retrieving information from memory strengthens that memory more than any other study technique.
What the Research Shows
The Classic Study (Roediger and Karpicke, 2006, Psychological Science 17(3), 249-255, Experiment 1)
Students studied prose passages and were randomly assigned to two groups:
- Group A: Study the passage, then study it again (SSSS)
- Group B: Study the passage, then take a test on it (STST)
Results after one week:
- Group A (study-study): 42% retention
- Group B (study-test): 56% retention
The group that tested themselves recalled 33% more material after one week - 56% against 42%, a 14-point gap. And they spent the same total time. The only difference was how they used that time.
Why Retrieval Beats Rereading
When you reread material, your brain recognizes it and produces a feeling of familiarity. This familiarity feels like learning, but it is an illusion -- recognition is not the same as recall. On exam day, you need recall (pulling information from memory without prompts), not recognition (identifying something you have seen before).
Retrieval practice forces your brain to reconstruct information from memory, which:
- Strengthens neural pathways to the stored information
- Identifies gaps in your knowledge (you cannot discover what you do not know by rereading)
- Builds retrieval routes that mirror the exam experience
- Reduces test anxiety because the exam format feels familiar
The Pretesting Effect
Even more surprisingly, taking a test BEFORE you have studied the material improves subsequent learning. Richland et al. (2009) showed that students who attempted a pretest on material they had not yet studied learned more from the subsequent study session than students who simply studied the material directly.
Application: Before reading a new chapter or starting a new study domain, take a quick quiz on the topic. Getting the answers wrong is the point -- it primes your brain to absorb the correct information when you encounter it.
How to Apply the Testing Effect to Certification Prep
Method 1: Practice Questions as Primary Study
Most candidates use practice questions as a final check before the exam. This is backwards. Practice questions should be your primary study method from Day 1.
The recommended split:
- Week 1: 30% reading/video, 70% practice questions
- Weeks 2-4: 20% reading/video, 80% practice questions
- Final weeks: 10% targeted reading, 90% practice questions
How to use practice questions effectively:
- Attempt the question before looking at the answer
- Read ALL answer explanations -- not just for wrong answers. Understanding why the correct answer is correct AND why each wrong answer is wrong builds comprehensive knowledge
- Track which domains/topics you get wrong
- Return to wrong questions 24-48 hours later (combines testing effect with spaced repetition)
Method 2: The Blank Page Technique
After each study session, close your materials and write down everything you can remember from what you just studied. Do not organize it. Do not make it pretty. Just dump everything from memory onto a blank page.
Then open your materials and compare. The gaps between what you wrote and what was in the material are your study priorities for the next session.
This technique takes 5-10 minutes and dramatically improves retention. It works because it is pure retrieval practice -- you are reconstructing information from memory with no cues.
Method 3: Teach-Back
Explain the material you just studied to someone else -- or to yourself out loud, or to a rubber duck on your desk. The act of generating an explanation forces retrieval and exposes gaps in understanding.
The test: If you cannot explain a concept in simple terms without looking at your notes, you do not understand it well enough to answer exam questions about it.
Method 4: Flashcards (Done Right)
Flashcards are retrieval practice tools, but most people use them wrong.
Wrong: Flipping through a deck and saying "I knew that" when you see the answer Right: Reading the front, attempting to recall the answer, checking yourself, and sorting into "got it" and "need to review" piles
Digital flashcard apps (Anki, Quizlet) are superior to paper because they implement spaced repetition algorithms that automatically schedule review at optimal intervals.
Method 5: Practice Exams Under Exam Conditions
At least once per week during your study period, take a full-length practice exam under timed, exam-like conditions:
- No breaks (or only scheduled breaks as the real exam allows)
- No looking up answers during the exam
- Timed to match the real exam duration
- In a quiet environment similar to a testing center
This combines the testing effect with what psychologists call "transfer-appropriate processing" -- practicing in conditions that match the performance conditions improves performance.
The Spacing and Testing Combination
The testing effect becomes even more powerful when combined with spaced repetition. This combination is called "spaced retrieval practice" and it is the single most effective study technique that cognitive science has identified.
The protocol:
- Study a topic (Day 1)
- Test yourself on it the next day (Day 2) -- pure retrieval, no re-reading first
- Test yourself again 3 days later (Day 5)
- Test yourself again 7 days later (Day 12)
- Test yourself again 14 days later (Day 26)
Each successful retrieval at a longer interval strengthens the memory more than the previous retrieval. By Day 26, the information is deeply consolidated in long-term memory.
Practice Question Quality Matters
Not all practice questions are equal. Here is what makes a good practice question for certification prep:
Good Practice Questions
- Written to match the format and difficulty of the actual exam
- Include detailed explanations for ALL options (correct and incorrect)
- Cover the exam objectives proportionally
- Regularly updated to reflect current exam content
- Present scenarios that require analysis, not just recall
Poor Practice Questions
- Simple recall ("What port does HTTPS use?") without scenario context
- Outdated content that does not match the current exam version
- No explanations or minimal "A is correct because A is the right answer" explanations
- Brain dumps (leaked exam questions) -- these teach you to recognize specific questions, not to understand the material
How Many Practice Questions?
A reasonable target for most certification exams:
- Minimum: 300 unique practice questions with full review of explanations
- Recommended: 500-800 unique practice questions
- Diminishing returns: Beyond 1,000 questions, you are likely seeing repeats and the learning benefit decreases
Measuring Your Progress
The Score Progression
Your practice exam scores should follow a roughly logarithmic curve:
- Weeks 1-2: 40-55% (normal -- you are still learning)
- Weeks 3-4: 55-70% (knowledge is consolidating)
- Weeks 5-6: 70-80% (targeting weak areas)
- Final weeks: 80-90% (exam ready)
When You Are Ready
Schedule your exam when you are consistently scoring 80%+ on practice exams from at least two different sources. Using only one source risks overfitting to that source's question style.
The Plateau Problem
If your scores plateau (stuck at 65% for two weeks), it means you are not addressing your weak areas. Analyze your domain-level scores, identify the two weakest domains, and focus exclusively on those until they improve.
Practice exams are not just preparation for the test. They ARE the most effective form of studying. Every question you answer -- right or wrong -- is building the neural pathways you need on exam day.