High-stakes testing

A driving test is a high-stakes test: Without passing the test, the test taker cannot obtain a driver's license.

A high-stakes test is a test with important consequences for the test taker.^[1] Passing has important benefits, such as a high school diploma, a scholarship, or a license to practice a profession. Failing has important disadvantages, such as being forced to take remedial classes until the test can be passed, not being allowed to drive a car, or not being able to find employment.

The use and misuse of high-stakes tests are a controversial topic in public education, especially in the United States where they have become especially popular in recent years, used not only to assess students but in attempts to increase teacher accountability.^[2]

Definitions

In common usage, a high-stakes test is any test that has major consequences or is the basis of a major decision.^[1][3][4]

Under a more precise definition, a high-stakes test is any test that:

• is a single, defined assessment,
• has a clear line drawn between those who pass and those who fail, and
• has direct consequences for passing or failing (something "at stake").^[5]

High-stakes testing is not synonymous with high-pressure testing. An American high school student might feel pressure to perform well on the SAT-I college aptitude exam. However, SAT scores do not directly determine admission to any college or university, and there is no clear line drawn between those who pass and those who fail, so it is not formally considered a high-stakes test.^[6][7] On the other hand, because the SAT-I scores are given significant weight in the admissions process at some schools, many people believe that it has consequences for doing well or poorly and is therefore a high-stakes test under the simpler, common definition.^[8][9]

The stakes

High stakes are not a characteristic of the test itself, but rather of the consequences placed on the outcome. For example, no matter what test is used—written multiple choice, oral examination, performance test—a medical licensing test must be passed to practice medicine.

The perception of the stakes may vary. For example, college students who wish to skip an introductory-level course are often given exams to see whether they have already mastered the material and can be passed to the next level. Passing the exam can reduce tuition costs and time spent at university. A student who is anxious to have these benefits may consider the test to be a high-stakes exam. Another student, who places no importance on the outcome, so long as he is placed in a class that is appropriate to his skill level, may consider the same exam to be a low-stakes test.^[5]

The phrase "high stakes" is derived directly from a gambling term. In gambling, a stake is the quantity of money or other goods that is risked on the outcome of some specific event. A high-stakes game is one in which, in the player's personal opinion, a large quantity of money is being risked. The term is meant to imply that implementing such a system introduces uncertainty and potential losses for test takers, who must pass the exam to "win," instead of being able to obtain the goal through other means.

Examples

Examples of high-stakes tests and their "stakes" include:

• Driver's license tests and the legal ability to drive
• Theater auditions and the part in the performance
• College entrance examinations in some countries, such as Japan's Common first-stage exam, and admission to a high-quality university
• Many job interviews or drug tests and being hired
• High school exit examinations and high-school diplomas
• No Child Left Behind tests and school funding and ratings
• Ph.D. oral exams and receiving the doctorate
• Professional licensing and certification examinations (such as the bar exams, FAA written tests, and medical exams) and the license or certification being sought
• The Test of English as a Foreign Language (TOEFL) and recognition as a speaker of English (if a minimum score is required, but not if it is used merely for information [normally in work and school placement contexts])

Stakeholders

A high-stakes system may be intended to benefit people other than the test-taker. For professional certification and licensure examinations, the purpose of the test is to protect the general public from incompetent practitioners. The individual stakes of the medical student and the medical school are, hopefully, balanced against the social stakes of possibly allowing an incompetent doctor to practice medicine.^[10]

A test may be "high-stakes" based on consequences for others beyond the individual test-taker.^[4] For example, an individual medical student who fails a licensing exam will not be able to practice his or her profession. However, if enough students at the same school fail the exam, then the school's reputation and accreditation may be in jeopardy. Similarly, testing under the U.S.'s No Child Left Behind Act has no direct negative consequences for failing students,^[11] but potentially serious consequences for their schools, including loss of accreditation, funding, teacher pay, teacher employment, or changes to the school's management.^[12] The stakes are therefore high for the school, but low for the individual test-takers.

Assessments used in high-stakes testing

Any form of assessment can be used as a high-stakes test. Many times, an inexpensive multiple-choice test is chosen for convenience. A high-stakes assessment may also involve answering open-ended questions or a practical, hands-on section. For example, a typical high-stakes licensing exam for a medical nurse determines whether the nurse can insert an I.V. line by watching the nurse actually do this task. These assessments are called authentic assessments or performance tests.^[5]

Some high-stakes tests may be standardized tests (in which all examinees take the same test under reasonably equal conditions), with the expectation that standardization affords all examinees a fair and equal opportunity to pass.^[5] Some high-stakes tests are non-standardized, such as a theater audition.

As with other tests, high-stakes tests may be criterion-referenced or norm-referenced.^[5] For example, a written driver's license examination typically is criterion-referenced, with an unlimited number of potential drivers able to pass if they correctly answer a certain percentage of questions. On the other hand, essay portions of some bar exams are often norm-referenced, with the worst essays failed and the best essays passed, without regard for the overall quality of the essays.

The "clear line" between passing and failing on an exam may be achieved through use of a cut score: for example, test takers correctly answering 75% or more of the questions pass the test; test takers correctly answering 74% or fewer fail, or don't "make the cut". In large-scale high-stakes testing, rigorous and expensive standard setting studies may be employed to determine the ideal cut score or to keep the test results consistent between groups taking the test at different times.

Criticism

High-stakes tests are often criticized for the following reasons:

• The test does not correctly measure the individual's knowledge or skills. For example, a test might purport to be a general reading-skills test, but it might actually determine whether or not the examinee has read a specific book.
• The test may not measure what the critic wants measured. For example, a test might accurately measure whether a law student has acquired fundamental knowledge of the legal system, but the critic might want students to be tested on legal ethics instead of legal knowledge.
• High-stakes testing may encourage teachers to omit material that is not tested. "Teaching to the test" can result in a narrow curriculum and lower skills. For example, if a driving exam does not test parallel parking skills, then driving instructors may stop teaching that skill to a driving student, in favor of focusing instruction time on the material that will be tested, such as determining which vehicle has the right of way at a four-way stop. The result is that the student will be able to pass the test, but may be unable to park a car safely in some places. According to Campbell's law, the higher the stakes are (for the test taker or for the school), the more likely this is to happen.
• Testing causes stress for some students. Critics suggest that since some people perform poorly under the pressure associated with tests, any test is likely to be less representative of their actual standard of achievement than a non-test alternative.^[13] This is called test anxiety or performance anxiety.
• High-stakes tests are often given as a single long exam. Some critics prefer continuous assessment instead of one larger test. For example, the American Psychological Association (APA) opposes using a one-time high school exit examination as the single determinant of whether a student should graduate, saying, "Any decision about a student's continued education, such as retention, tracking, or graduation, should not be based on the results of a single test, but should include other relevant and valid information."^[14] Since the stakes are related to consequences, not method, however, short tests can also be high-stakes.
• High-stakes testing creates more incentive for cheating.^[15] Because cheating on a single critical exam may be easier than either learning the required material or earning credit through attendance, diligence, or many smaller tests, more examinees that do not actually have the necessary knowledge or skills, but who are effective cheaters, may pass. Also, some people who would otherwise pass the test but are not confident enough of themselves might decide to additionally secure the outcome by cheating, get caught and often face even worse consequences than just failing. Additionally, if the test results are used to determine the teachers' pay or continued employment, or to evaluate the school, then school personnel may fraudulently alter student test papers to artificially inflate student performance.^[15]
• Sometimes a high-stakes test is tied to a controversial reward. For example, some people may want a high-school diploma to represent the verified acquisition of specific skills or knowledge, and therefore use a high-stakes assessment to deny a diploma to anyone who cannot perform the necessary skills.^[16] Others may want a high school diploma to represent primarily a certificate of attendance, so that a student who faithfully attended school but cannot read or write will still get the social benefits of graduation. This use of tests — to deny a high school diploma, and thereby access to most jobs and higher education for a lifetime — is controversial even when the test itself accurately identifies students that do not have the necessary skills. Criticism is usually framed as over-reliance on a single measurement^[17] or in terms of social justice, if the absence of skill is not entirely the test taker's fault, as in the case of a student who cannot read because of unqualified teachers, or an elderly person with advanced dementia that can no longer pass a driving exam due to loss of cognitive function.^[18]
• Tests can penalize test takers that do not have the necessary skills through no fault of their own. An absence of skill may not be the test taker's fault, but high-stakes test measure only skill proficiency, regardless of whether the test takers had an equal opportunity to learn the material.^[18][19][20] Additionally, wealthy students may use private tutoring or test preparation programs to improve their scores. Some affluent parents pay thousands of dollars to prepare their children for tests.^[21] Critics see this as being unfair to students who cannot afford additional educational services.^[22]
• High-stakes tests reveal that some examinees do not know the required material, or do not have the necessary skills. While failing these people may have many public benefits, the consequences of repeated failure can be very high for the individual. For example, a person who fails a practical driving exam will not be able to drive a car legally, which means they cannot drive to work and may lose their job if alternative transportation options are not available. The person may suffer social embarrassment when his acquaintances discover that his lack of skill resulted in loss of his driver's license. In the context of high school exit exams, poorly performing school districts have formally opposed high-stakes testing after low test results, which accurately and publicly exposed the districts' failures, proved to be politically embarrassing,^[23] and criticized high-stakes tests for identifying students who lack the required knowledge.^[24] As high-stakes testing moves into the 21st century, many exams are performed using online tools. This puts low income students at a disadvantage as less than 65% have computers in their household. Low-income school districts do not have the funding to provide students with the tools and training to perform the tasks required for the test. Tests may given mid-year to provide for the lack of technology services at the school^[25]
• High-stakes testing starts too young for children. The tests often start as young as third grade, and sometimes even earlier. High-stakes testing make children responsible for knowing or not knowing information, in order to be promoted, and if they do not know the information they are punished by being retained or summer school.^[26]

References

1. "Lexicon of Learning". Association for Supervision and Curriculum Development.
2. Rosemary Sutton & Kelvin Seifert (2009) Educational Psychology, 2nd Edition: “Chapter 1: The Changing Teaching Profession and You.” pp 14
3. "High-Stakes Testing: Educational Barometer for Success,or False Prognosticator for Failure".
4. Torin D. Togut. "EDEX 790 Glossary of Education Terms". Retrieved July 23, 2009.
5. "The nature of assessment: A guide to standardized testing — Center for Public Education". Retrieved July 23, 2009.
6. Pfeiffer, Steven I (Winter 2009). "The Debate about Using the SAT in College Admissions". Duke University Talent Identification Program. Gaston Caperton, president of the College Board, which publishes the SAT, counters that the SAT I is “not a high-stakes test” but is a useful admissions tool when considered along with other evidence of a student’s potential for college success.
7. "Phelps' critique of Cannell paper: Misunderstandings". Independent Education Review. ISSN 1557-2870. The ACT and SAT are not the highest stakes tests. Indeed, they may more accurately be categorized as medium stakes tests. One can do poorly on either test, and one will still get into college somewhere. By contrast, a couple dozen states, and most other countries, require passage of a test in order to graduate. That's high stakes.
8. Mari Pearlman (April 4, 2001). "High-stakes Testing: Perils & Opportunities". Archived from the original on 2009-09-25. Retrieved July 23, 2009.
9. Eddy Ramírez (30 April 2008). "Admissions Officials Shrug at SAT Writing Test". Retrieved 24 July 2009.
10. Mehrens, W.A. (1995). Legal and Professional Bases for Licensure Testing.' In Impara, J.C. (Ed.) Licensure testing: Purposes, procedures, and practices, pp. 33-58. Lincoln, NE: Buros Institute.
11. "NCLB has nothing to do with the high-stakes nature of the test for students".
12. Greene, Jay P., Marcus A. Winters, Greg Forster (February 2003). "Testing High Stakes Tests: Can We Believe the Results of Accountability Tests?". Civic Report (Manhattan Institute for Policy Research).
13. Zuriff GE (1997). "Accommodations for test anxiety under ADA?". J. Am. Acad. Psychiatry Law 25 (2): 197–206. PMID 9213292.
14. "Appropriate Use of High-Stakes Testing in Our Nation's Schools". American Psychological Association. Retrieved 2008-01-09.
15. Jacob, Brian A. and Steven D. Levitt (Winter 2004). "To Catch a Cheat" (PDF). Education Next.
16. "Figure 1-10: Employee/faculty support for high stakes testing: 2000". Retrieved 2008-02-06.
17. Lewis, Anne (April 2000). "High-stakes testing: Trends and issues" (PDF). Mid-Continent Research for Education and Learning.
18. Togut, Torin D. "High-Stakes Testing: Educational Barometer for Success, or False Prognosticator for Failure".
19. Myers, David (2001). Psychology. New York: Worth Publishers. p. 464. ISBN 1-57259-791-7. Why blame the tests for exposing unequal experiences and opportunities?
20. Dang, Nick (18 March 2003). "Reform education, not exit exams". Daily Bruin. One common complaint from failed test-takers is that they weren’t taught the tested material in school. Here, inadequate schooling, not the test, is at fault. Blaming the test for one’s failure is like blaming the service station for a failed smog check; it ignores the underlying problems within the 'schooling vehicle.'
21. "Tackling the SAT? Test-prep help abounds". Christian Science Monitor 90 (175). Associated Press. August 4, 1998. pp. B3. ISSN 0882-7729. Retrieved 2007-07-09. Some parents spend thousands of dollars for private sessions...
22. Johnson, Dale, Bonnie Johnson, Stephen J. Farenga, & Daniel Ness. (2008). Stop High-Stakes Testing: An Appeal to America's Conscience. Lanham, MD: Rowman & Littlefield.
23. Weinkopf, Chris (2002). "Blame the test: LAUSD denies responsibility for low scores". Daily News. The blame belongs to 'high-stakes tests' like the Stanford 9 and California's High School Exit Exam. Reliance on such tests, the board grumbles, 'unfairly penalizes students that have not been provided with the academic tools to perform to their highest potential on these tests'.
24. "Blaming The Test". Investor's Business Daily. 11 May 2006. A judge in California is set to strike down that state's high school exit exam. Why? Because it's working. It's telling students they need to learn more. We call that useful information. To the plaintiffs who are suing to stop the use of the test as a graduation requirement, it's something else: Evidence of unequal treatment....the exit exam was deemed unfair because too many students who failed the test had too few credentialed teachers. Well, maybe they did, but granting them a diploma when they lack the required knowledge only compounds the injustice by leaving them with a worthless piece of paper.
25. http://www.census.gov/history/pdf/2013computeruse.pdf
26. Kozol, Jonathan (2005). The Shame of the Nation. New York: Crown Publishers. p. 53. ISBN 978-1-4000-5245-5.

Further reading

• Featherston, Mark Davis, 2011. "High-Stakes Testing Policy in Texas: Describing the Attitudes of Young College Graduates." Applied Research Projects, Texas State University-San Marcos.