Progress testing as a pattern of excellence for the assessment of medical students’ knowledge: concepts, history, and perspective
DOI:
https://doi.org/10.11606/issn.2176-7262.rmrp.2021.173770Keywords:
Educational measurement, Learning, Knowledge acquisitionAbstract
Progress test has been created with the necessity of an assessment method align with problem-based learning. Although it was specifically created to overcome the limitations of traditional assessment for problem-based learning, nowadays is used by different type of curricula. In this paper, we first present the basic assumptions, the history, benefit and challenges of the progress test. Progress test overcomes many limitations of traditional assessment, such as validity and reliability. However, the implementation of progress test is a logistical challenge. In addition, we discuss the limitation of progress test when used as summative assessment, which may not always be aligned with constructivist theory. When adding feedback and methods of analysis that considers multiple testing, progress test is then align with constructivist theory. Finally, the use of progress test’s sub scores may lack validity because of the low number of items; thus, pass/fail decision should not be based on the sub scores, but only on general scores.
Downloads
References
Frank J. R, Danoff D. (2007). The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach;29(7):642-647.
Bloom B. S. (1956). Taxonomy of Educational Objectives: The Classification of Education Goals. Cognitive Domain. Handbook 1: Longman.
Anderson L. W, Krathwohl DR, Bloom BS. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives: Allyn & Bacon.
Krathwohl D. R. (2002). A revision of Bloom's taxonomy: An overview. Theory into practice;41(4):212-218.
Crowe A, Dirks C, Wenderoth M. P. (2008). Biology in bloom: implementing Bloom's Taxonomy to enhance student learning in biology. CBE Life Sci Educ;7(4):368-381.
Bissell A. N, Lemons PP. (2006). A new method for assessing critical thinking in the classroom. Bioscience;56(1):66-72.
Zoller U. (1993). Are lecture and learning compatible? Maybe for LOCS: Unlikely for HOCS. J Chem Educ;70(3):195.
Cecilio-Fernandes D, Kerdijk W, Jaarsma A. D. C, Tio RA. (2016). Development of cognitive processing and judgments of knowledge in medical students: analysis of progress test results. Med Teach;38(11):1125-1129.
Redfield D. L, Rousseau E. W. (1981). A meta-analysis of experimental research on teacher questioning behavior. Rev Educ Res;51(2):237-245.
Jensen J. L, McDaniel M. A, Woodard S. M, Kummer T. A. (2014). Teaching to the test… or testing to teach: exams requiring higher order thinking skills encourage greater conceptual understanding. Educ Psychol Rev;26(2):307-329.
Cook D. A, Beckman T. J. (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med;119(2):166-e7.
Swanson D. B. (1987). A measurement framework for performance-based tests. Further developments in assessing clinical competence:13-45.
Wrigley W van Der Vleuten C. P. M, Freeman A, Muijtjens A. (2012) A systemic framework for the progress test: strengths, constraints and issues: AMEE guide no. 71. Med Teach;34(9):683-697.
Van der Vleuten C. P. M, Verwijnen GM. (1996) Fifteen years of experience with progress testing in a problem-based learning curriculum. Med Teach;18:103–109.
Verhoeven H, Verwijnen G. M, Scherpbier A. J. J. A, Holdrinet RSG, Oeseburg B, Bulte JA, van Der Vleuten CPM. (1998) An analysis of progress test results of PBL and non-PBL students. Med Teach;20(4):310-316.
Muijtjens A. M. M, Mameren H. V, Hoogenboom E, van der Vleuten CPM. (1999). The effect of a ‘don't know’ option on test scores: number‐right and formula scoring compared. Med Educ;33:267-275.
Cecilio-Fernandes D, Medema H, Collares C. F, Schuwirth L, Cohen-Schotanus J, Tio RA. (2017). Comparison of formula and number-right scoring in undergraduate medical training: a Rasch model analysis. BMC Med Educ;17(1):192.
Ravesloot C. J, Van der Schaaf M. F, Muijtjens A. M. M, Haaring C, Kruitwagen C. L. J. J, Beek F. J. A, Bakker J, Van Schaik J. P. J, Ten Cate T. J. (2015). The don’t know option in progress testing. Adv Health Sci Educ;20(5):1325-1338.
Collares C. F, Cecilio-Fernandes D. (2019). When I say... Computerised adaptive testing. Med Educ;53(2),115-116.
Cecilio-Fernandes D. Implementing computerized adaptive test. Sci Med, 29(3):34432.
Bicudo A. M, Hamamoto Filho P. T, Abbade J. F, Hafner M. L. M. B, Maffei C. M. L. (2019). Consortia of cross-institutional progress testing for all medical schools in Brazil. Rev Bras Educ Méd;43(4):151-156.
Given K, Hannigan A, McGrath D. (2016). Red, yellow and green: What does it mean? How the progress test informs and supports student progress. Med Teach;38(10):1025-1032.
Hamamoto Filho P. T, Lourenção P. L. T. A, do Valle AP, Abbade J. F, Bicudo A. M. (2019). The correlation between students’ progress testing scores and their performance in a residency selection process. Med Sci Educ;29:1071-1075.
McHarg J, Bradley P, Chamberlain S, Ricketts C, Searle J, McLachlan JC. (2005). Assessment of progress tests. Med Educ;39:221–7.
Freeman, A. C, Ricketts C. (2010). Choosing and designing knowledge assessments: experience at a new medical school. Med Teach;32(7),578-581.
Blake J. M, Norman G. R, Keane D. R, Mueller C. B. (1996). Introducing progress testing in McMaster University's problem-based medical curriculum: psychometric properties and effect on learning. Acad Med;71(9),1002–1007
Dunlosky J, Rawson K. A, Marsh E. J, Nathan M. J, Willingham D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychol Sci Public Interest;14(1):4-58.
Cecilio-Fernandes D, Aalders W. S, de Vries J, Tio R. A. (2017). The Impact of Massed and Spaced-Out Curriculum in Oncology Knowledge Acquisition. J Cancer Educ;33(4),922-925.
Cecilio-Fernandes D, Aalders W. S, Bremers A. J, Tio R. A, de Vries J. (2017) The Impact of Curriculum Design in the Acquisition of Knowledge of Oncology: Comparison Among Four Medical Schools. J Cancer Educ;33(5),1110-1114.
Albano M, Cavallo F, Hoogenboom R, Magni F, Majoor G, Manenti F, et al. (1996). An international comparison of knowledge levels of medical students: the Maastricht Progress Test. Med Educ;30(4):239-245.
Nouns Z, Schauber S, Witt C, Kingreen H, Schüttpelz‐Brauns K. (2012). Development of knowledge in basic sciences: a comparison of two medical curricula. Med Educ;46(12):1206-1214.
Brunk I, Schauber S, Georg W. (2017). Do they know too little? An inter-institutional study on the anatomical knowledge of upper-year medical students based on multiple choice questions of a progress test. Annals of Anatomy-Anatomischer Anzeiger;209:93-100.
Henning M. A, Pinnock R, Webster C. S. (2017) Does Progress Testing Violate the Principles of Constructive Alignment? Med Sci Educ;27(4):825-829.
Swanson D. B. (1997). Assessment in basic science instruction: directions for practice and research. Adv Health Sci Educ;2(1):71-84.
Norcini J, Anderson M. B, Bollela V, Burch V, Costa M. J, Duvivier R., Swanson, D. (2018). 2018 Consensus framework for good assessment. Med Teach;40(11),1102-1109.
Ricketts C, Freeman A, Pagliuca G, Coombes L, Archer J. (2010). Difficult decisions for progress testing: how much and how often? Med Teach;32(6):513-515.
Downloads
Published
Issue
Section
License
Copyright (c) 2021 Dario Cecilio-Fernandes, Angélica Maria Bicudo, Pedro Tadao Hamamoto Filho
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Funding data
-
Fundação de Amparo à Pesquisa do Estado de São Paulo
Grant numbers 2018/15642-1
