Are progress tests and final achievement coefficient predictors of passing the medical residency?
DOI:
https://doi.org/10.11606/issn.2176-7262.rmrp.2022.182110Keywords:
Medical education, Problem-based learning, Professional performance assessment, CurriculumAbstract
Introduction: the Progress Test (PT) is a longitudinal, end-of-course assessment that aims to track students’ performance gains and assist in curriculum management. The predictive role of the PT in the selection processes at the end of medical school has been studied with great interest. Objective: to evaluate the association of longitudinal performance of medical students in the PT over a six-year period and the final course performance coefficient with approval in the selection for Medical Residency (MR). Method: a longitudinal study developed at Pernambuco Health College (PHC), where the trajectories of medical students who completed the course in 2018 and 2019 were followed in relation to performance in the PT and final income coefficient. The data were extracted from the PHC academic record database in the Lyceum system. Information about the performance and result in the MR selection
process was obtained from the website of the organizing institution. For bivariate analysis Pearson’s chi-square test and Fisher’s exact test were used when applied, and T test was used to compare means. A significance level of 95% was considered. Results: 293 students were evaluated according to the inclusion/exclusion criteria. The mean age
was 26.36 (±3.29) years, with a predominance of females (76%). It was observed that 96 (33%) students chose not to enter immediately after finishing the course in an MR program, and this behavior was more associated with the higher mean age at the time of course completion (P = 0.02). An association was observed between average PT and passing in MR (p<0.001), and no such association was observed with the final yield coefficient (p=0.71).
Conclusion: this study showed an association between performance in the PT over the six years of medical school and passing the MR test. Such association was not identified with the overall course performance coefficient. We emphasize the importance of motivating the performance of the PT with increasing emphasis on its formative and primordial function in the learning process.
Downloads
References
Van der Vleuten CP, Verwijnen GM, Wijnen WH. Fifteen years of experience with progress testing in a problem-based learning curriculum. Medical Teacher. 1996; 18(2):103-9.
Neeley, S.M., Ulman, C.A., Sydelko, B.S. et al. The Value of Progress Testing in Undergraduate Medical Education: a Systematic Review of the Literature. Med.Sci.Educ.2016 26, 617–622.
Van der Vleuten C, Freeman A, Collares CF. Progress test utopia. Perspect MedEduc. 2018;7 (2):136-138.
Albanese M, Case SM . Progress testing: critical analysis and suggested practices. Adv in Health Sci Educ 2016 ; 21(1): 221-234.
Blake JM, Norman GR, Keane DR, Mueller B, Cunnington J, Didyk N. Introducing progress testing in McMaster University’s problem-based curriculum: psychometric properties and effect of learning. Acad Med. 1996;71:1002–7.
Churwirth L, Bosman G, Henning R, Rinkel R, Wenink A. Collaboration on progress testing in medical schools in the Netherlands. Med Teach. 2010; 32(6):476–9.
Reeman A, van der Vleuten CPM, Nouns Z, Ricketts C. Progress testing internationally. Med Teach. 2010; 32(6):451–5.
Nouns ZM, Georg W. Progress testing in German speaking countries. 2010. Med Teach. 32:467–470.
Bicudo AM, Hamamoto Filho PT, Abbade JF, Hafner MLMB, Maffei CM. Teste de Progresso em consórcios para todas as escolas médicas do Brasil. Rev Bras Educ Méd.2019; 43 (4) : 151-156.
Wrigley W, van der Vleuten CP, Freeman A, Muijtjens A. A systemic framework for the progress test: strengths, constraints and issues: AMEE Guide No. 71. Med Teach. 2012; 34(9):683-97.
Sakai MH, Ferreira Filho OF, Almeida MJ, Mashima DA, Marchese MC. Teste de progresso e avaliação do curso: dez anos de experiência da medicina da Universidade Estadual de Londrina. Rev Bras Ed uc Med. 2008; 32(2).
Maria Inês da Rosa et al. Progress testing as an indicator for improvements in a medical School. Revista Brasileira de Educação Médica. 2017. 41 (1): 58 –
Lampert JB, Bicudo AM. 10 Anos de Diretrizes Curriculares Nacionais dos cursos de graduação em Medicina. Rio de Ja¬neiro/RJ: Associação Brasileira de Educação Médica, 2014.
Associação Brasileira de Educação Médica. Avaliação do estudante de Medicina: Contribuição do teste de progresso [Internet]. [cited 2019 Abr 21]. Disponível em: https://abem-educmed.org.br/acoes/avaliacao-do-estudante-contribuicao-do-teste-de-progresso.
Faccin, Mellysande Pontes. O teste do progresso como instrumento de avaliação da aquisição do conhecimento na graduação médica. 2004. 128 f. Tese (Doutorado em Ciências) – Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, 2005.
Norman G Neville A, Blake J, Mueller B. Assessment steers learning down the right road: Impact of progress testing on licensing examination performance. Medical Teacher. 2010 ,32: 496-9.
Karay Y, Schauber SK. A validity argument for progress testing: Examining the relation between growth trajectories obtained by progress tests and national licensing examinations using a latent growth curve approach. Medical Teacher 2018 Jun28:1-7.
Hamamoto Filho, P.T., de Arruda Lourenção, P.L.T., do Valle, A.P. et al. The Correlation Between Students’ Progress Testing Scores and Their Performance in a Residency Selection Process. Med.Sci.Educ. 2019, 29, 1071–1075.
Brasil. Ministério da Educação. Comissão Nacional de Residência Médica. Resolução CNRM n. 02 de 17 de maio de 2006. Dispõe sobre requisitos mínimos dos Programas de Residência Médica e dá outras providências Brasilia: MEC;2006.
Freitas, Rebeca Luiz. Duque, TB, Figueira, MAS. Teste de progresso para estudantes de graduação em uma faculdade especializada em cursos na área da saúde: avaliação da adesão e desempenho. 2015. Tese - Faculdade Pernambucana de Saúde.
Sylvia Heeneman, Suzanne Schut, Jeroen Donkers, Cees van der Vleuten & Arno Muijtjens (2017) Embedding of the progress test in an assessment program designed according to the principles of programmatic assessment, Medical Teacher, 2017 39:1, 44-52
Thompson, James and Houston, Donald, Programmatic assessment condensed: Introducing progress testing approaches to a single semester paramedic subject, Journal of University Teaching & Learning Practice. 2020, 17(3).
Goldstone, R. L., & Day, S. B. Introduction to "New conceptualizations of transfer of learning." Educational Psychologist. 2012;47(3), 149-152.
Larsen DP, Butler AC, Roediger HL. Repeated testing improves long-term retention relative to repeated study: a randomized controlled trial. Medical Education 2009; (43):1174–81.
Gorlich D, Friedericks H. Using longitudinal progress test data to determine the effect size of learning in undergraduate medical education - a retrospective, single-center, mixed model analysis of progress testing results. Med Educ Online.2021 Dec;26(1):1972505.
Downloads
Published
Issue
Section
License
Copyright (c) 2022 Carlos Vinícius Pacheco dos Santos Guaraná, Dra Taciana Barbosa, Dra Tereza Rebecca
This work is licensed under a Creative Commons Attribution 4.0 International License.
