Revista Meta: Avaliação

A revisão da literatura realizada, com foco em educação superior, mostra as diferentes utilidades da rubrica em processos avaliativos, especialmente quando estes estão inseridos em currículos voltados ao desenvolvimento de competências e habilidades cognitivas complexas. O estudo inclui discussões sobre boas práticas de criação e aplicação dessa ferramenta, e percepções de diversos autores ao utilizá-la. Os diferentes relatos sobre o assunto sugerem que a rubrica tem valor para professores, estudantes e instituições de ensino por várias razões, tal como favorecer uma avaliação honesta, prática e confiável, que gera informações relevantes sobre a evolução do aprendizado. O artigo não apresenta a rubrica como a solução definitiva para um método de ensino adequado, mas indica que este pode ser um recurso importante para educadores refletirem sobre os objetivos de ensino e sobre as ações para alcançá-los.

ALLEN, S.; KNIGHT, J. A method for collaboratively developing and validating a rubric. Int. J. Scholarsh. Teach. Learn, [S. l.], v. 3, n. 2, 2009. DOI: https://doi.org/10.20429/ijsotl.2009.030210. Disponível em: https://digitalcommons.georgiasouthern.edu/ij-sotl/vol3/iss2/10/. Acesso em:15 jun. 2021.

ANDRADE, H. G. Teaching with rubrics: the good, the bad, and the ugly. Coll. Teach., Washington, v. 53, n. 1, p. 27-30, 2005. DOI: http://doi.org/10.3200/CTCH.53.1.27-31. Disponível em: https://www.tandfonline.com/journals/vcol20. Acesso em: 15 jun. 2021.

ANDRADE, H. G. Using rubrics to promote thinking and learning. Educ. Leadersh., Washington, v. 57, n. 5, p. 13-18, 2000.

ANDRADE, H. G.; DU, Y. Student perspectives on rubric-referenced assessment. Pract. Assess. Res. & Eval., Boston, v. 10, n. 3, 2005. DOI: http://doi.org/10.7275/g367-ye94. Disponível em: https://openpublishing.library.umass.edu/pare/article/id/1649/. Acesso em: 15 jun. 2021.

ARTER, J. Creating & recognizing quality rubrics: a study guide. Portland: Pearson Assessment Training Institute, 2012.

ARTER, J. Designing scoring rubrics for performance assessments: the heart of the matter. In: ANNUAL MEETING OF THE AMERICAN EDUCATIONAL RESEARCH ASSOCIATION, 21., 1993, Atlanta. Anais […]. Atlanta: American Educational Research Association, 1993, p. 39-42.

BESTERFIELD-SACRE, M.; GERCHAK, J.; LYONS, M. R.; SHUMAN, L. J.; WOLFE, H. Scoring concept maps: an integrated rubric for assessing engineering education. J. Eng. Educ., Washington, v. 93, n. 2, p. 105-115, 2004. DOI: https://doi.org/10.1002/j.2168-9830.2004.tb00795.x. Disponível em: https://onlinelibrary.wiley.com/doi/10.1002/j.2168-9830.2004.tb00795.x. Acesso em: 15 jun. 2021.

BIAGIOTTI, L. C. M. Conhecendo e aplicando rubricas em avaliações. In: CONGRESSO INTERNACIONAL ABED DE EDUCAÇÃO A DISTÂNCIA, 12., 2005, Florianópolis. Anais [...]. Florianópolis: ABED, 2005.

BOLTON, F. C. Rubrics and adult learners: andragogy and assessment. Assess. Update, [S. l.], v. 18, n. 3, p. 5-6, 2006.

BRAID, B.; SCHRYNEMAKERS, G. P.; GROSE, A. W. Assessing early integrative learning. Peer Review, Washington, v. 14, n. 1, p. 12-14, 2012.

BRASIL. Ministério da Educação. Programa Brasil-Estados Unidos de modernização da educação superior na graduação (PMG - EUA). In: BRASIL. Ministério da Educação. CAPES. Brasília: Ministério da Educação, 2018. Disponível em: https://www.gov.br/capes/pt-br/acesso-a-informacao/acoes-e-programas/bolsas/bolsas-e-auxilios-internacionais/encontre-aqui/paises/estados-unidos/pmg-eua. Acesso em: 15 jun. 2021.

BRASIL. Ministério da Educação. Resolução nº 2, de 24 de abril de 2019. Institui as Diretrizes Curriculares Nacionais do Curso de Graduação em Engenharia. Diário Oficial da União, Brasília, 26 abr. 2019. Disponível em: http://portal.mec.gov.br/component/content/article?id=12991. Acesso em: 3 maio 2021.

BROAD, B. What we really value: beyond rubrics in teaching and assessing writing. Logan: Utah State University Press, 2003.

CAREY, S. J. From the editor. Peer Review, Washington, v. 14, n. 1, p. 3, 2012.

CASSIDY, E. D.; COLMENARES, A.; MARTINEZ, M. So text me—maybe: a rubric assessment of librarian behavior in SMS reference services. Ref. User Serv. Quart., Chicago, v. 53, n. 4, p. 300-336, 2014. DOI: https://doi.org/10.5860/rusq.53n4.300. Disponível em: https://journals.ala.org/index.php/rusq/article/view/3852. Acesso em: 3 maio 2021.

COOPER, B. S.; GARGAN, A. Rubrics in education: old term, new meanings. Phi Delta Kappan, Bloomington, v. 91, n. 1, p. 54-55, 2009. DOI: https://doi.org/10.1177/003172170909100109. Disponível em: https://journals.sagepub.com/doi/10.1177/003172170909100109. Acesso em: 3 maio 2021.

CUSTER, R. L. Rubrics: an authentic assessment tool for technology education. Technol. Teach., Reston, Va., v. 55, n. 4, p. 27-37, 1996.

DUNBAR, N. E.; BROOKS, C. F.; KUBICKA-MILLER, T. Oral communication skills in higher education: using a performance-based evaluation rubric to assess communication skills. Innov. High. Educ., Nova Iorque, v. 31, p. 115-128, 2006. DOI: https://doi.org/10.1007/s10755-006-9012-x. Disponível em: https://link.springer.com/article/10.1007/s10755-006-9012-x. Acesso em: 3 maio 2021.

GARCÍA-ROS, R. Análisis y validación de una rúbrica para evaluar habilidades de presentación oral en contextos universitarios. Electron. J. Res. Educ. Psychol., La Cañada. Almería, v. 9, n. 25, p. 1043-1062, 2011. DOI: https://doi.org/10.25115/ejrep.v9i25.1468. Disponível em: https://ojs.ual.es/ojs/index.php/EJREP/article/view/1468. Acesso em: 3 maio 2021.

GREEN, R.; BOWSER, M. Observations from the field: sharing a literature review rubric. J. Libr. Adm., Nova Iorque, v. 45, n. 1-2, p. 185-202, 2006. DOI: https://doi.org/10.1300/J111v45n01_10. Disponível em: https://www.tandfonline.com/doi/abs/10.1300/J111v45n01_10. Acesso em: 3 maio 2021.

HAFNER, J. C.; HAFNER, P. M. Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer-group rating. Int. J. Sci. Educ., Londres, v. 25, n. 12, p. 1509-1528, 2003. DOI: https://doi.org/10.1080/0950069022000038268. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/0950069022000038268. Acesso em: 3 maio 2021.

ISAACSON, J. J.; STACY, A. S. Rubrics for clinical evaluation: objectifying the subjective experience. Nurse Educ. Pract., Oxford, v. 9, n. 2, p. 134-140, 2009. DOI: https://doi.org/10.1016/j.nepr.2008.10.015. Disponível em: https://www.sciencedirect.com/science/article/abs/pii/S1471595308001194?via%3Dihub. Acesso em: 3 maio 2021.

JACKSON, C. W.; LARKIN, M. J. Teaching students to use grading rubrics. Teach. Except. Child., Reston, Va., v. 35, n. 1, p. 40-45, 2002. DOI: https://doi.org/10.1177/004005990203500106. Disponível em: https://journals.sagepub.com/doi/10.1177/004005990203500106. Acesso em: 3 maio 2021.

KIM, Y. R.; YANG, J.; LEE, Y.; EARWOOD, B. Assessing cybersecurity problem-solving skills and creativity of engineering students through model-eliciting activities using an analytic rubric. IEEE Access, [S. l.], v. 12, p. 5743-5759, 2024. DOI: https://doi.org/10.1109/ACCESS.2023.3348554. Disponível em: https://ieeexplore.ieee.org/document/10378650/authors. Acesso em: 10 jan. 2024.

KOHN, A. The trouble with rubrics. Alfie Kohn, [S. l.], 2006. Disponivel em: https://www.alfiekohn.org/article/trouble-rubrics/. Acesso em: 19 jul. 2021.

LEONHARDT, A. Using rubrics as an assessment tool in your classroom. Journal of Gen. Music Education, [S. l.], v. 19, n. 1, p. 10-16, 2005. DOI: https://doi.org/10.1177/10483713050190010104. Disponível em: https://journals.sagepub.com/doi/10.1177/10483713050190010104. Acesso em: 19 jul. 2021.

LEWIS, R.; BERGHOFF, P.; PHEENEY, P. Focusing students: three approaches for learning through evaluation. Innov. High. Educ., Nova Iorque, v. 23, p. 181-196, 1999.

LOBATO, A. S.; BRITO, S. R.; SOUZA, D. N. N.; FAVERO, E. L. Um sistema gerenciador de rubricas para apoiar a avaliação em ambientes de aprendizagem. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO, 20., 2009, Florianópolis. Anais [...]. Florianópolis: SBIE, 2009.

LOVELAND, T. R. Writing standards-based rubrics for technology education classrooms: the use of rubrics goes beyond the simple need for objective grading in classrooms. Technol. Teach., Reston, v. 65, n. 2, p. 19-22, 2005.

LUFT, J. A. Rubrics: design and use in science teacher education. J. Sci. Teach. Educ., [S. l.], v. 10, n. 2, p. 107-121, 1999. DOI: https://doi.org/10.1023/A:1009471931127. Disponível em: https://www.tandfonline.com/doi/abs/10.1023/A%3A1009471931127. Acesso em: 19 jul. 2019.

LUNNEY, M.; SAMMARCO, A. Scoring rubric for grading students’ participation in online discussions. CIN: comp. inf. nurs., Hangerstown, v. 27, n. 1, p. 26-31, 2009. DOI: https://doi.org/10.1097/NCN.0b013e31818dd3f6. Disponível em: https://journals.lww.com/cinjournal/abstract/2009/01000/scoring_rubric_for_grading_students__participation.8.aspx. Acesso em: 19 jul. 2019.

MABRY, L. Writing to the rubric: lingering effects of traditional standardized testing on direct writing assessment. Phi Delta Kappan, Bloomington, v. 80, n. 9, p. 673-679, 1999.

MEIER, S. L.; RICH, B. S.; CADY, J. Teachers’ use of rubrics to score non-traditional tasks: factors related to discrepancies in scoring. Assess. Educ., Londres, v. 13, n. 1; p. 69-95, 2006. DOI: https://doi.org/10.1080/09695940600563512. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/09695940600563512. Acesso em: 19 jul. 2019.

MERTLER, C. A. Designing scoring rubrics for your classroom. In: BOSTON, C. (ed.). Understanding scoring rubrics: a guide for teachers. Maryland: ERIC Clearinghouse on Assessment and Evaluation, 2002. p. 72-81.

MOSKAL, B. M. Recommendations for developing classroom performance assessments and scoring rubrics. Pract. Assess. Res. & Eval., Boston, v. 8, n. 14, 2002. DOI: https://doi.org/10.7275/jz85-rj16. Disponível em: https://openpublishing.library.umass.edu/pare/article/id/1467/. Acesso em: 19 jul. 2019.

MOSKAL, B. M. Scoring rubrics: what, when and how? Pract. Assess. Res. & Eval., Boston, v. 7, n. 3, 2000. DOI: https://doi.org/10.7275/a5vq-7q66. Disponível em: https://openpublishing.library.umass.edu/pare/article/id/1391/. Acesso em: 19 jul. 2019.

MOSKAL, B. M.; LEYDENS, J. A. Scoring rubric development: validity and reliability. Pract. Assess. Res. & Eval., Boston, v. 7, n. 3, 2000. DOI: https://doi.org/10.7275/q7rm-gg74. Disponível em: https://openpublishing.library.umass.edu/pare/article/id/1398/. Acesso em: 19 jul. 2019.

MUDDLE, L.; O'MALLEY, C. J.; STUPANS, I. Evaluating the impact of a curriculum intervention using an assessment rubric for communication skill development of osteopathy students. Int. J. Osteopath. Med., [S. l.], v. 47, 2023. DOI: https://doi.org/10.1016/j.ijosm.2022.12.003. Disponível em: https://www.journalofosteopathicmedicine.com/article/S1746-0689(22)00119-5/fulltext. Acesso em: 10 dez. 2023.

NEWELL, J. A.; DAHM, K. D.; NEWELL, H. L. Rubric development and inter-rater reliability issues in assessing learning outcomes. In: AMERICAN SOCIETY FOR ENGINEERING EDUCATION ANNUAL CONFERENCE & EXPOSITION, 2002, Montreal. Anais […]. Montreal: [s. n.], 2002.

NORTHWEST REGIONAL EDUCATIONAL LABORATORY. Converting rubric scores to letter grades. In: BOSTON, C. (ed.). Understanding scoring rubrics: a guide to teachers. Maryland: ERIC Clearinghouse on Assessment and Evaluation, 2002. p. 34-40.

OLIVEIRA, T. D.; STRINGHINI, D.; CRAIBAS, J. J. S.; CORRÊA, D. G. M. Uma análise do uso de avaliações por pares e rubricas na promoção de interação entre alunos em uma disciplina de graduação em engenharia de computação. Novas Tecnologias na Educação, Porto Alegre, v. 17, n. 1, p. 31-41, 2019. DOI: https://doi.org/10.22456/1679-1916.95702. Disponível em: https://seer.ufrgs.br/renote/article/view/95702. Acesso em: 10 dez. 2023.

PANADERO, E.; JONSSON, A.; PINEDO, L.; FERNÁNDEZ-CASTILLA, B. Effects of rubrics on academic performance, self-regulated learning, and self-efficacy: a meta-analytic review. Educ. Psychol. Rev., [S. l.], v. 35, n. 113, 2023. DOI: https://doi.org/10.1007/s10648-023-09823-4. Disponível em: https://link.springer.com/article/10.1007/s10648-023-09823-4. Acesso em: 10 dez. 2023.

PATE, P. E.; HOMESTEAD, E.; MCGINNIS, K. Designing rubrics for authentic assessment. Middle Sch. J., [S. l.], v. 25, n. 2, p. 25-27, 1993. DOI: https://doi.org/10.1080/00940771.1993.11495201. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/00940771.1993.11495201. Acesso em: 19 jul. 2021.

PEAT, B. Integrating writing and research skills: development and testing of a rubric to measure student outcomes. J. Public Aff. Educ., [S. l.], v. 12, n. 3, p. 295-311, 2006. DOI: https://doi.org/10.1080/15236803.2006.12001437. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/15236803.2006.12001437. Acesso em: 19 jul. 2021.

PEET, M. R.; REYNOLDS-KEEFER, L.; GURIN, P.; LONN, S. Fostering integrative knowledge and lifelong learning. Peer Review, Washington, v. 14, n. 1, p. 15-17, 2012.

PERLMAN, C. An introduction to performance assessment scoring rubrics. In: BOSTON, C. (ed.). Understanding scoring rubrics: a guide to teachers. Maryland: ERIC Clearinghouse on Assessment and Evaluation, 2002. p. 5-13.

REDDY, M. Y. Design and development of rubrics to improve assessment outcomes: a pilot study in a Master’s level business program in India. Qual. Assur. Educ., Bingley, v. 19, n. 1, p. 84-104, 2011. DOI: https://doi.org/10.1108/09684881111107771. Disponível em: https://www.emerald.com/insight/content/doi/10.1108/09684881111107771/full/html. Acesso em: 19 jul. 2021.

REDDY, M. Y.; ANDRADE, H. G. A review of rubric use in higher education. Assess. Eval. High Educ., Bath, v. 35, n. 4, p. 435-448, 2010. DOI: https://doi.org/10.1080/02602930902862859. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/02602930902862859. Acesso em: 19 jul. 2021.

SADLER, D. R. Formative assessment and the design of instructional systems. Instr. Sci., Amsterdã, v. 18, p. 119-144, 1989. DOI: https://doi.org/10.1007/BF00117714. Disponível em: https://link.springer.com/article/10.1007/BF00117714. Acesso em: 19 jul. 2021.

SCHNEIDER, F. J. Rubrics for teacher education in community college. Community Coll. Enterp., Livonia, v. 12, n. 1, p. 39-55, 2006.

SHIPMAN, D.; ROA, M.; HOOTEN, J.; WANG, Z. J. Using the analytic rubric as an evaluation tool in nursing education: the positive and the negative. Nurse Educ. Today, Oxford, v. 32, n. 3, p. 246-249, 2012. DOI: https://doi.org/10.1016/j.nedt.2011.04.007. Disponível em: https://www.sciencedirect.com/science/article/abs/pii/S0260691711000943?via%3Dihub. Acesso em: 19 jul. 2021.

SIEFERT, L. Assessing general education learning outcomes. Peer Review, Washington, v. 14, n. 1, p. 9-11, 2012.

SILVA, J. F. D. Introdução: avaliação do ensino e da aprendizagem numa perspectiva formativa reguladora. In: SILVA, J. F. D.; HOFFMANN, J. M. L.; ESTEBAN, M. T. (org.). Práticas avaliativas e aprendizagens significativas: em diferentes áreas do currículo. 9. ed. Porto Alegre: Mediação, 2012. p. 9-20.

STEVENS, D. D.; LEVI, A. Introduction to rubrics: an assessment tool to save grading time, convey effective feedback, and promote student learning. Sterling: Stylus Publishing, 2005.

STUHLMANN, J.; DANIEL, C.; DELLINGER, A.; KENTON, R.; POWERS, T. A generalizability study of the effects of training on teacher's abilities to rate children's writing using a rubric. Read. Psychol., v. 20, n. 2, p. 107-127, 1999. DOI: https://doi.org/10.1080/027027199278439. Disponível em: https://www.tandfonline.com/doi/abs/10.1080/027027199278439. Acesso em: 19 jul. 2021.

SZATMARY, A. C. Tools for comprehensive assessment of the 7 ABET student outcomes in mechanical engineering, with application to capstone design. In: AMERICAN SOCIETY FOR ENGINEERING EDUCATION ANNUAL CONFERENCE & EXPOSITION, 2023, Baltimore. Anais […]. Baltimore: [s. n.], 2023

TERNUS, M. P.; PALMER, K. L.; FAULK, D. R. Benchmarking quality in online teaching and learning: a rubric for course construction and evaluation. J. Eff. Teach., [S. l.], v. 7, n. 2, p. 51-67, 2007.

THALER, N.; KAZEMI, E.; HUSCHER, C. Developing a rubric to assess student learning outcomes using a class assignment. Teach. Psychol., Thousand Oaks, v. 36, p. 113-116, 2009. DOI: https://doi.org/10.1080/00986280902739305. Disponível em: https://journals.sagepub.com/doi/10.1080/00986280902739305. Acesso em: 19 jul. 2021.

THORNE, S.; MENTZER, N.; BARTHOLOMEW, S.; STRIMEL, G. J. A systematic literature review of student evaluation of peer exemplars and implications for design, technology, and engineering learning. Int. J. Technol. Des. Educ., [S. l.], 2024. DOI: https://doi.org/10.1007/s10798-023-09874-2. Disponível em: https://link.springer.com/article/10.1007/s10798-023-09874-2. Acesso em: 20 jan. 2024.

TIERNEY, R.; SIMON, M. What’s still wrong with rubrics: focusing on the consistency of performance criteria. Pract. Assess. Res. & Eval., Boston, v. 9, n. 2, 2004. DOI: https://doi.org/10.7275/jtvt-wg68. Disponível em: https://openpublishing.library.umass.edu/pare/article/id/1531/. Acesso em: 19 jul. 2021.

TIO, F.; KONG, J.; LIM, R.; TEO, E. Developing and applying rubrics for comprehensive capstone project assessment. In: INTERNATIONAL CDIO CONFERENCE, 10., jun. 2014, Barcelona. Anais […]. Barcelona: Universitat Politécnica de Catalunya, 2014.

WOLF, K.; STEVENS, E. The role of rubrics in advancing and assessing student learning. J. Eff. Teach., [S. l.], v. 7, n. 1, p. 3-14, 2007.

ZANOTTO, M. A. C.; AUGUSTO, T. A.; SCURACCHIO, C. H. Uso de rubricas para avaliação formativa: uma experiência em período remoto no curso de Engenharia de Materiais da Universidade Federal de São Carlos. R. Ens. Eng., São Paulo, v. 42, p. 331-347, 2023. DOI: https://doi.org/10.37702/REE2236-0158.v42p331-347.2023. Disponível em: https://www.semanticscholar.org/paper/USO-DE-RUBRICAS-PARA-AVALIA%C3%87%C3%83O-FORMATIVA%3A-UMA-EM-NO-Zanotto-AUGUSTO/da9a79f7be324c43316006e4be0ecbfa21262d83. Acesso em: 19 jan. 2024.