Exploring Trends in Education Program Evaluation Models in High Schools: Bibliometric Analysis
DOI:
https://doi.org/10.61227/arji.v7i3.519Keywords:
Program evaluation model, international collaboration, GenderAbstract
This study aims to analyze the program evaluation model applied in high school using a bibliometric approach integrated with interpretive analysis. The main problem identified was the importance of understanding the various evaluation models that are often applied in education and their influence on improving the quality of the program. The method used in this study is a bibliometric analysis by selecting 120 articles published between 1985 and 2024 from the Scopus database related to the evaluation of educational programs in secondary schools. Data was collected through a search for articles with relevant keywords, and an analysis was conducted to find thematic trends and collaborations between authors in this field. Data were analyzed using the prism method and the R Studio application with the Bibliometrix::biblioshiny() package to explore thematic trends, author collaboration networks, and conceptual structures. The results show that evaluation models, such as the Outcome-Mediation Cascade (OMC), TADIPHE, and EP_PISTdu, are increasingly relevant in complex educational contexts. The study also found the importance of gender elements in program evaluation, with a focus on equality between women and men. In addition, international collaborations between authors from different countries, such as the United States and Canada, are instrumental in enriching the quality of program evaluation research. This study suggests that the development of more innovative and relevant evaluation models should be carried out to increase the effectiveness of educational program evaluations in the future.
Downloads
References
Afriyani, A., Wahidah, I., & Wibowo, M. T. H. (2022). Bibliomatric Analysis: Development of Research Publication on "General Elections In Indonesia". Social Impact Journal, Vol. 1(No. 1).
Al-Alawi, R., & Alexander, G. L. (2020). Systematic review of program evaluation in baccalaureate nursing programs. In Journal of Professional Nursing (Vol. 36, Issue 4). https://doi.org/10.1016/j.profnurs.2019.12.003
Amahoroe, R. A. (2023). Evaluation of Classical Training at the Ambon Religious Training Center using The Kirkpatrick Evaluation Model. 12 Hydrau, 9(2). https://doi.org/10.47655/12waiheru.v9i2.166
Amouzou, A., Bryce, J., & Walker, N. (2022). Strengthening effectiveness evaluations to improve programs for women, children and adolescents. Global Health Action, 15(sup1). https://doi.org/10.1080/16549716.2021.2006423
Asrul, Ananda, R., & Rosinta. (2014). Evaluation of Piracy. In Ciptapustaka Media.
Binderkrantz, A. S., & Bisgaard, M. (2024). A gender affinity effect: the role of gender in teaching evaluations at a Danish university. Higher Education, 87(3). https://doi.org/10.1007/s10734-023-01025-9
Bindu, N., Sankar, C. P., & Kumar, K. S. (2019). Research collaboration and knowledge sharing in e-governance: Temporal analysis of co-author network. Transforming Government: People, Process and Policy, 13(1). https://doi.org/10.1108/TG-03-2018-0022
Blizniuk, A., Ueno, M., Furukawa, S., & Kawaguchi, Y. (2014). Evaluation of a Russian version of the oral health literacy instrument (OHLI). BMC Oral Health, 14(1). https://doi.org/10.1186/1472-6831-14-141
Brito, A. C. M., Silva, F. N., & Amancio, D. R. (2023). Analyzing the influence of prolific collaborations on authors productivity and visibility. Scientometrics, 128(4). https://doi.org/10.1007/s11192-023-04669-7
Browne, F., Hannigan, B., & Harden, J. (2021). A realist evaluation of a safe medication administration education programme. Nurse Education Today, 97. https://doi.org/10.1016/j.nedt.2020.104685
Chanthalangsy, P., Yeh, B. Il, Choi, S. J., & Park, Y. C. (2024). Program evaluation of postgraduate obstetrics and gynecology training in Lao people's democratic republic - using the CIPP model. BMC Medical Education, 24(1). https://doi.org/10.1186/s12909-023-04942-6
D'Inverno, G., Smet, M., & De Witte, K. (2021). Impact evaluation in a multi-input multi-output setting: Evidence on the effect of additional resources for schools. European Journal of Operational Research, 290(3). https://doi.org/10.1016/j.ejor.2020.08.042
Dolor, R. J., Ruybalid, R. L., Uyeda, L., Edson, R. G., Phibbs, C., Vertrees, J. E., Shih, M. C., Jacobson, A. K., & Matchar, D. B. (2010). An evaluation of patient self-testing competency of prothrombin time for managing anticoagulation: pre-randomization results of VA Cooperative Study #481--The Home INR Study (THINRS). Journal of Thrombosis and Thrombolysis, 30(3), 263–275. https://doi.org/10.1007/s11239-010-0499-8
Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133. https://doi.org/10.1016/j.jbusres.2021.04.070
Ellegaard, O., & Wallin, J. A. (2015). The bibliometric analysis of scholarly production: How great is the impact? Scientometrics, 105(3). https://doi.org/10.1007/s11192-015-1645-z
Fu, Y., Mao, Y., Jiang, S., Luo, S., Chen, X., & Xiao, W. (2023). A bibliometric analysis of systematic reviews and meta-analyses in ophthalmology. Frontiers in Medicine, 10. https://doi.org/10.3389/fmed.2023.1135592
Gençoğlu, C. (2019). Remedial Education Programme: As A National Catch-Up And Remedial Education Model. Egitim Mill, 48(1), 853–881. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85105112375&partnerID=40&md5=73f7f6c4d5aa6a6f7af4a8ed70af8f49
Guo, Y. M., Huang, Z. L., Guo, J., Li, H., Guo, X. R., & Nkeli, M. J. (2019). Bibliometric analysis on smart cities research. Sustainability (Switzerland), 11(13). https://doi.org/10.3390/su11133606
Guyadeen, D., & Seasons, M. (2018). Evaluation Theory and Practice: Comparing Program Evaluation and Evaluation in Planning. In Journal of Planning, Education and Research (Vol. 38, Issue 1). https://doi.org/10.1177/0739456X16675930
Hidayah, N., & Romelah, R. (2022). Evaluation of Learning at Aisyiyah Kindergarten Bustanul Athfal II, Berau Regency. Journal of Obsession: Journal of Early Childhood Education, 6(5). https://doi.org/10.31004/obsesi.v6i5.2770
January, N. (2024). Systematic Literature Review Using the Prism Method: The Impact of Blockchain Technology on Digital Advertising. M-Progress Scientific Journal, 14(1), 1–11. https://doi.org/10.35968/m-pu.v14i1.1182
Jáuregui, A., Pacheco-Miranda, S., Argumedo-García, G., Marrón-Ponce, J. A., G.-Olvera, A., Vargas-Meza, J., Ayvar-Gama, Y. Y., Velázquez, D., David Quezada, A., & Bonvecchio-Arenas, A. (2022). Comprehensive evaluation of Salud Escolar a health school program in Mexico: Rationale, design and methods. Preventive Medicine Reports, 25. https://doi.org/10.1016/j.pmedr.2021.101662
Kania, N., Rais, R., Manoppo, Y., Yusron, A., Zega, Y., Nurbaya, Nuraeni, Z., Ahmad, Munif, A., Sulfiati, Y., Anas, Suwenti, R., Maghfirah, G., Listiani, H., Dedi, & Mursidin. (2023). Educational Evaluation (A Critical Review). In Edupedia Publisher.
Kelloway, E. K., Dimoff, J. K., & Gilbert, S. (2023). Mental Health in the Workplace. In Annual Review of Organizational Psychology and Organizational Behavior (Vol. 10). https://doi.org/10.1146/annurev-orgpsych-120920-050527
Khan, M. A. (2022). ESG disclosure and Firm performance: A bibliometric and meta analysis. In Research in International Business and Finance (Vol. 61). https://doi.org/10.1016/j.ribaf.2022.101668
Liu, W., Xu, C., Peng, Y., & Xu, X. (2023). Evolution of Tourism Risk Communication: A Bibliometric Analysis and Meta-Analysis of the Antecedents of Communicating Risk to Tourists. Sustainability (Switzerland), 15(12). https://doi.org/10.3390/su15129693
Mustofa, I., Kuswara, H., Rosmawati, R., & Rosmika, E. (2023). Evaluation of Computer Training Programs Using Kirkpatrick Models to Increase the Competency Capacity of Drinking Teachers. Nidhomul Haq : Journal of Islamic Education Management, 8(2). https://doi.org/10.31538/ndh.v8i2.3778
Nouraey, P., Al-Badi, A., Riasati, M. J., & Martha, R. L. (2020). Educational Program and Curriculum Evaluation Models: A Mini Systematic Review of the Recent Trends. In Universal Journal of Educational Research (Vol. 8, Issue 9). https://doi.org/10.13189/ujer.2020.080930
Park, S.-E., & Tang, L. (2019). How colour and visual complexity affect the evaluation of skin cancer infographics: an experiment study. Journal of Visual Communication in Medicine, 42(2), 52–65. https://doi.org/10.1080/17453054.2019.1573633
Saeed, S., Chand, P., Sulaiman, A., Nisar, I., Humayun, K. N., Malik, M. G. R., & Jehan, F. (2023). Process evaluation of paediatric fellowship training programs at a University Hospital in Pakistan. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04501-z
Sahu, M. K., G. K., C., & Panda, S. P. (2020). Research Trends on Coronavirus (Covid-19): A Bibliomatric Analysis between 2010–March, 2020. Library Philosophy and Practice, 2020.
Schlickmann, A., & Bortoluzzi, S. C. (2023). Environmental Education Performance Evaluation in a Higher Education Institution. Systemic Practice and Action Research, 36(6). https://doi.org/10.1007/s11213-023-09636-0
Sell, K., Oliver, K., & Meiksin, R. (2023). Comprehensive Sex Education Addressing Gender and Power: A Systematic Review to Investigate Implementation and Mechanisms of Impact. Sexuality Research and Social Policy, 20(1). https://doi.org/10.1007/s13178-021-00674-8
Tang, J., & Hai, L. (2021). Construction and Exploration of an Intelligent Evaluation System for Educational APP through Artificial Intelligence Technology. International Journal of Emerging Technologies in Learning, 16(5). https://doi.org/10.3991/ijet.v16i05.20293
Tigre, F. B., Curado, C., & Henriques, P. L. (2023). Digital Leadership: A Bibliometric Analysis. Journal of Leadership and Organizational Studies, 30(1). https://doi.org/10.1177/15480518221123132
Vaiopoulou, J., Papadakis, S., Sifaki, E., Kalogiannakis, M., & Stamovlasis, D. (2023). Classification and evaluation of educational apps for early childhood: Security matters. Education and Information Technologies, 28(3). https://doi.org/10.1007/s10639-022-11289-w
Vieira, E. A. O., Silveira, A. C. da, & Martins, R. X. (2019). Heuristic evaluation on usability of educational games: A systematic review. Informatics in Education, 18(2). https://doi.org/10.15388/infedu.2019.20
Watt, M. (2017). An evaluation of the Australian Government's Students First agenda for strengthening the curriculum. Curriculum Perspectives, 37(2), 161–170. https://doi.org/10.1007/s41297-017-0008-8
Weinkle, L. J., Stratford, J. M., & Lee, L. M. J. (2020). Voice in Digital Education: The Impact of Instructor's Perceived Age and Gender on Student Learning and Evaluation. Anatomical Sciences Education, 13(1). https://doi.org/10.1002/ase.1865
Wu, Y., Venkatramanan, S., & Chiu, D. M. (2016). Research collaboration and topic trends in Computer Science based on top active authors. PeerJ Computer Science, 2016(1). https://doi.org/10.7717/peerj-cs.41
Yangari, M., & Inga, E. (2021). Article educational innovation in the evaluation processes within the flipped and blended learning models. Education Sciences, 11(9). https://doi.org/10.3390/educsci11090487
Yasin, A. M. Al, Shehah, A. Al, Cherian, S., & Aitchison, M. E. (2023). Program Evaluation: Nursing Informatics Structured Training Program. Saudi Journal of Nursing and
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Authors
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
