Exploring Trends in Education Program Evaluation Models in High Schools: Bibliometric Analysis

Authors

  • Mariano Dos Santos Istituto Católico para a Formação de Professores (ICFP) Baucau
  • Ahmad Ahmad Universitas Bumigora Mataram

DOI:

https://doi.org/10.61227/arji.v7i3.519

Keywords:

Program evaluation model, international collaboration, Gender

Abstract

This study aims to analyze the program evaluation model applied in high school using a bibliometric approach integrated with interpretive analysis. The main problem identified was the importance of understanding the various evaluation models that are often applied in education and their influence on improving the quality of the program. The method used in this study is a bibliometric analysis by selecting 120 articles published between 1985 and 2024 from the Scopus database related to the evaluation of educational programs in secondary schools. Data was collected through a search for articles with relevant keywords, and an analysis was conducted to find thematic trends and collaborations between authors in this field. Data were analyzed using the prism method and the R Studio application with the Bibliometrix::biblioshiny() package to explore thematic trends, author collaboration networks, and conceptual structures. The results show that evaluation models, such as the Outcome-Mediation Cascade (OMC), TADIPHE, and EP_PISTdu, are increasingly relevant in complex educational contexts. The study also found the importance of gender elements in program evaluation, with a focus on equality between women and men. In addition, international collaborations between authors from different countries, such as the United States and Canada, are instrumental in enriching the quality of program evaluation research. This study suggests that the development of more innovative and relevant evaluation models should be carried out to increase the effectiveness of educational program evaluations in the future.

Downloads

Download data is not yet available.

References

Afriyani, A., Wahidah, I., & Wibowo, M. T. H. (2022). Bibliomatric Analysis: Development of Research Publication on "General Elections In Indonesia". Social Impact Journal, Vol. 1(No. 1).

Al-Alawi, R., & Alexander, G. L. (2020). Systematic review of program evaluation in baccalaureate nursing programs. In Journal of Professional Nursing (Vol. 36, Issue 4). https://doi.org/10.1016/j.profnurs.2019.12.003

Amahoroe, R. A. (2023). Evaluation of Classical Training at the Ambon Religious Training Center using The Kirkpatrick Evaluation Model. 12 Hydrau, 9(2). https://doi.org/10.47655/12waiheru.v9i2.166

Amouzou, A., Bryce, J., & Walker, N. (2022). Strengthening effectiveness evaluations to improve programs for women, children and adolescents. Global Health Action, 15(sup1). https://doi.org/10.1080/16549716.2021.2006423

Asrul, Ananda, R., & Rosinta. (2014). Evaluation of Piracy. In Ciptapustaka Media.

Binderkrantz, A. S., & Bisgaard, M. (2024). A gender affinity effect: the role of gender in teaching evaluations at a Danish university. Higher Education, 87(3). https://doi.org/10.1007/s10734-023-01025-9

Bindu, N., Sankar, C. P., & Kumar, K. S. (2019). Research collaboration and knowledge sharing in e-governance: Temporal analysis of co-author network. Transforming Government: People, Process and Policy, 13(1). https://doi.org/10.1108/TG-03-2018-0022

Blizniuk, A., Ueno, M., Furukawa, S., & Kawaguchi, Y. (2014). Evaluation of a Russian version of the oral health literacy instrument (OHLI). BMC Oral Health, 14(1). https://doi.org/10.1186/1472-6831-14-141

Brito, A. C. M., Silva, F. N., & Amancio, D. R. (2023). Analyzing the influence of prolific collaborations on authors productivity and visibility. Scientometrics, 128(4). https://doi.org/10.1007/s11192-023-04669-7

Browne, F., Hannigan, B., & Harden, J. (2021). A realist evaluation of a safe medication administration education programme. Nurse Education Today, 97. https://doi.org/10.1016/j.nedt.2020.104685

Chanthalangsy, P., Yeh, B. Il, Choi, S. J., & Park, Y. C. (2024). Program evaluation of postgraduate obstetrics and gynecology training in Lao people's democratic republic - using the CIPP model. BMC Medical Education, 24(1). https://doi.org/10.1186/s12909-023-04942-6

D'Inverno, G., Smet, M., & De Witte, K. (2021). Impact evaluation in a multi-input multi-output setting: Evidence on the effect of additional resources for schools. European Journal of Operational Research, 290(3). https://doi.org/10.1016/j.ejor.2020.08.042

Dolor, R. J., Ruybalid, R. L., Uyeda, L., Edson, R. G., Phibbs, C., Vertrees, J. E., Shih, M. C., Jacobson, A. K., & Matchar, D. B. (2010). An evaluation of patient self-testing competency of prothrombin time for managing anticoagulation: pre-randomization results of VA Cooperative Study #481--The Home INR Study (THINRS). Journal of Thrombosis and Thrombolysis, 30(3), 263–275. https://doi.org/10.1007/s11239-010-0499-8

Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133. https://doi.org/10.1016/j.jbusres.2021.04.070

Ellegaard, O., & Wallin, J. A. (2015). The bibliometric analysis of scholarly production: How great is the impact? Scientometrics, 105(3). https://doi.org/10.1007/s11192-015-1645-z

Fu, Y., Mao, Y., Jiang, S., Luo, S., Chen, X., & Xiao, W. (2023). A bibliometric analysis of systematic reviews and meta-analyses in ophthalmology. Frontiers in Medicine, 10. https://doi.org/10.3389/fmed.2023.1135592

Gençoğlu, C. (2019). Remedial Education Programme: As A National Catch-Up And Remedial Education Model. Egitim Mill, 48(1), 853–881. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85105112375&partnerID=40&md5=73f7f6c4d5aa6a6f7af4a8ed70af8f49

Guo, Y. M., Huang, Z. L., Guo, J., Li, H., Guo, X. R., & Nkeli, M. J. (2019). Bibliometric analysis on smart cities research. Sustainability (Switzerland), 11(13). https://doi.org/10.3390/su11133606

Guyadeen, D., & Seasons, M. (2018). Evaluation Theory and Practice: Comparing Program Evaluation and Evaluation in Planning. In Journal of Planning, Education and Research (Vol. 38, Issue 1). https://doi.org/10.1177/0739456X16675930

Hidayah, N., & Romelah, R. (2022). Evaluation of Learning at Aisyiyah Kindergarten Bustanul Athfal II, Berau Regency. Journal of Obsession: Journal of Early Childhood Education, 6(5). https://doi.org/10.31004/obsesi.v6i5.2770

January, N. (2024). Systematic Literature Review Using the Prism Method: The Impact of Blockchain Technology on Digital Advertising. M-Progress Scientific Journal, 14(1), 1–11. https://doi.org/10.35968/m-pu.v14i1.1182

Jáuregui, A., Pacheco-Miranda, S., Argumedo-García, G., Marrón-Ponce, J. A., G.-Olvera, A., Vargas-Meza, J., Ayvar-Gama, Y. Y., Velázquez, D., David Quezada, A., & Bonvecchio-Arenas, A. (2022). Comprehensive evaluation of Salud Escolar a health school program in Mexico: Rationale, design and methods. Preventive Medicine Reports, 25. https://doi.org/10.1016/j.pmedr.2021.101662

Kania, N., Rais, R., Manoppo, Y., Yusron, A., Zega, Y., Nurbaya, Nuraeni, Z., Ahmad, Munif, A., Sulfiati, Y., Anas, Suwenti, R., Maghfirah, G., Listiani, H., Dedi, & Mursidin. (2023). Educational Evaluation (A Critical Review). In Edupedia Publisher.

Kelloway, E. K., Dimoff, J. K., & Gilbert, S. (2023). Mental Health in the Workplace. In Annual Review of Organizational Psychology and Organizational Behavior (Vol. 10). https://doi.org/10.1146/annurev-orgpsych-120920-050527

Khan, M. A. (2022). ESG disclosure and Firm performance: A bibliometric and meta analysis. In Research in International Business and Finance (Vol. 61). https://doi.org/10.1016/j.ribaf.2022.101668

Liu, W., Xu, C., Peng, Y., & Xu, X. (2023). Evolution of Tourism Risk Communication: A Bibliometric Analysis and Meta-Analysis of the Antecedents of Communicating Risk to Tourists. Sustainability (Switzerland), 15(12). https://doi.org/10.3390/su15129693

Mustofa, I., Kuswara, H., Rosmawati, R., & Rosmika, E. (2023). Evaluation of Computer Training Programs Using Kirkpatrick Models to Increase the Competency Capacity of Drinking Teachers. Nidhomul Haq : Journal of Islamic Education Management, 8(2). https://doi.org/10.31538/ndh.v8i2.3778

Nouraey, P., Al-Badi, A., Riasati, M. J., & Martha, R. L. (2020). Educational Program and Curriculum Evaluation Models: A Mini Systematic Review of the Recent Trends. In Universal Journal of Educational Research (Vol. 8, Issue 9). https://doi.org/10.13189/ujer.2020.080930

Park, S.-E., & Tang, L. (2019). How colour and visual complexity affect the evaluation of skin cancer infographics: an experiment study. Journal of Visual Communication in Medicine, 42(2), 52–65. https://doi.org/10.1080/17453054.2019.1573633

Saeed, S., Chand, P., Sulaiman, A., Nisar, I., Humayun, K. N., Malik, M. G. R., & Jehan, F. (2023). Process evaluation of paediatric fellowship training programs at a University Hospital in Pakistan. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04501-z

Sahu, M. K., G. K., C., & Panda, S. P. (2020). Research Trends on Coronavirus (Covid-19): A Bibliomatric Analysis between 2010–March, 2020. Library Philosophy and Practice, 2020.

Schlickmann, A., & Bortoluzzi, S. C. (2023). Environmental Education Performance Evaluation in a Higher Education Institution. Systemic Practice and Action Research, 36(6). https://doi.org/10.1007/s11213-023-09636-0

Sell, K., Oliver, K., & Meiksin, R. (2023). Comprehensive Sex Education Addressing Gender and Power: A Systematic Review to Investigate Implementation and Mechanisms of Impact. Sexuality Research and Social Policy, 20(1). https://doi.org/10.1007/s13178-021-00674-8

Tang, J., & Hai, L. (2021). Construction and Exploration of an Intelligent Evaluation System for Educational APP through Artificial Intelligence Technology. International Journal of Emerging Technologies in Learning, 16(5). https://doi.org/10.3991/ijet.v16i05.20293

Tigre, F. B., Curado, C., & Henriques, P. L. (2023). Digital Leadership: A Bibliometric Analysis. Journal of Leadership and Organizational Studies, 30(1). https://doi.org/10.1177/15480518221123132

Vaiopoulou, J., Papadakis, S., Sifaki, E., Kalogiannakis, M., & Stamovlasis, D. (2023). Classification and evaluation of educational apps for early childhood: Security matters. Education and Information Technologies, 28(3). https://doi.org/10.1007/s10639-022-11289-w

Vieira, E. A. O., Silveira, A. C. da, & Martins, R. X. (2019). Heuristic evaluation on usability of educational games: A systematic review. Informatics in Education, 18(2). https://doi.org/10.15388/infedu.2019.20

Watt, M. (2017). An evaluation of the Australian Government's Students First agenda for strengthening the curriculum. Curriculum Perspectives, 37(2), 161–170. https://doi.org/10.1007/s41297-017-0008-8

Weinkle, L. J., Stratford, J. M., & Lee, L. M. J. (2020). Voice in Digital Education: The Impact of Instructor's Perceived Age and Gender on Student Learning and Evaluation. Anatomical Sciences Education, 13(1). https://doi.org/10.1002/ase.1865

Wu, Y., Venkatramanan, S., & Chiu, D. M. (2016). Research collaboration and topic trends in Computer Science based on top active authors. PeerJ Computer Science, 2016(1). https://doi.org/10.7717/peerj-cs.41

Yangari, M., & Inga, E. (2021). Article educational innovation in the evaluation processes within the flipped and blended learning models. Education Sciences, 11(9). https://doi.org/10.3390/educsci11090487

Yasin, A. M. Al, Shehah, A. Al, Cherian, S., & Aitchison, M. E. (2023). Program Evaluation: Nursing Informatics Structured Training Program. Saudi Journal of Nursing and

Additional Files

Published

2025-08-01

 

How to Cite

Dos Santos, M., & Ahmad, A. (2025). Exploring Trends in Education Program Evaluation Models in High Schools: Bibliometric Analysis . Action Research Journal Indonesia (ARJI), 7(3), 1755 – 1574. https://doi.org/10.61227/arji.v7i3.519

Issue

Vol. 7 No. 3 (2025): Action Research Journal Indonesia (ARJI)

Section

Articles

License

Copyright (c) 2025 Authors

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Similar Articles

<< < 4 5 6 7 8 9 10 11 12 13 > >> 

You may also start an advanced similarity search for this article.