ONLINE VS FACE TO FACE TRAINING
RETHINKING IMPACT AND EFFECTIVENESS
DOI:
https://doi.org/10.54583/apic.vol9.no1.261Keywords:
training, effectiveness, online, face-to-faceAbstract
The emergence of digital learning in training has made the necessity to rethink the approaches used to measure the effectiveness of training more pressing, primarily due to the popularity of metrics focused on satisfaction. The current study explores the satisfaction-effectiveness gap associated with such an approach to assessing training efficiency by comparing online (Pelatihan Jarak Jauh/PJJ) training programs with traditional face-to-face training. In particular, the study integrates the Indeks Kepuasan Masyarakat (IKM) approach to assessment with the well-known model of Kirkpatrick and uses data triangulation from participants, trainers, and supervisors at the Religious Education and Training Centers in Medan, Indonesia. The findings show that the IKM index diverges from other aspects of training: PJJ is associated with greater satisfaction (IKM > 94) than face-to-face programs (IKM ≈ 89), but is not followed by improvements in behavior change or performance improvement among the trainees. At the same time, face-to-face training proves to be significantly more effective in terms of both behavioral changes and improvement in performance despite the lower degree of participant satisfaction. Overall, participant satisfaction seems to be determined more by the convenience and availability of training than its actual impact on the effectiveness of performance. Therefore, this finding calls into question the focus on the first level of measurement proposed by Kirkpatrick and suggests a move to behavior and outcome-based frameworks of assessment in the area of public administration.
References
Azra, A. (2020). History and Dynamics of Diversity in Indonesia. Jakarta: Gramedia.
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2023). Transfer of training: A meta-analytic review and future research directions. Journal of Management, 49(1), 1–35.
Bond, M., Bedenlier, S., Marín, V. I., & Händel, M. (2023). Emergency remote teaching in higher education: Mapping the first global online semester. International Journal of Educational Technology in Higher Education, 20(1), 1–24.
Field, A. (2023). Discovering statistics using IBM SPSS statistics (6th ed.). Sage Publications.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2022). Multivariate data analysis (8th ed.). Cengage Learning.
Hayes, A. F. (2022). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach (3rd ed.). Guilford Press.
Johnston, M. P. (2023). Secondary data analysis: A method of which the time has come. Qualitative and Quantitative Methods in Libraries, 12(1), 1–15.
Kim, J., Park, Y., & Cozart, J. (2023). Examining the role of learner engagement in online learning effectiveness. Computers & Education, 191, 104642Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.
Kraiger, K., & Ford, J. K. (2022). The science of workplace instruction: Learning and development applied. Annual Review of Organizational Psychology and Organizational Behavior, 9, 1–28.
Lim, J., & Richardson, J. C. (2024). Exploring learner engagement in online learning environments: A meta-analytic approach. Computers & Education, 200, 104800.
Martin, F., Sun, T., & Westine, C. D. (2022). A systematic review of research on online teaching and learning. Computers & Education, 159, 104009.
Nguyen, T., & Habók, A. (2024). Digital learning and training effectiveness: A systematic review of recent evidence. Educational Research Review, 42, 100580.
OECD. (2024). Skills development in the public sector: Trends and challenges in digital training. OECD Publishing.
Park, S., & Kim, S. (2024). The impact of online learning environments on behavioral change: Evidence from public sector training. Public Personnel Management, 53(1), 45–67.
Rapanta, C., Botturi, L., Goodyear, P., Guàrdia, L., & Koole, M. (2022). Online university teaching during and after the COVID-19 crisis. Postdigital Science and Education, 4(1), 923–945.
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2023). The science of training and development in organizations. Psychological Science in the Public Interest, 24(1), 1–52.
Sitzmann, T., & Weinhardt, J. M. (2022). Training engagement theory: A multilevel perspective. Journal of Management, 48(3), 732–765.
Smith, A. (2022). The strengths and limitations of secondary data research. Journal of Applied Social Science, 16(2), 45–60.
World Bank. (2025). Digital transformation and public sector capacity building. World Bank Publications.
Zhang, W., Wang, Y., Yang, L., & Wang, C. (2022). Suspending classes without stopping learning. Journal of Risk and Financial Management, 15(2), 55.
