Evaluation of the Effectiveness of Virtual Teaching Assistant in Online Collaborative Learning
Downloads
The rise of online learning has introduced various tools and technologies aimed at enhancing the learning experience, with virtual teaching assistants (VTAs) being one of the most prominent innovations. VTAs can support both students and instructors by providing real-time feedback, answering questions, and facilitating collaboration in online environments. However, the effectiveness of VTAs in fostering successful online collaborative learning experiences remains underexplored. This study evaluates the effectiveness of VTAs in online collaborative learning environments, focusing on their impact on student engagement, collaboration, and academic performance. A mixed-methods research design was employed, combining quantitative data from student performance assessments with qualitative feedback from surveys and interviews. The study involved 200 students across multiple online courses that integrated a VTA to support collaborative activities. Data was collected over the course of a semester. The results indicate that the use of VTAs significantly enhanced student engagement and collaboration, leading to improved academic performance. Students in the experimental group showed a 15% increase in collaboration scores and a 20% improvement in academic performance compared to the control group. This study concludes that VTAs can play a crucial role in improving the effectiveness of online collaborative learning by fostering greater student interaction, providing timely support, and enhancing learning outcomes.
Akram, H., & Li, S. (2024). Understanding the Role of Teacher-Student Relationships in Students’ Online Learning Engagement: Mediating Role of Academic Motivation. Perceptual and Motor Skills, 131(4), 1415–1438. Scopus. https://doi.org/10.1177/00315125241248709
Al-Emran, M. (2024). Unleashing the role of ChatGPT in Metaverse learning environments: Opportunities, challenges, and future research agendas. Interactive Learning Environments, 32(10), 7497–7506. Scopus. https://doi.org/10.1080/10494820.2024.2324326
Anand, B., & Yuxin, H. (2024). Play Testing and Reflective Learning AI Tool for Creative Media Courses. Dalam Poquet O., Ortega-Arranz A., Viberg O., Chounta I.-A., McLaren B., & Jovanovic J. (Ed.), International Conference on Computer Supported Education, CSEDU - Proceedings (Vol. 1, hlm. 146–158). Science and Technology Publications, Lda; Scopus. https://doi.org/10.5220/0012633600003693
Bharathyuvaraj, R., & Masilamani, V. (2024). Prospective Applications of Artificial Intelligence (AI) to Enhance Consistent Attention in First-Year Undergraduate Students in the Education Sector. IET. Conf. Proc., 2024(23), 136–140. Scopus. https://doi.org/10.1049/icp.2024.4414
Boateng, G., John, S., Boateng, S., Badu, P., Agyeman-Budu, P., & Kumbol, V. (2024). Real-World Deployment and Evaluation of Kwame for Science, an AI Teaching Assistant for Science Education in West Africa. Dalam Olney A.M., Chounta I.-A., Liu Z., Santos O.C., & Bittencourt I.I. (Ed.), Lect. Notes Comput. Sci.: Vol. 14830 LNAI (hlm. 119–133). Springer Science and Business Media Deutschland GmbH; Scopus. https://doi.org/10.1007/978-3-031-64299-9_9
Chen, D.-C., Hou, J.-C., & Zheng, Q.-D. (2024). The Empirical Research on the Impact of Applying VR Technology to Students’ Skill Learning in Machining Processing Courses on Questionnaire Evaluation. Dalam Cheng Y.-P., Pedaste M., Bardone E., & Huang Y.-M. (Ed.), Lect. Notes Comput. Sci.: Vol. 14786 LNCS (hlm. 97–107). Springer Science and Business Media Deutschland GmbH; Scopus. https://doi.org/10.1007/978-3-031-65884-6_10
De-La-Cruz-Vasquez, A., Flor-Cunza, H., Lara-Herrera, J., & Romero-Untiveros, L. (2024). Selection of the Best AI Educational Tool Applied to University-Level Teaching and Learning Process Using the AHP Methodology. Proc. - Int. Symp. Accredit. Eng. Comput. Educ., ICACIT. Proceedings - 10th International Symposium on Accreditation of Engineering and Computing Education, ICACIT 2024. Scopus. https://doi.org/10.1109/ICACIT62963.2024.10788591
Faúndez-Ugalde, A., Mellado-Silva, R., Aldunate-Lizana, E., & Escobar, J. B. (2024). The teaching-learning of law through virtual assistants: Main findings in undergraduate students. Revista Pedagogia Universitaria y Didactica del Derecho, 11(1), 31–48. Scopus. https://doi.org/10.5354/0719-5885.2024.69639
Granda, A. M., Roldán, A. F., & López, S. P. (2024). Virtual professor mentorship of higher education student professional practices in virtual learning environments. Formacion Universitaria, 17(6), 45–56. Scopus. https://doi.org/10.4067/S0718-50062024000600045
Hellen, N., Marvin, G., Balikuddembe, J. K., & Tulinayo, F. P. (2024). Strategic Utilization of ChatGPT in Teaching and Learning. Dalam Kumar R., Verma A.K., Verma O.P., & Wadehra T. (Ed.), Lect. Notes Networks Syst.: Vol. 971 LNNS (hlm. 129–139). Springer Science and Business Media Deutschland GmbH; Scopus. https://doi.org/10.1007/978-981-97-2089-7_12
Hindman, S., King, R., & Pereira, A. (2024). Virtual reality based executive function training in schools: The experience of primary school-aged children, teachers and training teaching assistants. Computers in Human Behavior Reports, 16. Scopus. https://doi.org/10.1016/j.chbr.2024.100500
Howell, B. M., & Peterson, J. (2024). Starting a university gerontology research laboratory: Experiences from researchers in public health and psychology. Gerontology and Geriatrics Education, 45(2), 166–179. Scopus. https://doi.org/10.1080/02701960.2022.2163245
Jain, V., Vishwakarma, S. K., & Shanbhag, A. (2024). Threat or Gift to Academic: A Case Study on ChatGPT. Dalam Kumar R., Verma A.K., Verma O.P., & Wadehra T. (Ed.), Lect. Notes Networks Syst.: Vol. 971 LNNS (hlm. 365–375). Springer Science and Business Media Deutschland GmbH; Scopus. https://doi.org/10.1007/978-981-97-2089-7_32
Jones, R., Kreppner, J., Marsh, F., & Hartwell, B. (2024). Supporting behaviour and emotions in school: An exploration into school staff perspectives on the journey from punitive approaches to relational-based approaches. Emotional and Behavioural Difficulties, 29(1–2), 82–98. Scopus. https://doi.org/10.1080/13632752.2024.2354021
Khaldi, M. (2025). Supporting personalized learning and students’ skill development with AI. Dalam Support. Pers. Learn. And Stud.’ Skill Dev. With AI (hlm. 472). IGI Global; Scopus. https://doi.org/10.4018/979-8-3693-8965-2
Lecon, C. (2024). Supporting Distributed Learning through Immersive Learning Environments. Athens Journal of Education, 11(3), 213–226. Scopus. https://doi.org/10.30958/aje.11-3-3
Lee, H. (2024). The rise of ChatGPT: Exploring its potential in medical education. Anatomical Sciences Education, 17(5), 926–931. Scopus. https://doi.org/10.1002/ase.2270
Lesselroth, B., Monkman, H., Liew, A., Palmer, R., Crosby, K., Kelly, D., Kollaja, L., Ijams, S., Rodriguez, K., Homco, J., & Wen, F. (2024). Simulating Telemedicine, Medication Reconciliation, and Social Determinants: A Novel Instructional Approach to Health Systems Competencies. Dalam Bichel-Findlay J., Otero P., Scott P., & Huesing E. (Ed.), Stud. Health Technol. Informatics (Vol. 310, hlm. 1201–1205). IOS Press BV; Scopus. https://doi.org/10.3233/SHTI231155
Li, Z., Qi, H., Sun, Z., Shi, C., & Zhu, D. (2024). Research on an Open and Shared Maker Space and Curriculum System. Dalam Babic S., Car Z., Cicin-Sain M., Cisic D., Ergovic P., Grbac T.G., Gradisnik V., Gros S., Jokic A., Jovic A., Jurekovic D., Katulic T., Koricic M., Mornar V., Petrovic J., Skala K., Skvorc D., Sruk V., Svaco M., … Vrdoljak B. (Ed.), ICT Electron. Conv., MIPRO - Proc. (hlm. 1234–1237). Institute of Electrical and Electronics Engineers Inc.; Scopus. https://doi.org/10.1109/MIPRO60963.2024.10569945
Liarokapis, F., Milata, V., Ponton, J. L., Pelechano, N., Zacharatos, H., Sousa Santos, B., Magana, A. J., & Bidarra, R. (2024). XR4ED: An Extended Reality Platform for Education. IEEE Computer Graphics and Applications, 44(4), 79–88. Scopus. https://doi.org/10.1109/MCG.2024.3406139
Lizano-Sánchez, F., Idoyaga, I., Orduña, P., Rodríguez-Gil, L., & Arguedas-Matarrita, C. (2025). Teachers’ perspective on the use of artificial intelligence on remote experimentation. Frontiers in Education, 10. Scopus. https://doi.org/10.3389/feduc.2025.1518896
Masters, K., Benjamin, J., Agrawal, A., MacNeill, H., Pillow, M. T., & Mehta, N. (2024). Twelve tips on creating and using custom GPTs to enhance health professions education. Medical Teacher, 46(6), 752–756. Scopus. https://doi.org/10.1080/0142159X.2024.2305365
Mirzayeva, D., Ortiqov, R., Usmonova, D., Nizomova, N., Makhmudova, N., & Karimjonova, S. (2024). The Ai Illustration in Shifting the Technical Education System to Digital Era. Int. Conf. Adv. Comput. Innov. Technol. Eng. ICACITE, 1521–1527. Scopus. https://doi.org/10.1109/ICACITE60783.2024.10617273
Neupane, A., Shahi, T. B., Cowling, M., & Tanna, D. (2024). Threading the GenAI needle: Unpacking the ups and downs of GenAI for higher education stakeholders. Journal of Applied Learning and Teaching, 7(2), 38–46. Scopus. https://doi.org/10.37074/jalt.2024.7.2.4
Nguyen, L. T. K., Pham, L. D., & Nguyen, H. N. (2024). uMentor: LLM-Powered Chatbot for Harnessing Technology Books in Digital Library. Dalam Nguyen N.-T., Kozierkiewicz A., Franczyk B., Ludwig A., Nunez M., Treur J., & Vossen G. (Ed.), Commun. Comput. Info. Sci.: Vol. 2165 CCIS (hlm. 232–244). Springer Science and Business Media Deutschland GmbH; Scopus. https://doi.org/10.1007/978-3-031-70248-8_18
Peng, S. (2024). Supporting transnational teaching in Finnish education export: Possibilities and limitations of using ChatGPT as a virtual assistant during short-erm teaching abroad. Innovations in Education and Teaching International. Scopus. https://doi.org/10.1080/14703297.2024.2413053
Rädel-Ablass, K., Schliz, K., Schlick, C., Meindl, B., Pahr-Hosbach, S., Schwendemann, H., Rupp, S., Roddewig, M., & Miersch, C. (2025). Teaching opportunities for anamnesis interviews through AI based teaching role plays: A survey with online learning students from health study programs. BMC Medical Education, 25(1). Scopus. https://doi.org/10.1186/s12909-025-06756-0
Rayaz, H., Yedavalli, V., Sair, H., Sharma, G., Rowan, N. R., Tackett, S., Infosino, A., Nabipour, S., Kothari, P., Levine, R., Ishii, M., Yousem, D., Agrawal, Y., Skarupski, K., Faraday, N., Lee, J. K., & Brady, M. (2024). Staying Virtual: A Survey Study of the Virtual Lecture Experience in Academic Medicine. Anesthesia and Analgesia, 138(5), 1020–1030. Scopus. https://doi.org/10.1213/ANE.0000000000006490
Sabic, I., Puljiz, H., & Smoljo, A. (2024). Personalized Learning in the Croatian National Education System: A Study of AI Implementation in the e-Class Register. SN Computer Science, 5(8). Scopus. https://doi.org/10.1007/s42979-024-03515-8
Sakib, S. J., Joy, B. K., Rydha, Z., Nuruzzaman, M., & Rasel, A. A. (2024). Virtual teaching assistant for undergraduate students using natural language processing & deep learning. Dalam Zakaria N.F., Ahmad M.F., Norizan M.N., Zakaria M.R.B., Oung Q.W., & Lee H.L. (Ed.), AIP Conf. Proc. (Vol. 2898, Nomor 1). American Institute of Physics Inc.; Scopus. https://doi.org/10.1063/5.0192090
Shah, M., Pankiewicz, M., Baker, R. S., Chi, J., Xin, Y., Shah, H., & Fonseca, D. (2025). Students’ Use of an LLM-Powered Virtual Teaching Assistant for Recommending Educational Applications of Games. Dalam Plass J.L. & Ochoa X. (Ed.), Lect. Notes Comput. Sci.: Vol. 15259 LNCS (hlm. 19–24). Springer Science and Business Media Deutschland GmbH; Scopus. https://doi.org/10.1007/978-3-031-74138-8_2
Situmorang, M., Munthe, L. B., Simanjuntak, H., Purba, J., Sinaga, M., Sitorus, M., & Sudrajat, A. (2024). The Design of a Virtual Laboratory for Electrophoretic Separation Analysis. Dalam Nasution R.F., Rahmadany S., Pertiwi A.D., Rajagukguk D.H., Sarumaha C., Rajagukguk S.P., Hariono null, Simanullang E., Sihombing L.W., Tambunan F.E.F., Batubara D.A., Sitanggang I.C., & Tinambunan F.F. (Ed.), J. Phys. Conf. Ser. (Vol. 2908, Nomor 1). Institute of Physics; Scopus. https://doi.org/10.1088/1742-6596/2908/1/012002
Villmore, D. L., Dyer, E. J., & Gugliucci, M. R. (2024). Teaching empathy: Comparison of a virtual reality experience using head-mounted display versus group streaming. Gerontology and Geriatrics Education. Scopus. https://doi.org/10.1080/02701960.2024.2328514
Wójcik, S., Rulkiewicz, A., Pruszczyk, P., Lisik, W., Pobo?y, M., & Domienik-Kar?owicz, J. (2024). Reshaping medical education: Performance of ChatGPT on a PES medical examination. Cardiology Journal, 31(3), 442–450. Scopus. https://doi.org/10.5603/cj.97517
Yarnall, R., Monkman, H., Akel, M., Mnajjed, L., Reddy, V., Taylor, L., Shachak, A., Homco, J., Liew, A., & Lesselroth, B. (2024). Teaching and Evaluating the Virtual Physical Exam in Telemedicine. Dalam Mantas J., Hasman A., Demiris G., Saranto K., Marschollek M., Arvanitis T.N., Ognjanovic I., Benis A., Gallos P., Zoulias E., & Andrikopoulou E. (Ed.), Stud. Health Technol. Informatics (Vol. 316, hlm. 1519–1523). IOS Press BV; Scopus. https://doi.org/10.3233/SHTI240704
Copyright (c) 2025 Aylin Erdogan, Sevda Kara, Hale Y?lmaz
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
