Research Article

Psychometric properties of information and communication technology competencies scale: Latent profile analysis

Sergei P. Zhdanov 1 , Lilia M. Sadrieva 2 , Igor A. Astakhov 3 , Natalia L. Sokolova 4 , Elena E. Grishnova 5 , Larisa I. Tararina 6 7 *
More Detail
1 Plekhanov Russian University of Economics, Moscow, RUSSIA2 Almetyevsk State Oil Institute, Almetyevsk, RUSSIA3 Department of Pedagogy, MGIMO University, Moscow, RUSSIA4 Peoples’ Friendship University of Russia (RUDN University), Moscow, RUSSIA5 Bauman Moscow State Technical University, Moscow, RUSSIA6 Moscow Institute of Physics and Technology, Moscow, RUSSIA7 Russian State Social University, Moscow, RUSSIA* Corresponding Author
Online Journal of Communication and Media Technologies, 13(4), October 2023, e202345, https://doi.org/10.30935/ojcmt/13479
Published Online: 14 July 2023, Published: 01 October 2023
OPEN ACCESS   1765 Views   1235 Downloads
Download Full Text (PDF)

ABSTRACT

Rapid expansion of information and communication technologies (ICT) underscores importance of ICT competency for success in modern society. In education, ICT facilitates knowledge acquisition, innovative teaching methods, and development of digital literacy skills. By measuring ICT competencies, teacher training programs can better equip educators for technology integration, leading to more effective teaching and learning processes. It is crucial for educational policies to emphasize integration of ICT and ensure teachers are prepared to utilize it effectively. The study aims to determine psychometric properties of “information and communication technology competency scale (ICTCS)” for pre-service teachers (PSTs) in the Russian setting and identify distinct proficiency levels among them. This study employed a mixed-methods approach to adapt a scale measuring PSTs’ ICT competencies. The research involved two different samples for exploratory factor analysis (EFA) (n=160) and confirmatory factor analysis (CFA) (n=326). To establish language validity, a translation, and cross-cultural adaptation process was followed. Data analysis included EFA, CFA, reliability estimation, and latent profile analysis, with satisfactory results obtained for scale’s psychometric properties. The study concludes that ICTCS, with two factors (ICTC-PU and ICTC-ID), is a valid and reliable measure of teachers’ attitudes and skills regarding ICT use. Four-class latent profile model reveals distinct competence levels, informing targeted professional development programs. Educational institutions and policymakers should prioritize these programs and use the scale for teacher evaluations. Future research should explore the efficacy of these programs, expand the sample size, incorporate objective measures, and employ longitudinal designs to better understand the impact on student outcomes.
Keywords: adaptation of ICTCS, latent profile analysis, pre-service teachers’ ICT competence

CITATION (APA)

Zhdanov, S. P., Sadrieva, L. M., Astakhov, I. A., Sokolova, N. L., Grishnova, E. E., & Tararina, L. I. (2023). Psychometric properties of information and communication technology competencies scale: Latent profile analysis. Online Journal of Communication and Media Technologies, 13(4), e202345. https://doi.org/10.30935/ojcmt/13479

REFERENCES

  1. Abbasova, L. I., Zotova, I. V., & Mustafaeva, Z. I. (2021). The technology of formation of future teachers’ information culture. SHS Web of Conferences, 113, 00051. https://doi.org/10.1051/shsconf/202111300051
  2. Adam, F., & Ray, G. (2020). The role of information and communication technology (ICT) in enhancing the innovative learning process. IAIC Transactions on Sustainable Digital Innovation, 2(1), 54-60. https://doi.org/10.34306/itsdi.v2i1.352
  3. Aesaert, K., Van Nijlen, D., Vanderlinde, R., & Van Braak, J. (2014). Direct measures of digital information processing and communication skills in primary education: Using item response theory for the development and validation of an ICT competence scale. Computers and Education, 76, 168-181. https://doi.org/10.1016/j.compedu.2014.03.013
  4. Agasisti, T., Gil-Izquierdo, M., & Han, S. W. (2020). ICT Use at home for school-related tasks: What is the effect on a student’s achievement? Empirical evidence from OECD PISA data. Education Economics, 28(6), 601-620. https://doi.org/10.1080/09645292.2020.1822787
  5. Aliaga-Tovar, J., Ponce-Díaz, C., & Salas-Blas, E. (2018). Psychometric analysis of the self-efficacy inventory for multiple intelligences-revised (SIMI-R) in Peruvian high school students. Propósitos y Representaciones [Purposes and Representations], 6, 95-124. https://doi.org/10.20511/pyr2018.v6n2.249
  6. Alkan, M. F., & Emmioglu Sarikaya, E. (2018). Adaptation of preservice teachers’ information and communication technology competencies scale into Turkish culture. Bartın Üniversitesi Eğitim Fakültesi Dergisi, 7(2), 665-691. https://doi.org/10.14686/buefad.375745
  7. Arushanyan, Y., Ekener-Petersen, E., Moberg, Å., & C. Coroama, V. (2015). A framework for sustainability assessment of ICT futures. Scenarios and sustainability impacts of future ICT-societies. In Proceedings of EnviroInfo and ICT for Sustainability 2015 (pp. 1-9). https://doi.org/10.2991/ict4s-env-15.2015.1
  8. Aslan, A., & Zhu, C. (2017). Investigating variables predicting Turkish pre-service teachers’ integration of ICT into teaching practices. British Journal of Educational Technology, 48(2), 552-570. https://doi.org/10.1111/bjet.12437
  9. Baez Zarabanda, D. E. (2019). ICT and its purpose in the pedagogical practice. Research in Social Sciences and Technology, 4(2), 83-95. https://doi.org/10.46303/ressat.04.02.6
  10. Bauer, J. (2022). A Primer to latent profile and latent class analysis. In M. Goller, E. Kyndt, S. Paloniemi, & C. Damşa (Eds.), Professional and practice-based learning (pp. 243-268). Springer. https://doi.org/10.1007/978-3-031-08518-5_11
  11. Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(4), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014
  12. Braslauskienė, R., Šmitienė, G., & Vismantienė, R. (2017). Primary school teachers’ approach to advantages of ICT use in education. Society Integration Education. Proceedings of the International Scientific Conference, 3, 439. https://doi.org/10.17770/sie2017vol3.2241
  13. Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.
  14. Chen, F., Gorbunova, N. V., Masalimova, A. R., & Bírová, J. (2017). Formation of ICT-competence of future university schoolteachers. EURASIA Journal of Mathematics, Science and Technology Education, 13(8), 4765-4777. https://doi.org/10.12973/eurasia.2017.00963a
  15. Churchill, N. (2020). Development of students’ digital literacy skills through digital storytelling with mobile devices. Educational Media International, 57(3), 271-284. https://doi.org/10.1080/09523987.2020.1833680
  16. García-Martín, J., & García-Sánchez, J. N. (2017). Pre-service teachers’ perceptions of the competence dimensions of digital literacy and of psychological and educational measures. Computers and Education, 107, 54-67. https://doi.org/10.1016/j.compedu.2016.12.010
  17. Gómez-Trigueros, I. M., Ruiz-Bañuls, M., & Ortega-Sánchez, D. (2019). Digital literacy of teachers in training: Moving from ICTS (information and communication technologies) to LKTS (learning and knowledge technologies). Education Sciences, 9(4), 274. https://doi.org/10.3390/educsci9040274
  18. Guillén-Gámez, F. D., Lugones, A., Mayorga-Fernández, M. J., & Wang, S. (2019). ICT use by pre-service foreign languages teachers according to gender, age, and motivation. Cogent Education, 6(1), 1-17. https://doi.org/10.1080/2331186X.2019.1574693
  19. Gulavani, U. T., & Joshi, M. (2012). ICT in higher education: Review of literature from the period 2004-2011. International Journal of Innovation, Management and Technology, 3(1), 20-23.
  20. Gunduz, S. (2020). Investigation of the relationship between pre-service teachers’ perceptions of education and support for ICT and ICT competencies. Malaysian Online Journal of Educational Technology, 8(2), 28-42. https://doi.org/10.17220/mojet.2020.02.003
  21. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. Pearson.
  22. Harrington, D. (2009). Confirmatory factor analysis (pocket guides to social work). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195339888.003.0004
  23. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
  24. Huda, I., Yulisman, H., Evtia Nurina, C. I., Erni, F., & Abdullah, D. (2018). Investigating pre-service teachers about their competencies, experiences, and attitudes towards technology integration. Journal of Physics: Conference Series, 1114, 012033. https://doi.org/10.1088/1742-6596/1114/1/012033
  25. Istenic Starcic, A., & Bagon, S. (2014). ICT-supported learning for inclusion of people with special needs: Review of seven educational technology journals, 1970-2011. British Journal of Educational Technology, 45(2), 202-230. https://doi.org/10.1111/bjet.12086
  26. Jackson, D. L., Gillaspy, J. A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6-23. https://doi.org/10.1037/a0014694
  27. Jedrinović, S., Ferk Savec, V., & Rugelj, J. (2019). Innovative and flexible approaches to teaching and learning with ICT. In T. Väljataga, & M. Laanpere (Eds.), Digital turn in schools–Research, policy, practice (pp. 171-186). Springer. https://doi.org/10.1007/978-981-13-7361-9_12
  28. Kline, R. B. (2016). Principles and practice of structural equation modeling. Canadian Graduate Journal of Sociology and Criminology, 1(1), 305. https://doi.org/10.15353/cgjsc-rcessc.v1i1.25
  29. Mallidis-Malessas, P., Iatraki, G., & Mikropoulos, T. A. (2022). Teaching physics to students with intellectual disabilities using digital learning objects. Journal of Special Education Technology, 37(4), 510-522. https://doi.org/10.1177/01626434211054441
  30. Matviyevskaya, E. G., Tavstukha, O. G., Galustyan, O. V., Ignatov, P. A., & Miroshnikova, D. V. (2019). Formation of information and communication competence of future teachers. International Journal of Emerging Technologies in Learning, 14(19), 65-76. https://doi.org/10.3991/ijet.v14i19.10990
  31. McGarr, O., & McDonagh, A. (2021). Exploring the digital competence of pre-service teachers on entry onto an initial teacher education program in Ireland. Irish Educational Studies, 40(1), 115-128. https://doi.org/10.1080/03323315.2020.1800501
  32. Melander Bowden, H., & Svahn, J. (2020). Collaborative work on an online platform in video-mediated homework support. Social Interaction. Video-Based Studies of Human Sociality, 3(3). https://doi.org/10.7146/si.v3i3.122600
  33. Ocampo-Botello, F., Vera-Hernández, G., & De Luna-Caballero, R. (2019). Pedagogical considerations of the curricular incorporation of ICT. Journal of Teaching and Educational Research, 5(15), 32-39. https://doi.org/10.35429/JTER.2019.15.5.32.39
  34. Peeraer, J., & van Petegem, P. (2012). Information and communication technology in teacher education in Vietnam: From policy to practice. Educational Research for Policy and Practice, 11(2), 89-103. https://doi.org/10.1007/s10671-011-9106-9
  35. Pozas, M., & Letzel, V. (2021). “Do you think you have what it takes?”–Exploring predictors of pre-service teachers’ prospective ICT use. Technology, Knowledge and Learning, 28(2), 823-841. https://doi.org/10.1007/s10758-021-09551-0
  36. Schumacker, R. E., & Lomax, R. G. (2004). A beginner´s guide to structural equation modeling. Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410610904
  37. Siddiqui, S., Alam, M., Azmi, J., Ahmad, M., Wiquar, R., & Aziz, A. (2021). Integration of ICT-learning environments: a paradigm shift from traditional teaching pattern. In Proceedings of the 2nd International Conference on ICT for Digital, Smart, and Sustainable Development. https://doi.org/10.4108/eai.27-2-2020.2303238
  38. Stavroulia, K. E., Christofi, M., Baka, E., Michael-Grigoriou, D., Magnenat-Thalmann, N., & Lanitis, A. (2019). Assessing the emotional impact of virtual reality-based teacher training. International Journal of Information and Learning Technology, 36(3), 192-217. https://doi.org/10.1108/IJILT-11-2018-0127
  39. Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association. https://doi.org/10.1037/10694-000
  40. Thurm, D. (2018). Teacher beliefs and practice when teaching with technology: A latent profile analysis. In L. Ball, P. Drijvers, S. Ladel, H. Siller, M. Tabach, & C. Vale (Eds.), Uses of technology in primary and secondary mathematics education (pp. 409-419). Springer. https://doi.org/10.1007/978-3-319-76575-4_25
  41. Tondeur, J., Aesaert, K., Prestridge, S., & Consuegra, E. (2018). A multilevel analysis of what matters in the training of pre-service teacher’s ICT competencies. Computers and Education, 122, 32-42. https://doi.org/10.1016/j.compedu.2018.03.002
  42. Tondeur, J., Aesaert, K., Pynoo, B., Braak, J., Fraeyman, N., & Erstad, O. (2017). Developing a validated instrument to measure preservice teachers’ ICT competencies: Meeting the demands of the 21st century. British Journal of Educational Technology, 48(2), 462-472. https://doi.org/10.1111/bjet.12380
  43. Tondeur, J., Van Braak, J., Siddiq, F., & Scherer, R. (2016). Time for a new approach to prepare future teachers for educational technology use: Its meaning and measurement. Computers and Education, 94, 134-150. https://doi.org/10.1016/j.compedu.2015.11.009
  44. Tran, T., Phan, H. A., Le, H. Van, & Nguyen, H. T. (2020). ICT integration in developing competence for pre-service mathematics teachers: A case study from six universities in Vietnam. International Journal of Emerging Technologies in Learning, 15(14), 19-34. https://doi.org/10.3991/ijet.v15i14.14015
  45. Uzun, A. M. (2019). Psychometric properties of the perceived ICT literacy scale among Turkish university students. International Online Journal of Education and Teaching, 6(3), 644-656.
  46. Vasyura, S. A., Kuzmina, O. V., Maletova, M. I. (2020). Internet communications: Time phenomenon in online activity. Education and Self Development, 15(4), 71-79. https://doi.org/10.26907/esd15.4.03
  47. Vilppola, J., Lämsä, J., Vähäsantanen, K., & Hämäläinen, R. (2022). Teacher trainees’ experiences of the components of ICT competencies and key factors in ICT competence development in work-based vocational teacher training in Finland. International Journal for Research in Vocational Education and Training, 9(2), 146-166. https://doi.org/10.13152/IJRVET.9.2.1
  48. Wang, Z., Pang, H., Zhou, J., Ma, Y., & Wang, Z. (2021). “What if … it never ends?”: Examining challenges in primary teachers’ experience during the wholly online teaching. Journal of Educational Research, 114(1), 89-103. https://doi.org/10.1080/00220671.2021.1884823
  49. Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., & Erikson, P. (2005). Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR task force for translation and cultural adaptation. Value in Health, 8(2), 94-104. https://doi.org/10.1111/j.1524-4733.2005.04054.x
  50. Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Journal of Emergency Primary Health Care, 8(3), 1-13. https://doi.org/10.33151/ajp.8.3.93
  51. Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. https://doi.org/10.20982/tqmp.09.2.p079
  52. Zhang, X., Shinozuka, M., Tanaka, Y., Kanamori, Y., & Masui, T. (2022). How ICT can contribute to realize a sustainable society in the future: A CGE approach. Environment, Development and Sustainability, 24(4), 5614-5640. https://doi.org/10.1007/s10668-021-01674-9
  53. Zheltukhina, M.R., Klushina, N.I., Vasilkova, N.N., Ponomarenko, E.B., & Dzyubenko, A.I. (2017). Modern media influence: Mass culture–mass consciousness–mass communication. Xlinguae, 10(4), 96-105. https://doi.org/10.18355/XL.2017.10.04.09