Trends and Innovation in Digital Reading Assessment: A Decade of Bibliometric Insights

Authors

  • Wendi Saputra Universitas Pendidikan Indonesia, Indonesia
  • Isah Cahyani Universitas Pendidikan Indonesia, Indonesia
  • Andoyo Sastromiharjo Universitas Pendidikan Indonesia, Indonesia

DOI:

https://doi.org/10.33394/jollt.v13i1.12182

Keywords:

Digital Reading, Reading Assessment, Digital Reading Assessment, Bibliometric Analysis,

Abstract

The digitalization of reading assessment has become inevitable. The emergence of technology in reading assessment should be seen as an opportunity to improve the quality of students' reading. This study aims to compile various research conducted on digital reading assessment. The method used in this research is a literature review, where the researcher gathers information through literature studies including books, articles, research findings, and others. The researcher then analyzes the collected data using bibliometric analysis. Bibliometric analysis is an approach that employs a range of quantitative methods to measure, analyze, and track scientific literature. The results of this research found 29 articles related to digital-based reading assessment from 2013 to 2023. After analysis, several topics were frequently discussed in these articles, including assessment, computer-based assessment, technology, online testing, and open book. However, there are still some topics that need further development, such as computation design, reading comprehension assessment, cooperative/collaborative learning, and active reading. This research will be highly beneficial for researchers looking to develop digital reading assessments, ensuring that this form of assessment advances in the future and produces the best digital-based reading evaluations.

Author Biographies

Wendi Saputra, Universitas Pendidikan Indonesia

Indonesian Language Education Study Program, Faculty of Language and Literature Education, Indonesia University of Education, Indonesia

Isah Cahyani, Universitas Pendidikan Indonesia

Indonesian Language Education Study Program, Faculty of Language and Literature Education, Indonesia University of Education, Indonesia

Andoyo Sastromiharjo, Universitas Pendidikan Indonesia

Indonesian Language Education Study Program, Faculty of Language and Literature Education, Indonesia University of Education, Indonesia

References

Al-Sulaimi, A., & Al-Shihi, H. (2017). The effects of reading mode (digital vs printed text) on reading comprehension: A literature review of the key assessment factors. 2017 6th International Conference on Information and Communication Technology and Accessbility, ICTA 2017, 1–6. https://doi.org/10.1109/ICTA.2017.8336053

Andreessen, L. M., Gerjets, P., Meurers, D., & Zander, T. O. (2021). Toward neuroadaptive support technologies for improving digital reading: a passive BCI-based assessment of mental workload imposed by text difficulty and presentation speed during reading. User Modeling and User-Adapted Interaction, 31(1), 75–104. https://doi.org/10.1007/s11257-020-09273-5

Chang, K. L., & Huang, C. J. (2013). Construction of adolescent digital reading assessment. Advanced Materials Research, 718–720, 2214–2220. https://doi.org/10.4028/www.scientific.net/AMR.718-720.2214

Chen, C. M., Chen, L. C., & Horng, W. J. (2021). A collaborative reading annotation system with formative assessment and feedback mechanisms to promote digital reading performance. Interactive Learning Environments, 29(5), 848–865. https://doi.org/10.1080/10494820.2019.1636091

Coiro, J. (2021). Toward a Multifaceted Heuristic of Digital Reading to Inform Assessment, Research, Practice, and Policy. Reading Research Quarterly, 56(1), 9–31. https://doi.org/10.1002/rrq.302

Dixon, C., Oxley, E., Gellert, A. S., & Nash, H. (2023). Dynamic assessment as a predictor of reading development: a systematic review. Reading and Writing, 36(3), 673–698. https://doi.org/10.1007/s11145-022-10312-3

Espinosa-Rada, A., Lerner, J., & Fritz, C. (2024). Socio-cognitive Networks between Researchers (Version 1). arXiv. https://doi.org/10.48550/ARXIV.2407.21067

Estrada-Araoz, E. G., Larico-Uchamaco, G. R., Jara-Rodríguez, F., & Pachacutec-Quispicho, R. (2024). Assessment of digital competencies in basic education teachers: A descriptive study. Salud, Ciencia y Tecnologia - Serie de Conferencias, 3. https://doi.org/10.56294/sctconf2024632

Fahimnia, B., Sarkis, J., & Davarzani, H. (2015). Green Supply Chain management: A Review and Bibliometric Analysis. Intern. Journal of Production Economics. https://doi.org/10.1016/j.ijpe.2015.01.003

Flanagan, B., Majumdar, R., Akcapinar, G., & Ogata, H. (2020). The relationship between student performance and reading behavior in open ebook assessment. Proceedings - IEEE 20th International Conference on Advanced Learning Technologies, ICALT 2020, 368–372. https://doi.org/10.1109/ICALT49669.2020.00117

Flanagan, B., Majumdar, R., & Ogata, H. (2022). Early-warning prediction of student performance and engagement in open book assessment by reading behavior analysis. International Journal of Educational Technology in Higher Education, 19(1). https://doi.org/10.1186/s41239-022-00348-4

Frønes, T. S., Narvhus, E. K., & Aasebø, M. C. (2013). Nordic results from the PISA digital reading assessment. Nordic Journal of Digital Literacy, 2013(1), 13–31. https://doi.org/10.18261/issn1891-943x-2013-01-02-02

Gammel, N., Ross, T. L., Lewis, S., Olson, M., Henciak, S., Harris, R., Hanlon, A., & Carroll, K. C. (2021). Comparison of an Automated Plate Assessment System (APAS Independence) and Artificial Intelligence (AI) to Manual Plate Reading of Methicillin-Resistant and Methicillin-Susceptible Staphylococcus aureus CHROMagar Surveillance Cultures. Journal of Clinical Microbiology, 59(11). https://doi.org/10.1128/JCM.00971-21

Hautala, J., Heikkilä, R., Nieminen, L., Rantanen, V., Latvala, J. M., & Richardson, U. (2020). Identification of Reading Difficulties by a Digital Game-Based Assessment Technology. Journal of Educational Computing Research, 58(5), 1003–1028. https://doi.org/10.1177/0735633120905309

Ho, J. C. S., McBride, C., Lui, K. F. H., & Åockiewicz, M. (2023). WordSword: An Efficient Online Word Reading Assessment for Global English. Assessment. https://doi.org/10.1177/10731911231194971

Lin, P., & Liao, G. (2023). The Study on Usability and User Experience of Reading Assessment Systems: A Preliminary Research. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14040 LNCS, 305–320. https://doi.org/10.1007/978-3-031-34411-4_21

Liu, Y., Fu, C., & Gu, X. (2018). The assessment of digital reading skills with cognitive diagnose for the reading achievement test in china. Proceedings of International Conference of the Learning Sciences, ICLS, 3(2018-June), 1435–1436. https://api.elsevier.com/content/abstract/scopus_id/85053854803

Morrice, E., Johnson, A. P., Marinier, J. A., & Wittich, W. (2017). Assessment of the Apple iPad as a low-vision reading aid. Eye (Basingstoke), 31(6), 865–871. https://doi.org/10.1038/eye.2016.309

Oppenlaender, J. (2024). Past, Present, and Future of Citation Practices in HCI (Version 5). arXiv. https://doi.org/10.48550/ARXIV.2405.16526

Pradana, M., Elisa, H. P., Utami, D. G., Pradana, M., Elisa, H. P., & Utami, D. G. (2023). Cogent Business & Management Mental health and entrepreneurship : A bibliometric study and literature review MANAGEMENT | REVIEW ARTICLE Mental health and entrepreneurship : A bibliometric study and literature review. Cogent Business & Management, 10(2). https://doi.org/10.1080/23311975.2023.2224911

Rice, M., Wijekumar, K., Lambright, K., & Bristow, A. (2023). Inferencing in Reading Comprehension: Examining Variations in Definition, Instruction, and Assessment. Technology, Knowledge and Learning, 0123456789. https://doi.org/10.1007/s10758-023-09660-y

Rojas-Sánchez, M. A., Palos-Sánchez, P. R., & Folgado-Fernández, J. A. (2023). Systematic literature review and bibliometric analysis on virtual reality and education. Education and Information Technologies, 28(1), 155–192. https://doi.org/10.1007/s10639-022-11167-5

Sabatini, J., O’Reilly, T., Weeks, J., & Wang, Z. (2020). Engineering a Twenty-First Century Reading Comprehension Assessment System Utilizing Scenario-Based Assessment Techniques. International Journal of Testing, 20(1), 1–23. https://doi.org/10.1080/15305058.2018.1551224

Serafini, F., Moses, L., Kachorsky, D., & Rylak, D. (2020). Incorporating Multimodal Literacies Into Classroom-Based Reading Assessment. Reading Teacher, 74(3), 285–296. https://doi.org/10.1002/trtr.1948

Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104(July), 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039

Suárez-álvarez, J., Fernández-Alonso, R., García-Crespo, F. J., & Muñiz, J. (2022). The Use of New Technologies in Educational Assessments: Reading in a digital world. Papeles Del Psicologo, 2022(43), 36–47. https://doi.org/10.23923/pap.psicol.2986

Taskin, Z. (2024). Sustaining the ‘Frozen Footprints’ of Scholarly Communication Through Open Citations. https://doi.org/10.31235/osf.io/3pej6

Udeozor, C., Abegão, F. R., & Glassey, J. (2024). Measuring learning in digital games: Applying a game-based assessment framework. British Journal of Educational Technology, 55(3), 957–991. https://doi.org/10.1111/bjet.13407

Van Helden, G., Van Der Werf, V., Saunders-Smits, G. N., & Specht, M. M. (2023). The Use of Digital Peer Assessment in Higher Education-An Umbrella Review of Literature. IEEE Access, 11, 22948–22960. https://doi.org/10.1109/ACCESS.2023.3252914

Virinkoski, R., Lerkkanen, M. K., Holopainen, L., Eklund, K., & Aro, M. (2017). Teachers’ Ability to Identify Children at Early Risk for Reading Difficulties in Grade 1. Early Childhood Education Journal, 46(5), 497–509. https://doi.org/10.1007/s10643-017-0883-5

Walia, P. K., & Sinha, N. (2014). Changing trend in reading habits of teenagers in Delhi an impact assessment of demographic and environmental variables. Library Review, 63(1–2), 125–137. https://doi.org/10.1108/LR-03-2013-0038

Wüst, M., Maskut, N., Baumann, L., Heitplatz, V. N., Wilkens, L., Dirks, S., & Bühler, C. (2023). Easy Reading – Keeping the User at the Digital Original: Assessment and Potential Use of Easy Reading for Digital Accessibility. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14021 LNCS, 469–487. https://doi.org/10.1007/978-3-031-35897-5_34

Yüksel, Y. T., Sedeh, F. B., Brans, R., Svedman, C., Paulsen, E., Gimenéz-Arnau, A., Foti, C., & Agner, T. (2021). Value of photo assessment in late patch test readings—A multicenter study from six European patch test clinics. Contact Dermatitis, 84(5), 283–289. https://doi.org/10.1111/cod.13736

Downloads

Published

2025-01-16

How to Cite

Saputra, W., Cahyani, I., & Sastromiharjo, A. (2025). Trends and Innovation in Digital Reading Assessment: A Decade of Bibliometric Insights. Journal of Languages and Language Teaching, 13(1), 46–59. https://doi.org/10.33394/jollt.v13i1.12182

Issue

Vol. 13 No. 1 (2025)

Section

Articles

Citation Check

License

License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:

  1. They are authorized by their co-authors to enter into these arrangements.
  2. The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
  3. That it is not under consideration for publication elsewhere,
  4. That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
  5. They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  6. They agree to the following license and publishing agreement.

Copyright
Authors who publish with JOLLT Journal of Languages and Language Teaching agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal. 
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

Licensing for Data Publication

JOLLT Journal of Languages and Language Teaching uses a variety of waivers and licenses, that are specifically designed for and appropriate for the treatment of data:
Other data publishing licenses may be allowed as exceptions (subject to approval by the editor on a case-by-case basis) and should be justified with a written statement from the author, which will be published with the article.

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.