Computer-assisted assessment: Application of computerised testing at the Institute of English Studies at the University of Lodz, Poland

Olga Trendak

Abstract


Numerous researchers have noticed the need for better measurement of students’ stated learning outcomes (Conole & Warburton, 2005). One of the reasons is the increasing number of university students, which has led to the necessity of finding an efficient form of assessment. One of the ways of testing, which is rapidly gaining popularity among academic staff, is computer-assisted assessment (CAA). The aim of the following paper is to briefly discuss the notion of CAA and the observed positive impacts it has exerted on the testing process at the Institute of English Studies at the University of Lodz, Poland, and to consider several pedagogical implications related to the use of this type of assessment within the institution. The findings were observed by the author of the paper and are not based on empirical data.


Keywords


computer-assisted assessment; computer assisted testing systems; computerised testing; computer-based assessment; ICT

Full Text:

PDF

References


Arora, A., Evans, S., Gardner, C., Gulbrandsen, K, & Riley, J. E. (2015). Strategies for success: Using formative assessment to build skills and community in the blended classroom. In S. Koç, X. Liu, & P. Wachira (Eds.), Assessment in online and blended learning environments (pp. 235-251). Charlotte, NC: Information Age Publishing.

Bachman, L. (2000) Modern language testing at the turn of the century: assuring that what we count counts. Language Testing, 17(1), 1-42.

Bartram, D. (2006). Testing on the Internet: Issues, challenges and opportunities in the field of occupational assessment. In D. Bartram, & R. K. Hambleton (Eds.), Computer-based testing and the Internet: Issues and advances (pp. 13-37). New York, NY, US: John Wiley & Sons Ltd.

Black, P., & William, D. (1998). Inside the Black Box: Raising Standards through Classroom Assessment. School of Education, King’s College: London.

Boevé, A., Meijer, R., Albers, C., Beetsma Y., & Bosker, R. (2015). Introducing computer-based testing in high-stakes exams in higher education: Results of a field experiment. PloS ONE 10(12). DOI: 10.1371/journal.pone.0143616. eCollection 2015.

Brown, M. J., & Tallon, J. (2015). The effects of pre-lecture quizzes on test anxiety and performance in a statistics course. Education, 135(3), 346-350.

Brown, S., Race, P., & Bull J. (1999). Computer-assisted Assessment

in higher education. London: Kogan Page.Bull, J. (1997). Computer-assisted assessment: Impact on higher education institutions. Educational Technology & Society, 2(3), 123-126.

Bull, J., & Danson, M. (2004). Computer-assisted Assessment (CAA)

– No.14 in LTSN Generic Centre Assessment Series, LTSN.Bull, J., & McKenna, C. (2004). Blueprint for Computer-assisted Assessment. London: Routledge.

Bunderson, V.C., Dilkon K.I., & Olsen, J. B. (1989). The four generations of computerized educational measurement. Educational Measurement, 3, 367-407.

Chalhoub-Deville, M. (2001). Language testing and technology: past and future. Language Learning and Technology, 5(2), 95-98.

Choi, I., Sung Kim, K., & Boo, J. (2003). Comparability of a paper-based language test and a computer-based language test. Language Testing, 20(3), 296-320.

Conole, G., & Warburton, B. (2005). A review of computer-assisted assessment. ALT-J, Research in Learning Technology, 13(1), 17-31.

Dashtestani, R. (2015). Examining the use of web-based tests for testing academic vocabulary in EAP instruction. Teaching English with Technology, 15(1), 48-61. Retrieved 20, September, 2019, from http://tewtjournal.org/issues/volume-2015/volume-2015-issue-1/

Deutsch, T., Herrman, K., Frese, T., & Sandholzer, H. (2012). Implementing computer-based assessment – A web-based mock examination changes attitudes. Computers & Education, 58(4), 1068-1075.

Dumova, T. (2012). The usability of online quizzes: Evaluating student perceptions. In S. Kelsey, & K. S. Amant (Eds.), Computer-mediated communication: Issues and approaches in education (pp. 50-61). Hershey, PA: IGI Global.

Ehrman, S. (1998). Studying teaching, learning and technology: a toolkit from the Flashlight programme. Active Learning, 9, 36-39.

Fuentes, J., Ramírez-Gómez, Á., Garciá A., & Ayuga F. (2014). Computer-based tools for the assessment of learning processed in higher education: A Comparative Analysis. Proceedings of INTED2014 Conference (pp. 976-984). Valencia: IATED.

Galaczi, E.D. (2010). Face-to-face and computer-based assessment of speaking: challenges and opportunities. In L. Araújo (Ed.), Computer-based Assessment (CBA) of Foreign Language Speaking Skills (pp. 29-52). Luxembourg: Publications Office of the European Union.

Galizzi, M. (2010). An assessment of the impact of online quizzes and textbook resources on students‘ learning. International Review of Economics Education, 9(1), 31–43. DOI:10.1016/S1477-3880(15)30062-1.

Haigh, M. (2010). Why use computer-based assessment in education? A literature review. Research Matters, 10(6), 33-40.

International Test Commission. 2005. International guidelines on computer-based and Internet delivered testing. Gainesville, FL: International Test Commission.

Kearney, J., Fletcher, M., & Bartlett, B. (2002). Computer-based assessment: Its use and effects on student learning. In H. Middleton (Ed.), Learning in technology education: Challenges for the 21st Century (pp. 235-242). Brisbane: Centre for Technology Education Research, Griffith University.

Kibble, J. D. (2011). Voluntary participation in online formative quizzes is a sensitive predictor of student success. Advances in Physiology Education, 35(1), 95–96. DOI:10.1152/advan.00053.2010.

Kılıçkaya, F. (2017). The effects of pre-lecture online quizzes on language students’ perceived preparation and academic performance. PASAA Journal, 53, 59-84.

Krakowian, P. 2015 Communities of practice in peer assessment of speaking with the EPSS (Electronic Performance Support System). In M. Marczak, & M. Hinton (Eds.), Contemporary English Language Teaching and Research (21-33). Cambridge: Scholars Publishing.

Lu, H.-L. (2009). Pre-class online quizzing as a catalyst for pedagogical change. SoTL Commons Conference. Paper 56. Retrieved 20 March, 2019, from http://digitalcommons.georgiasouthern.edu/sotlcommons/SoTL/2009/56.

Mackenzie, D. M., O’Hare, D., Paul, C., Boyle, A., Edwards, D., Williams, D., & Wilkins, H. (2004). Assessment for learning: the TRIADS assessment of learning outcomes project and the development of a pedagogically-friendly computer-based assessment. In D. O’Hare, & D. Mackenzie (Eds.), Advances in computer aided assessment, SEDA Paper, 116 (pp.11-24). Birmingham: Staff & Educational Development Association Ltd.

McCulloch, M., & Macleod, H. (2004). Assessing online – An overview. Reflections on Assessment: 2, 1-11. Retrieved 20 March, 2019, from https://www.enhancementthemes.ac.uk/docs/ethemes/assessment/reflections-on-assessment-volume-ii.pdf?sfvrsn=dd49f681_12.

McDaniel, M. A., Widman, K. M., & Anderson, J. L. (2012). Using quizzes to enhance summative-assessment performance in a web-based class: An experimental study. Journal of Applied Research in Memory and Cognition, 1(1), 18–26. DOI:10.1016/j.jarmac.2011.10.001.

Marriott P., & Teoh, L. (2012). Computer-based assessment and feedback: Best Practice Guidelines. The Higher Education Academy. Retrieved 20 March, 2019 from https://www.heacademy.ac.uk/system/files/computer-basedassessmentfeedbackbestpractice.pdf.

Russell, M. & Haney, W. (2000). Bridging the gap between testing and technology in schools. Education Policy Analysis Archives, 8(19), 1–10.

Schaefer, E. (2008). Rater bias patterns in an EFL writing Assessment. Language Testing, 25(4), 465–483.

Schegel, R.E., & Gilliland, K. 2007. Development and quality assurance of computer-based assessment batteries. Archives of Clinical Neuropsychology, 22, 49–61.

Scheuermann, F., & Guimarães Pereira, A. (2008). Towards a research agenda on computer-based assessment: Challenges and needs for European educational measurement. Luxembourg City: Office for Official Publications of the European Communities.

Thomas, T., & Milligan C. (2003). Online assessment of practical experiments. Proceedings of the Seventh International CAA Conference, 421-430.

Thurlow, M., Lazarus, S., Albus, D., & Hodgson, J. (2010). Computer-based testing: Practices and Considerations. (Synthesis Report 78). Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.




DOI: http://dx.doi.org/10.17951/lsmll.2019.43.4.49-61
Date of publication: 2019-12-30 00:00:00
Date of submission: 2019-02-12 20:25:01


Statistics


Total abstract view - 1246
Downloads (from 2020-06-17) - PDF - 438

Indicators



Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Olga Trendak

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.