Students’ and lecturers’ perceptions of the effect of open-book examinations on teaching and assessment at departments of accountancy at South African universities

S.J. Kruger

Abstract


Strong arguments are put forward in literature that teaching methods should be aligned with assessment practices in order to optimise the teaching-learning environment. The decision by the South African Institute of Chartered Accountants to change its qualifying examination from a closed-book to an open-book format has led to accredited universities changing their assessment accordingly. This paper investigates how students and lecturers perceive the changes made to teaching and assessment after the introduction of open-book assessment. A survey was performed among final-year accounting students preparing for the qualifying examination of the South African Institute of Chartered Accountants. Assessment in the first three years of study of these students was generally done by means of closed-book examinations, but in their final year, students were assessed by means of open-book tests and examinations. A comparison was made between the views of students and lecturers in certain universities’ departments of accountancy. The views of students and lecturers differed significantly on the extent of changes which were made to teaching practices and the setting of examination papers. The paper identified aspects to be considered to encourage students’ deep learning, long term retention, selection of knowledge and preparation for open-book assessment. Issues lecturers need to take into account when determining their teaching and assessment approach within the broader context of an open-book assessment environment were also identified.


Keywords


Open-book assessment; Closed-book assessment; Learning; Knowledge management; Accounting education; Testing effect; Constructive alignment; Competency-based education; SAICA; IRBA

Full Text:

PDF

References


Agarwal, P.K., Karpicke, J.D., Kang, S.H.K., Roediger, H.L. and McDermott, K.B. (2008). Examining the testing effect with open- and closed-book tests, Applied Cognitive Psychology, 22:861-876.

Agarwal, P.K. and Roediger, H.L. (2011). Expectancy of an open-book test decreases performance on a delayed closed-book test, Memory, 19(8):836-852.

Arthur, N. and Everaert, P. (2012). Gender and performance in accounting examinations: Exploring the impact of examination format, Accounting Education, 21(5):471-487.

Baillie, C. and Toohey, S. (1997). The “Power Test”: Its impact on student learning in a materials science course for engineering students, Assessment & Evaluation in Higher Education, 22(1):33-48.

Ballantine, J. and McCourt Larres, P. (2009). Accounting undergraduates’ perceptions of cooperative learning as a model for enhancing their interpersonal and communication skills to interface successfully with professional accountancy education and training, Accounting Education, 18(4-5):387-402.

Betteridge, D. (1971). Open-book exams, Education in Chemistry, 8:68-69.

Biggs, J.B. (1996). Enhancing teaching through constructive alignment, Higher Education, 32(3):347-364.

Boniface, D. (1985). Candidate’s use of notes and textbooks during an open-book examination, Educational Research, 27(3):201-209.

Breton, G. (1999). Some empirical evidence on the superiority of the problem-based learning (PBL) method, Accounting Education, 8(1):1-12.

Broyles, I.L., Cyr, P.R. and Korsen, N. (2005). Open book tests: Assessment of academic learning in clerkships, Medical Teacher, 27(5):456-462.

Cortese, C., Pupovac, S. and Xu, L. (2015). Applying open-book-open-web assessment in post graduate accounting subject: Flipping test. In Zang, Y. (ed.), Handbook of Mobile Teaching and Learning, Springer Berlin Heidelberg, 183-198.

Croasdale, R. (1973). Open-book examinations in operational research (A personal view), International Journal of Mathematical Education in Science and Technology, 4:133-135.

Du Preez, H. (2012). Taxation students’ perceptions of open-book assessment prior to the qualifying examination of South African chartered accountants, South African Journal of Accounting Research, 26(1):119-142.

Du Preez, H. (2015). Taxation students’ perceptions of open-book assessment: A follow-up interactive qualitative analysis, South African Journal of Accounting Research, 29(1):84-99.

Durning, S.J., Dong, T., Ratcliffe, T., Schuwirth, L., Artino, A.R., Boulet, J.R. & Eva, K. (2016). Comparing Open-Book and Closed-Book Examinations. Academic Medicine. 91(4):583–599.

Eilertsen, T.V. and Valdermo, O. (2000). Open-book assessment: A contribution to improved learning? Studies in Educational Evaluation, 26(2):91-103.

Fallan, L. and Opstad, L. (2014). Beyond gender performance in accounting: Does personality distinction matter? Accounting Education, (July 2015):1-19.

Feldhusen. (1961). An evaluation of college students’ reactions to open-book tests, Educational and Psychological Measurement, 21:637-646.

Francis, J. (1982). A case for open-book examinations, Educational Review, 34(1):13-26.

French, G.R. and Coppage, R.E. (2003). A strategic model for accounting education, The Journal of Applied Business Research, 19(2):107-116.

Gharib, A., Phillips, W. & Mathew, N. (2012). Cheat Sheet or Open-Book? A Comparison of the Effects of Exam Types on Performance, Retention, and Anxiety. Psychology Research. 2(8):469–478

Green, S.G., Ferrante, C.J. and Heppard, K.A. (2016). Using open-book exams to enhance student learning, performance, and motivation, The Journal of Effective Teaching, 16(1):19-35.

Healy, M., McCutcheon, M. and Doran, J. (2014). Student views on assessment activities: Perspectives from their experience on an undergraduate programme, Accounting Education, 23(5):467-482.

Heijne-Penninga, M., Kuks, J.B.M., Hofman, W.H.A. and Cohen-Schotanus, J. (2008). Influence of open- and closed-book tests on medical students’ learning approaches, Medical Education, 42(10):967-974.

Heijne-Penninga, M., Kuks, J.B.M., Hofman, W.H.A. and Cohen-Schotanus, J. (2010). Influences of deep learning, need for cognition and preparation time on open- and closed-book test performance, Medical Education, 44(9):884-891.

Heijne-Penninga, M., Kuks, J.B.M., Hofman, W.H.A. and Cohen-Schotanus, J. (2011). Directing students to profound open-book test preparation: The relationship between deep learning and open-book test time, Medical Teacher, 33(1):e16-e21.

Heijne-Penninga, M., Kuks, J.B.M., Hofman, W.H.A., Muijtjens, A.M.M. and Cohen-Schotanus, J. (2013). Influence of PBL with open-book tests on knowledge retention measured with progress tests, Advances in Health Sciences Education, 18(3):485-495.

Heijne-Penninga, M., Kuks, J.B.M., Schönrock-Adema, J., Snijders, T.B. and Cohen-Schotanus, J. (2008). Open-book tests to complement assessment-programmes: Analysis of open- and closed-book tests, Advances in Health Sciences Education, 13(3):263-273.

Hesketh, J. (2011). Accounting academics’ multiple challenges : Issues- driven learning offers a way forward, South African Journal of Accounting Research, 25(1):1-34.

IRBA. (2004). Open-book assessment and the public practice examination (PPE), Maneo, 1-15.

Kalish, R.A. (1958). An experimental evaluation of the open book examination, Journal of Educational Psychology, 49(4):200-204.

Karagiannopoulou, E. (2010). Effects of classroom learning experiences and examination type on students’ learning, Psychology, 17(4):325-342.

Karagiannopoulou, E. and Entwistle, N. (2013). Influences on personal understanding : Intentions, approaches to learning, perceptions of assessment, and a 'meeting of minds', Psychology Teaching Review, 19(2):80-96.

Karpicke, J.D., Butler, A.C. and Roediger, H.L. (2009). Metacognitive strategies in student learning: Do students practise retrieval when they study on their own? Memory (Hove, England), 17(4):471–479.

Koutselini-Ioannidou, M. (1997). Testing and life-long learning: Open-book and closed-book examination in a university course, Studies in Educational Evaluation, 23(2):131-139.

Krarup, N., Naeraa, N. and Olsen, C. (1974). Open-book tests in a university course, Higher Education, 3(2):157-164.

Larwin, K.H. (2012). Student prepared testing aids: A low-tech method of encouraging student engagement, Journal of Instructional Psychology, 39(2):105.

Lord, B.R. and Robertson, J. (2006). Students’ experiences of learning in a third-year management accounting class: Evidence from New Zealand, Accounting Education, 15(1):41-59.

Lubbe, I. (2013). Educating accounting professionals: Development of a theoretical framework as a language of description of accounting knowledge production and its implications for accounting academics at South African universities, South African Journal of Accounting Research, 27(1):87-124.

Lubbe, I. (2014). Educating professionals, Meditari Accountancy Research, 22(1):107-127.

Maharg, P. (1999). The culture of mnemosyne: open-book assessment and the theory and practise of legal education, International Journal of the Legal Profession, 6(2):219-239.

Moore, R. and Jensen, P.A. (2007). Do open-book exams impede long-term learning in introductory biology courses ? Journal of College Science Teaching, 36(7):46-49.

Pauker, J.D. (1974). Effect of Open Book Examinations on Test Performance in an Undergraduate Child Psychology Course. Teaching Psychology. 1(2):71–73.

Roediger, H.L. and Karpicke, J.D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention, Psychological Science, 17(3):249-255.

Rowlands, J.E. and Forsyth, D. (2006). Open book professional accountancy examinations, South African Journal of Higher Education, 20(5):703-717.

Rust, C. (2002). The impact of assessment on student learning, Active Learning in Higher Education, 3(2):145-158.

SAICA. (2014). Competency framework detailed guidance for the academic programme. https://www.saica.co.za/Portals/0/LearnersStudents/ documents/Detailed_Guidance_to_the_competency_framework_for_the_academic_programme_Updated_and_approved_July_2014.pdf, date of access: 28 July 2016

Scott, J., Buchanan, J. and Haigh, N. (1997). Reflections on student-centred learning in a large class setting, British Journal of Educational Technology, 28(1):19-30.

Scully, G. and Kerr, R. (2014). Student workload and assessment: Strategies to manage expectations and inform curriculum development, Accounting Education, 23(5):443-466.

Shine, S., Kiravu, C. and Astley, J. (2004). In defence of open-book engineering degree examinations, International Journal of Mechanical Engineering Education, 32(3):197-211.

Smit, S. and Steenkamp, G. (2015). The competencies developed in an undergraduate accounting course before SAICA’s competency framework was effective : A student’s perspective, Journal of Economic and Financial Sciences, 8(2):666-688.

Stainbank, L.J. (2010). Students’ perceptions of the usefulness of an accounting project in acquiring accounting knowledge and professional skills, Meditari Accountancy Research, 24(1):79-100.

Steenkamp, L.P., Baard, R.S. and Frick, B.L. (2009). Factors influencing success in first-year accounting at a South African university: A comparison between lecturers’ assumptions and students’ perceptions, South African Journal of Accounting Research, 23(1):113-140.

Strauss-Keevy, M. (2014). Education programmes’ responsibilities regarding pervasive skills, Journal of Economic and Financial Sciences, 7(2):415-432.

Theophilides, C. and Dionysiou, O. (1996). The major functions of the open-book examination at the university level: A factor analytic study, Studies in Educational Evaluation, 22(2):157-170.

Theophilides, C. and Koutselini, M. (2000). Study behaviour in the closed-book and the open-book examination: A comparative analysis, Educational Research and Evaluation, 6(4):379-393.

Turner, K.F., Reed, R.O. and Greiman, J. (2011). Accounting education in crisis, American Journal of Business Education, 4(12):39-44.

Tussing, L. (1951). A consideration of the open book examination, Educational and Psychological Measurement, 597-602.

Visser, S. and Vreken, N. (2006). Teaching styles versus learning styles in the accounting sciences in the United Kingdom and South Africa: A comparative analysis, Meditari Accountancy Research, 14(2):97-112.

Watty, K., Jackson, M. and Yu, X. (2010). Students’ approaches to assessment in accounting education: The unique student perspective, Accounting Education, 19(3):219-234.

Wilbur, K. (2015). Summative assessment in a doctor of pharmacy program: A critical insight, Advances in Medical Education and Practice, 6:119.




DOI: https://doi.org/10.20853/32-5-2587

Refbacks

  • There are currently no refbacks.


eISSN: 1753-5913

Copyright © 2016 South African Journal of Higher Education

Hosted by Stellenbosch University Library and Information Service since 2016.

Creative Commons License -CC BY-NC-ND 4.0

Disclaimer:
This journal is hosted by the SU LIS on request of the journal owner/editor. The SU LIS takes no responsibility for the content published within this journal, and disclaim all liability arising out of the use of or inability to use the information contained herein. We assume no responsibility, and shall not be liable for any breaches of agreement with other publishers/hosts.