Evaluation of the interactive multimedia business simulation SPACE (Simulating Project Auditing and Controlling Excellence)

This report presents the evaluation of the computer-based
simulation SPACE – Simulating Project Auditing & Controlling
Excellence – which is an interactive multiedia business simulation
developed in partnership by Andersen Consulting and Siemens AG. The
aims of SPACE are fostering self-directed learning and the
acquisition of applicable knowledge in the economic domain
regarding construction and solution projects of US GAAP. The
evaluation was conducted in cooperation with the Institute of
Educational Psychology at the Ludwig-Maximilians-University in
Munich. The aim of the evaluation was to compare the effectiveness
of SPACE with a traditional classroom instruction. Therefore, a
problem-based transfer task was designed which assessed learning
gains with respect to applicable knowledge in the following areas:
(1) strategic knowledge and problem-solving skills, that means
selection of appropriate information and strategies to solve a
realistic business problem, (2) basic skills to calculate POC and
(3) conceptual knowledge, i.e. an understanding of principles and
interconnections of concepts in the domain. 38 students of business
administration participated in the evaluation. 19 students learned
eight hours with SPACE, the other 19 students received a
traditional classroom instruction lasting also eight hours in the
same subject area of US GAAP. Results show that SPACE was
significantly better with regard to strategic knowledge and
applying problem solving skills. In other words, the study showed
that SPACE is superior to classroom instruction in this area of
knowledge acquisition and application. In the other areas of basic
skills to calculate POC and conceptional knowledge, differences
were not significant between the classroom instruction and SPACE.
When SPACE is employed under realistic conditions, i.e. in
business, it can be assumed that SPACE is even more superior to
classroom instruction.