Developing a Learning Outcome-Based Question Examination Paper Tool for Universiti Putra Malaysia

Much attention is now given on producing quality graduates. Therefore, outcome-based education (OBE) in teaching and learning is now being implemented in Malaysia at all levels of education especially at higher education institutions. For implementing OBE, the design of curriculum and courses should be based on specified outcomes. Thus, the challenge for the assessment is that it should be capable of measuring whether intended outcomes have been achieved or not. Likely, by assisting lecturer in preparing examination paper that aligns with the specified outcomes is something that can help to ensure the implementation of OBE. Hence, this paper describes the development of a tool for generating question examination paper based on learning outcomes, called Learning Outcome-based Question Examination paper Tool (LoQET). LoQET is proposed for assisting lecturer in Universiti Putra Malaysia for preparing examination paper based on programme outcomes and learning outcomes set in the teaching plan and assessment entries.


Introduction
Outcome-based education (OBE) is an approach to education in which decisions about the curriculum are driven by the exit learning outcomes (LO) that the students should display at the end of the course (Davis, 2003).LO as 'being something that student can do now that they could not do previously' are changes in people as a result of learning experience (Watson, 2002).In contrast to traditional education, this approach particularly concerns on preparing students for life and work after graduate.OBE focuses on what the students can actually learn from the course and how to help students learn it and able to reproduce what was taught.For assessing the OBE, the chosen assessment methods should be able to measure how much and how well the students have learnt from the course.Therefore, the course teaching plan and course assessments are attentively created to support the intended learning outcomes that have been set out for the particular course.
OBE can serve as a benchmark to measure a success of a university (Mohayidin et al., 2008).Thus, the implementation of OBE is to ensure that the academic programmes, delivery systems, assessment methods and the graduates are of high quality.Therefore, there is a crucial need for supporting tools to assists universities in implementing OBE successfully in teaching and learning.Universiti Putra Malaysia (UPM) is one of the public universities in Malaysia that has implemented OBE approach in its teaching and learning strategy since year 2006 (CADe, 2009).Since then, UPM has upgraded its e-learning systems where many new modules have been introduced in the existing system in order to support OBE implementation.Thus far, the existing technology-based tools and efforts are mainly focus on activities related to administration work and student.However, efforts are continuously made by UPM to improve the system.As part of UPM community, we were motivated to propose a tool that is essential for implementing and achieving OBE.Hence, we proposed a tool called LOs-based Question Examination Tool (LoQET), which aims to help UPM's lecturer to compose questions examination paper align with learning outcomes and program outcome set in the course teaching plan and assessment entries.This tool is intended to give benefits to UPM's lecturers specifically and other universities that implementing OBE generally.Some of the significant benefits are: -To reduce the amount of time in preparing examination paper, and emphasis should be given to assign each question with suitable learning outcomes -To improve the quality of examination paper by assigning each question with suitable learning outcomes that need to be achieved by the course.
This paper focuses on the development of LoQET prototype for the UPM.The activities conducted in this development are based on the common activities involved in software development methodologies.The remainder of the paper is organized as follows: In the following section, we provide a brief background of OBE and its implementation in UPM.Section 3, describes the activities conducted in developing LoQET.Section 4, discusses the findings based on the conducted development and evaluation.Finally, in Section 5, we draw conclusions and put forward future directions.

Background
Some overview of OBE and the implementation of OBE in Universiti Putra Malaysia (UPM) are given in this section.

OBE Approach in Malaysia
OBE is now being implemented in Malaysia at all levels of education especially at higher education institutions.
In To be in line with the ministry's objectives, most of public universities in Malaysia have made decision to adopt the OBE approach in their teaching and learning strategy.The significant efforts (e.g., Mohayidin et al., 2008;Jaafar et al., 2008;Shariff et al., 2011) have been continuously done to ensure that OBE is successfully implemented.

OBE Implementation in UPM
The MoE's learning outcomes become the base of UPM's programme outcome (PO).Program outcomes (PO) are the outcomes that students should have achieved by graduation time.UPM has emphasized that the curriculum design and development should be based on the specified outcomes.In which, each course in the particular programme must contribute to the achievement of the PO.Each course should determine the LO and KI that can be measured by each of the student.It was the decision of the curriculum planners that specified learning outcomes of each course (course LO) comprises of three learning domains; Cognitive, Psychomotor and Affective.In addition, the KIs should be embedded in the curriculum as part of UPM continuous efforts to ensure graduates able to adapt to any economic situations and seek for employment.Where, one to three KIs must be embedded in each course.
In order to know what the students are learning, and about the extent to which they are meeting the LO and KI, is via assessments.In UPM, the course assessment is continuous starting from first week until the end of semester.Essential information on student achievement is analysed at the end of the course learning process and assessment.The LOs can be assessed by using variety of assessment methods such as, test, final examination, quiz, assignment, project, and peer-assessment.As for paper based examination, the important information that should take into account in the paper is the question relationships with PO, LO, and its level.

Technology-based OBE Supporting Tools in UPM
UPM has provides a system called Student Information System or e-SMP in order to support activities in teaching and learning.The e-SMP offers few modules that facilitate lecturers, administrations, as well as students.Some of the main modules are student registration, course assessment, and course teaching plan.Furthermore, UPM has also plans and progressively develop more modules to be integrated to e-SMP in supporting the implementation of OBE.Since e-SMP provides a lot of facilities and information, thus, it motivates us to utilize the available information and data to help ensuring the implementation of OBE.At the same time, to enhance the e-SMP functionalities and help in reducing lecturer's efforts.In which, preparing examination paper is not only a repetitive and time consuming process, it is also challenging when the emphasis should been given to assign each question with suitable LO.Therefore, we propose a tool for assisting lecturer in preparing examination paper, called LOs-based Question Examination Tool (LoQET).The tool empowers the lecturer to generate effective and better quality examination paper in a very short span of time thus allowing the www.ccsen lecture to based on repository

LoQET
The main a

Analys
Before Lo requiremen understand data and e and extend the study gathered fr in Figure 1 The    on data from e-SMP.Thus, some modification and adjustment to e-SMP database design need to be considered.
The database design should be modifiable and expandable for future enhancement.The improvement that should be made is not only to support LoQET but also beneficial to other new modules that can be integrated with e-SMP in the future.
For LoQET development, the analysis and design stages were involving users is an iterative and rapid prototyping development cycle.In rapid prototyping, LoQET prototype are developed which can be quickly modified in line with users' evaluation and feedbacks.System testing and experts' review were also conducted to evaluate the final product.System testing aims to ensure that all the provided functionalities are functioning and implemented as in the proposed design.This testing was conducted by the developer and research team members.All the necessary modification required are fixed and done before the system is release for experts' review.
While for the experts' review, LoQET was introduced and demonstrated to a group of lecturers as the group of experts.They were given for a week to evaluate the functionalities of the system.Suggestions for improvement were proposed both during the evaluation.The suggestions were regarding LoQET's functionalities and the interface design.The conclusion of the experts' review was that LoQET does help lecturer and provide basic facilities in preparing examination paper according to the POs and LOs set in e-SMP.However, they have also highlighted some functionality that need to be improved in order to achieve OBE objectives to the fullest.Given that LoQET is a prototype, thus, in order to deploy and integrate it in the real environment required a thorough study on the design, as well as software and hardware to be used.
The development of LoQET requires deep understanding on the business process and procedures of the domain.Thus, high involvement of lecturers, and knowledge and skill of the development team are essential.Agile development methodology seems a better choice for this particular situation.Based on our experience, we have spent a lot of time and effort at design stage.Even though the functional requirements are clear and firm, however, designing the system to fulfilling the functionalities is quite challenging.Feedbacks from users were important input for this stage.A few iterations of design have been made to improve the final design.

Conclusion
This paper describes the development of LOs-based Question Examination Tool (LoQET), for assisting lecturer in preparing examination paper based on POs and LOs set in the teaching plan and assessment entries.The main requirements and design elements are emphasized in the development activities.Some issues that need to be considered for the development are also discussed.Hopefully, those can act as guidelines on developing such system.
LoQET empowers lecturer to generate effective and better quality examination paper in a short span of time and allowing the lecturer to be more productive for other workloads.Our current and future work direction aims to develop a comprehensive assessment system that will facilitate implementation of OBE in higher institutions.The undergoing project is a system, called Examination Management System (EMaS), which aims to support supervision, execution, and evaluation of the examination paper.LoQET is part of EMaS and come together with other modules that aim to assist administration in managing and monitoring the implementation of OBE in the examination paper, and generate reports on student's performance and OBE achievement.