The Design and Implementation of Intelligent Assessment Management System

(1)

The Design and Implementation of Intelligent

Assessment Management System

Y.C Lu , Y.S Yang , P.C Chang , C.S Yang

2013 IEEE Global Engineering Education Conference at Berlin ,Germany

Dep't of Electrical Engineering, NCKU, Taiwan Tel: 886-6-2757575 ext. 62400,

(2)

Outlines

• Introduction

• System Design

• System implementation

• Conclusions

2

(3)

Outlines

• Introduction

• System Design

• System implementation

• Conclusions

(4)

Introduction(1/3)

• Online education has become one of the popular subjects in

higher education research and application.

• Typical online learning systems existing are based on

web-based system and these systems are usually comprised of

some functional subsystems.

– Such as Web Course System , Online Q&A (Question and Answer) System , online Testing System.

(5)

Introduction(2/3)

• However , typical online learning systems have some

disadvantages listed below.

– Learning activities are mainly through virtual interactions and

environments.

– It is hard to confirm the personal identification effectively, and monitor students’ activities during the exam.

– Students’ learning results which generated from the typical online learning system are lack of the correctness and the fairness ,and a

great deal of data accumulated during the teaching and learning process have not been made full use .

(6)

Introduction(3/3)

• In the paper , we propose a system that aimed to the practice of

current summative examination . The new system provides a

hybrid structure for integrating virtual online assessment

management system and in-classroom examinations.

(7)

Outlines

• Introduction

• System Design

• System implementation

• Conclusions

(8)

Design Concepts

• To improve the fairness and effectiveness of assessment ,and

provide personalized remedial education to the student

– Confirm the personal identification effectively

– Reduce the possibility of violating the exam regulations

– Use the assessment management tools that are handy to operate and can be processed in time

• We apply the following objects to design our system

– i-Tag(Intelligent tag) : for location management

– Digital certificate and signature: for identity authentication – Personalized exam and question items : for reducing cheat – Invigilator APP : for double check the examinees’ identity

8 System Design

(9)

Features

• Intelligent Assessment Management System (IAMS) has the

following features:

– Comprehensive and integrated framework

– Adaptive evaluation module for students and invigilators

(10)

Comprehensive and integrated

framework

• “Comprehensive” means

– different technologies and applications

– NFC-enabled tablet, digital certificate and signature technique,

NFC technology and various management APPs for better

performance in the IAMS.

• “Integrated” means

– system gets information from students, course instructors and

invigilators during the assessment time.

10 System Design

(11)

Adaptive evaluation module for

students and invigilators

• The IAMS gets meaningful data

– static information

• Ex: exam result

– dynamic information

• Ex: users’ behavior and actions in the assessment time.

(12)

Relationship between managed objects

12 System Design

(13)

Application Context

NFC-enabled tablet

(14)

System Architecture of IAMS

14 System Design

(15)

Outlines

• Introduction

• System Design

• System implementation

(16)

System Components(1/3)

16 System Implementation

(17)

System Components(2/3)

• Examination Space Management Module

– Arranges available examination time , rooms and seats – Corresponds i-Tags of each room and seat

• Authentication Module

– Provides services for user login ,verification of digital certificate and signature ,and user profile management.

(18)

System Components(3/3)

• Assessment Management Module

– provides functions of question bank establishment, test developing, test grading, and results analysis and feedback.

• Location Management Module

– Provides information of user location and related location records.

(19)

System workflow

(20)

Examination space configuration

• Examination space managers need to use Exam space

management APP to configure the exam space.

(21)

Exam space management

(22)

Arrange examination activity

• Course instructors use Assessment Management APP to

arrange information and questions of the exam.

(23)

Workflow of add a new exam activity

(24)

Add a new exam activity

(25)

Workflow of adding new questions

(26)

Adding new questions

(27)

Proceeding Examinations

• Students use Student APP to log in the system and start to

exam.

• Invigilators use Invigilator APP to check the identity of the

examinee and report the violation if needed.

• Course instructor uses Assessment Management APP to get

real-time information of the course student.

(28)

Workflow of students participate exam

(29)

Student choose his digital certificate

(30)

Student login to use digital certificate

(31)

Start the exam

(32)

Invigilator identify examinee

(33)

Invigilator report exam violation

(34)

Course instructor gets real-time

info of the examinees

(35)

Follow-up Activities

• Course instructors

– Use Assessment Management App to do online check

– System provides the statistics and analysis information of answers to the instructors

– The statistics information help instructors to modify the teaching activities and provide remedial learning.

• Students

– Get personal exam grade and all correct answer of the exam. – Remedial resource will be provided to the student automatically.

(36)

Statistics of the exam result

(37)

Remedial material in Student app

(38)

Outlines

• Introduction

• System Design

• System implementation

• Conclusions

38

(39)

Conclusions

• The paper proposed a hybrid structure that integrates both

advantages of digital and traditional assessments and also

guarantees fairness

• The IAMS system can improve the effectiveness of

assessment ,and instructor can recognize each student’s needs

more accurately and providing personalized remedial

(40)

Acknowledgement

• Project support

– Center for Technologies of Ubiquitous Computing and Humanity , National Cheng Kung University , under projects from Ministry of

Education and the National Science Council(NSC-100-2218-E-006-033 and NSC-100-2218-E-006-017) of Taiwan.

• Travel Fee

– National Science Council under grant NSC-102-2922-I-006-026 – National Cheng Kung University under grant D102-14103

(41)

(42)

• NFC is a non-contact short-distance transmission technology

evolved from radio frequency radio(RFID) technology. NFC

technology is developed by Sony and Philips. NFC currently

meet the international standards (ISO 180921,ECMA 3402 and

the ISO 14443)

• NFC features:

– The frequency that NFC used is 13.56MHz.

– The transmission distance for NFC is only 10cm . – Low power consumption

– Connect to a device once a time – High confidentiality and security.

Near Field Communication(NFC)

(43)

NFC Micro payment e-Ticket

……

LBS Education Authentication

(44)

IAMS Workflow(1/5)

• Phase 1: Examination Space Configuration

– Available and administrable examination room should be configured before examination.

– Examination Room Managers configure i-Tags in each examination room and seat.

(45)

IAMS Workflow(2/5)

• Phase 2: Arranging related affairs of examination

– After allotting available and administrable rooms, course instructors can generate an exam using IAMS.

– Course instructors decide the scope and questions of the exam to

generate an exam ,then choose available examination time and rooms to reserve the exam event.

(46)

IAMS Workflow(3/5)

• Phase 3: Proceeding examinations

– Students:

• During examination period, students can choose any of available examination room and seat to take an exam.

• After induct the i-Tag of the seat , students’ identity are checked using digital certificate.

• Students’ answers will be signed with digital signature and upload to the system after finishing the examination.

(47)

IAMS Workflow(4/5)

• Phase 3: Proceeding examinations

– Invigilators:

• Responsible for keeping fairness and stability of the examination • Verify students’ identification and personal information, and return

verified results to the system

• Report violation of exam regulation

– course instructors :

• Inquire the location of the student taking the course exam.

(48)

IAMS Workflow(5/5)

• Phase 4: Follow-up activities after the exam

– When examinations come to the end of the stage, course instructors can use IAMS to do online checking(if necessary).

– Students attending the exam can get personal grade and all correct answer of this exam for remedial education.