This qualitative interview involved staffs who passed the competency-based course accreditation and reviewers who have reviewed cases of the accreditation.
The results gotten by interviewees and the researcher clustered the same items into one main factor which includes factors of Attitude to the accreditation expectations, Information, Course, Resources and Communication and Convincing.The items below the factors and details information in each item showed in Table 4.1. In Chapter 4, the researcher used five main factors to categorize and to describe.
Attitude to the Accreditation Expectations
In the critical factor of attitude contains two main factors which are the determination and intention of preparing the whole process and the deep knowledge of competency-based course accreditation.
The Determination and Intention of Preparing the Whole Process
The route of prepare for the whole process is long and need to spend lots of time. The facilities not only need to finish original task but also extra work for preparing for the accreditation. Therefore, the positive attitude for the accreditation is very important. The statements are as follow:
“The applicants have lot of their original tasks. While involving in the process of accreditation, they need to spend extra time to prepare (Bfb05).”
“The applicants should have determination to prepare of all the process. If the level of intention was high and did big effort to finish the whole process, the possibility of passing the accreditation will be high (Bgb08).”
“If you have strong eager to finish the whole process, you will have complete plan for the whole thing before everything starts. Positive attitude for the prepare work is significant.
It is relevant to the continuous process (Bfb08).”
28
29 Table 4.1.(Continued)
Aa Ab Ac Ad Ae Af Ag Ba Bb Bc Bd Be Bf Bg
Course Analysis V V V V V V V V V V
The develop of competency structure
V V V V V V V V V
V
The logic of
course design V V V V V V V V
Resources Supporting
V V V V V V V V V
Teamwork
V V V V V V
Communication and Convincing V V V V
30
“From now on it is hard to find the outcome of passing the accreditation so having the positive view to the accreditation is important. If they have the heart to fulfill the whole process then they will do anything and try anyway to finish it (Bfb08).”
What to keep applicant to keep going for the whole process is to have a positive thinking, which showed in the following statements. As Adam said:
The applicants need to have passion and determination. The accreditation was not supported by higher manager. Why do I need to do a lot of extra work? It is important to keep the learning heart and passion. The experience will be helpful. In the condition of lack of support positive thinking is important. It is important to know for what reason and for what purpose they want to apply for this accreditation. After realizing for what reason to fight, they start to have intention to finish all the things (Aeb12).
It is a really huge process and time consuming for the whole process of preparing for the accreditation so the positive thinking for applicant is really important. To realize of why they fight and what they will get from this let them do anything to finish all the task. The determination and the intention from applicant is a critical factor.
The Deep Knowledge of Competency-Based Course Accreditation
In this factor most interviewers who mentioned are reviewers. Do some work to get more information? They should know the details in each part and the big structure of ADDIE model. Except the knowledge of course design, since this accreditation is focus on competency-based course, the applicant should have clearly concept of competency analysis.
The interviewers mentioned as followings. As Alex said:
We should know how to arrange the main point in eighty pages and realize what the main point in every part is. We should think about what to present to the reviewers.
31
Since we have deep realization in the accreditation, the process of writing the whole thing is not difficult for us (Afb05).
Angus said:
The accreditation had held some instruction meeting to tell us how to prepare for the accreditation. The meeting in Taipei was full, I went far to join the meeting in Hsinchu.
The more I realize on the accreditation the higher possibility to pass the accreditation (Agb03).
“All members in my department realize the concept of Addie. They know how to design a good course (Aeb07).” Bob2 said:
The main point of passing the accreditation is having sufficient realization of Addie model, which means to realize what is the mission and the concept of the model and to realize why to use ADDIE. It is ordinal; the course design should follow the process (Bab02).
“The applicant not only should have clear knowledge of ADDIE model but also the concept of competency-based course. The connection of process should have close relation.
The competency of job request should show in the document (Bbb02).”
“Sometimes they didn't know how to design a course well. They did not have strong knowledge of ADDIE. They should learn more or join some workshop (Bfb06).”
The accreditation offered the manual on the website; the applicant should in deep familiar with it. The statement showed in the following:
“They should read over the manual the accreditation offered and be familiar with thirty
32
criteria. There are a lot of terms which are not easy to understand. Therefore, it is important to realize all the detail in the manual (Bgb8).”
The applicant should read the manual the competency-based course offered. They should realize what the meaning of every criterion. The applicants should do some work to collect information or join some instruction meeting to increase the knowledge of competency-based course accreditation.In the critical factor of attitude contains two main factors which are the determination and intention of preparing the whole process and the deep knowledge of competency-based course accreditation. The route of prepare for the whole process is very long and need to spend extra time of original tasks. The positive attitude for the accreditation is very important to let one keep going for the process until the whole preparing work ends. The strong eager will lead to high possibility of successful passing.
Therefore, the determination and the intention from applicant is a critical factor. It is important to have deep knowledge of competency-based course accreditation including the ADDIE model and the method of competency analysis. Barron (2006) mentioned:
It is incredibly risky to place instructors into a course who have never demonstrated competence in a particular online environment. Targeted faculty orientation and training can reveal critical elements of skill and need. Requiring facilitators to participate in an orientation or initial training can reveal their aptitude and positions. (p.362)
The applicants need to realize what the main point is in every part so when preparing for the accreditation, they can do the right thing and make it more effective. Some applicants even go far away from their company to join the meeting of introduction of the accreditation.
They thought the more knowledge they knew, the higher possibility they could pass the accreditation.
33
Information
There are three factors in the critical factor of information, which are pervious plan, organized document and evidence and prove document.
Pervious Plan
When doing everything it is important to plan first. Plan for every stage and put it in the schedule is very helpful to develop the following time schedule. Alex said:
In the previous stage of plan, we listed down the entire thing needed to be done by each stage followed by the criteria. The list we wrote down was in very detail, which was as detail as for whom to involve the stakeholder meeting (Afb06).
“We draw the big structure first and then put in details step by step. We also inspect if the information were collected in time before the schedule we planned (Aeb08).” Alex said:
At the previous stage we had planned what to do in every stage. Some evidences were difficult to collect when the time already passed. It is easier to have a good plan first.
The follower steps will be easy to do by following all the steps (Afb05).
“It is better to list down all the potential stakeholders no matter it are for interview or the stakeholder meeting. By doing so, it is benefit for the whole process (Afb12).”
Some evidences were difficult to collect when the time already passed. Therefore, it is better to have a good plan first. The follower steps will be easy to do by following the plan. It is better to list down all the potential stakeholders no matter it is for interview or the stakeholder meeting. By doing so, it is benefit for the whole process and don't need to be worried in urgent.
34
Organized Document
The time for reviewer to examine is not quite long, so how to let reviewer realize the whole process is very important. The big amount of data and evident should organize well to let reviewer easy to identify. The statements are as follow. Bill said:
First main factor is to follow ADDIE. Second, due to the limit of the rule in eighty pages, the document which needed to put in should extract vital information only. The document to put in is not the more the better (Bcb02).
Ben mentioned:
The time for reviewers to examine was not quite long so if the information is easy to identify would be a critical factor. The most critical factor is to meet all criteria the accreditation request. The second important factor is to organize data let them present in a logic and clear way (Bbb05).
“The document which reviewers need to examine is quite a lot. If the reviewer didn't have lot of experience, when the time ends they can only inspect only one third of document (Beb05).”
“The accreditation only uses paper-review way to examine the whole process so the information should be very clear. (Bfb05).” Bill said:
We will check the evaluation method if it fit the skill it require or not. We also examine if it evaluate by every single trainers. What the percentage of every source and how it be measured should be clearly described. The evidence should the products, test sheet and some reports. Therefore the file is very huge, it should be well organized to let reviewers
35
identify in short time (Bcb02).
The ability of writing a report is important. The skill of writing words in short sentence and full meaning is a critical factor. Betty mentioned:
The recommendation for applicants will be enhanced the ability of writing the report and increase the knowledge of course development. If the skill is insufficient, they should get more training. There are many classed or speech about competency course so they are easy to get close the class and to figure out what the main point of the competency-based course (Bfb12).
Since the time for reviewer to inspect the document, it is important to arrange information in a easy way to identify. Moreover, the way of examination only use in handing paper,so it is important to let paper talk and to let reviewer recognize information in a short time. The skill of writing and the knowledge of course development and competency can be trained by taking class so this factor can take effort to improve.
Evidence and Prove Document
The applicant not only should offer the evidence but also make it clear to let reviewer easy to identify. The reviewer will discuss together if the evidence they offer is appropriate or where they put in the whole document. Also, the reviewer will inspect carefully depend on the date in the evidence to make sure if the order is logic. The statements are showed as following:
“The accreditation had designed a checklist for reviewers to examine item by item. They need to discuss and get consensus at every single item. Sometimes they will miss the information before pointing out together where the evidences are (Bab02).” Abby mentioned:
I thought the critical factor is the process. We conserved all the evidence when the class
36
started and all meeting hold. After finishing the meeting with focus group and stakeholders, the evidence of the meeting can show by photos. Actually, reviewers are very strict to the evidences. They inspect clearly at the date of the meeting and the signatures of the students (Aab05).
“It is important to keep all the evidence, because it is hard to find the evidence after the activity was over. Therefore, it is efficient to keep the information when all stages goes (Aab12).” Ben mentioned:
The evidences are like the link of two stages to describe why it leads to the next stage. if the evidences didn't show up, the connection will be break and the logic will be weak.
The evidence is like the button of the cloth. Everything unsuccessful cases were failed due to the missing connection (Bbb02).
Bonnie mentioned:
The last part is evaluation. Most of people thought it can be start at this stage. Actually, it should be built at the stage of development. It is impossible to plan to examine the result after the whole class. It should plan previous of what is the way to conduct the evidence and the evidence to show the result of learner is effect or not (Beb02).
The interviewer mentioned that it should include the evidence to show the involvement of stakeholders. The reported showed at the following statement:
“How to involve expert to create competency analysis is important to show. The evidence need to show the involvement of stakeholders. They should show the involvement of different stakeholders with different evidences (Bab08).”
37
Besides the evidence of the attendance the interviewers also mentioned that it is important to show the result of learner, which reported on the following statement. Bob mentioned:
We inspect if they use the right evidence to show what they want to prove. For example, the result of learner, the proof of high satisfaction cannot represent the result the learners learned. If they used wrong evidence, it didn't match the criteria (Bab06).
Bill said:
We will check the evaluation method if it fit the skill it require or not. We also examine if it evaluate by every single trainers. What the percentage of every source and how it be measured should be clearly described. The evidence should the products, test sheet and some reports. Therefore the file is very huge, it should be well organized to let reviewers identify in short time (Bcb02).
“At the evidence part, we need to see the proof of if the learners have new behavior to transfer to their work (Beb02).”
Among the result of learner, the accreditation request for the result of every single learner:
“When it mention to the collection of the result, the competency-based course accreditation request for the evidence of every single learner. The facility needs to do extra work to take photos or film to collect evidences (Afb06).” Angus said:
We used two ways to verify if the learner learned what the lecturer taught at the class.
One was record the conversation between learner and customer when they were talking
38
on the phone. The other one was asking their manager to have role play with them and scored them. We spent a lot of time to collect the score of every single learner (Agb05).
The evidence showed up to proof the connection between each stage and the proof of how they accomplished the class. The connections between all stages in ADDIE are proved by evidences. The evidence should involve especially the attendance of the stakeholder and the result of the learners. At the part of result of learner, the accreditation request to show the evidence of every single learner.There are three factors in the critical factor of information, which are pervious plan, organized document and evidence and prove document. Plan for every stage and put it in the schedule is very helpful to develop the following time schedule.
It could help applicants to inspect if the information were collected in time before the schedules were planned. By doing the previous plan, they listed down all the potential stakeholders no matter it is for interview or the stakeholder meeting, so they don't need to be worry in urgent. It is important to put all the information in a clear way because the time for reviewers to examine is quite short and in the opposite the information is huge up to almost eighty pages. Let the reviewer easier to identify in a critical factor. Almost all the interviewees mentioned that the evidences were important. For the key point the accreditation request for the result of every single learner. Expect for the evidence of the learner result, the evidence is important because it showed the connection between two stages. Therefore, the proof of evidence made the logic of course design more smoothly.
Course
The factor of course includes the ability to analyze, develop of competency structure and the connections between each stages.The factor of course includes the ability to analyze, develop of competency structure and the connections between each stages. The analysis is very important part of the whole course, because it is the start step of the whole thing. The course need to design on the condition of there is the demand of industry. The purpose for
39
this accreditation is to eliminate the gap between the academic and industry. After discovering the demand in the industry, the training institutions are able to design the training course to eliminate the competency gap between the industry and employees. Besides, the objective of the accreditation is to cultivate the training institution having the knowledge how to use competency analysis. Applicants need to analysis the competency among the work, and use those competencies to develop the course. It is important to show the evidence how they create it and how they develop the course follow by those competency analyses. They should involve expert of certain industry to build up and discuss the competency structure as a consultant. Then, when all stages are going to develop, it is important to be caution of the connection between each stage. Is must be convinced to connect each stages. Therefore, the order is very important. If the reviewers found that the evidences showed that the process was not in order, they wouldn't let the case pass.
Analysis
In this factor, applicant should point out the demand of the industry. What kind of workers they want? How many employees they need? The purpose of this accreditation is to train the trainers and let them be available to work at the industry. Therefore, the first step of
In this factor, applicant should point out the demand of the industry. What kind of workers they want? How many employees they need? The purpose of this accreditation is to train the trainers and let them be available to work at the industry. Therefore, the first step of