Instrumentation and Data Collection

The research tools. A pre-examination procedure is developed after analyzing the literature review. The weak questions are determined through the examination by experts.

This process allows the study to increase its reliability and validity. The tools of the study are (a) the Kano Model Scale for the demand of the recording officials in Short Track Speed Skating competitions for the App functions; (b) the basic information of the referees at different levels.

The Kano Model Scale for the demand of the recording officials in Short Track Speed Skating competitions for the App functions. The questions of the pre-examination include 59 questions (Table 8 and 9) on application functions for before, on-going and after the

competition. The interview questions referred to the Kano Model. The Kano model is a theory of product development and customer satisfaction, developed in 1984 by Noriaki Kano, which classifies customer preferences into five categories:

1. Must-be Quality: These attributes are taken for granted when fulfilled but result in dissatisfaction when not fulfilled. Since customers expect these attributes and view them as basic, it is unlikely that they are going to tell the company about them when asked about quality attributes.

2. One-dimensional Quality: These attributes result in satisfaction when fulfilled and dissatisfaction when not fulfilled. These are spoken attributes and are used by companies to compete.

Table 8

The Kano Model Scale of the demand of the recording officials in Short Track Speed Skating competitions for the App functions before the competition

Facets The process of the competition

Questions

The factors of quality Source

The App functions Before the competition Four weeks before the competition Must-be

Quality, 1. The App offers the bulletin board function for the announcement

2. The App offers the push notification function for the announcement 3. The App offers the ringtone function for the announcement 4. The App offers the calendar function for the announcement Five days before the competition

5. The App offers the mailing function for application 6. The App offers the push notification function for application 7. The App offers the ringtone function for application 8. The App offers the office function for application

9. The App offers the digitalized form function for application 10. The App offers the page optimization function for application Two days before the competition

11. The App offers the mailing function to make the seeding 12. The App offers the push notification function to make the seeding 13. The App offers the ringtone function to make the seeding 14. The App offers the office function to make the seeding

15. The App offers the digitalized form function to make the seeding 16. The App offers the page optimization function to make the seeding 15:00 a day before the competition

17. The App offers the bulletin board function for posting the seeding 18. The App offers the mailing function for posting the seeding 19. The App offers the push notification function for posting the seeding 20. The App offers the ringtone function for posting the seeding 21. The App offers the office function for posting the seeding

22. The App offers the digitalized form function for posting the seeding 23. The App offers the page optimization function for posting the seeding 18:00 a day before the competition.

24. The App offers the instant message function for commenting on the seeding 25. The App offers the memo function for commenting on the seeding

26. The App offers the push notification function for commenting on the seeding

27. The App offers the ringtone function for on the commenting seeding 3 hours before the competition

28. The App offers the bulletin board function for posting the make-up of the races

29. The App offers the push notification function for posting the make-up of the races

30. The App offers the office function for posting the make-up of the races 31. The App offers the digitalized form function for posting the make-up of the

races

32. The App offers the page optimization function for posting the make-up of the races

Table 9

The Kano Model Scale of the demand of the recording officials in Short Track Speed Skating competition for the App functions during and after the competition.

Facets The process of the competition Questions

The factors of quality Source

The App functions During the competition After the heat, quarter-final, semi-final and final round Must-be

Quality,

races for the next round

2. The App offers the push notification function for posting the make-up of the races for the next round

3. The App offers the office function for posting the make-up of the races for the next round

4. The App offers the digitalized form function for posting the make-up of the races for the next round

5. The App offers the page optimization function for posting the make-up of the races for the next round

After the each race

6. The App offers the instant message function for commenting on the race 7. The App offers the push notification function for commenting on the race 8. The App offers the ringtone function for commenting on the race 9. The App offers the memo function for commenting on the race 10. The App offers the office function for making the time and order form 11. The App offers the digitalized form function for making the time and order

form

12. The App offers the page optimization function for making the time and order form

13. The App offers the playing video function for checking the race

The App functions After the competition Right after the competition

1. The App offers the bulletin board function for publishing the final result 2. The App offers the push notification function for publishing the final result 3. The App offers the ringtone function for publishing the final result 4. The App offers the sharing function for publishing the final result 5. The App offers the office function for determining the final result

6. The App offers the digitalized form function for determining the final result 7. The App offers the page optimization function for determining the final result 8. The App offers the calculating function for determining the final result 30 days after the competition

9. The App offers the mailing function for reporting the final result 10. The App offers the push notification function for reporting the final result 11. The App offers the ringtone function for reporting the final result 12. The App offers the office function for determining the final result

13. The App offers the digitalized form function for determining the final result 14. The App offers the page optimization function for determining the final result

3. Attractive Quality: These attributes provide satisfaction when fully achieved, but do not cause dissatisfaction when not fulfilled. These are attributes that are not

normally expected. Since these types of attributes of quality unexpectedly delight

customers, they are often unspoken.

4. Indifferent quality: These attributes refer to aspects that are neither good nor bad, and they do not result in either customer satisfaction or customer dissatisfaction.

5. Reverse quality: These attributes refer to a high degree of achievement resulting in dissatisfaction and to the fact that not all customers are alike.

The Kano model offers some insight into the product attributes which are perceived to be important to customers. The purpose of the tool is to support product specification and discussion through the better development of team understanding. Kano's model focuses on differentiating product features, as opposed to focusing initially on customer needs (Kano, 1984).

The respondents can evaluate the application functions using 5 quality factors of the Kano evaluation (Figure 7), Must-be Quality (M), One-dimensional Quality (O), Attractive Quality (A), Indifferent quality (I), Reverse quality (R), for each question. The questions of the interview can be modified by the result of the pre-examination with the experts.

Figure 7. The Kano model. Source: “A new fuzzy concept approach for Kano’s model”, Lee, Y. C., & Huang, S. Y. , 2009, Expert Systems with Applications, 36(3), 4479-4484.

Through the pre-interview with experts, the interview questions on the Table 8 and 9 were revised. In the revised interview, the researcher firstly explains how to evaluate the each App function with 5 quality factors of the Kano model, and then participants choose and evaluate the App functions for the each recording procedure before, during, and after the competition (Appendix B).

The basic information of the recorders at different levels. The basic information of the recorders includes (a) gender; (b) age; (c) educated level; (d) occupation; (e) level of license;

(f) career and experience; (g) number times of competition participation per year.

Reliability and validity. Triangulation is the combination of two or more data sources, investigators, methodologic approaches, theoretical perspectives (Denzin, 1970; Kimchi et al., 1991), or analytical methods (Kimchi et al., 1991) within the same study. These combinations result in data triangulation, investigator triangulation, methodological triangulation,

theoretical triangulation, (Denzin, 1970; Patton, 1990), or analytical triangulation (Kimchi et al., 1991).The benefits of triangulation can include increasing confidence in research data, creating innovative ways of understanding a phenomenon, revealing unique findings, challenging or integrating theories, and providing a clearer understanding of the problem (Jick, 1979). Thus, the researcher can increase the reliability through data triangulation. The reliability can be measured by comparing the similarity of the information which was investigated by the researcher, collected literature, and the result of the interview with

recording officials in 3 different positions. The question and outline of the interview are those are including all analysis results and the advice of the experts. It is expected to increase the validity of the study.

Target and data collection. According to the KSU general regulation (2016), there are three levels within the position of referee. The lowest level is 3, and the highest level is 1. An international referee has to be approved by the ISU. The referees include referee, competitor steward, and starter. There are no limitations to the gender, age, and level of education,

however, referee must not be a current coach. The referee must have previous experience in skating. The researcher of this study has worked as a referee since 2011 in Korea, and hence knows more than ten referees. However, the KSU is not open about the official number of referees. The conditions of each level are:

1. Level 3: A referee at this level should participate at least three times per year in the competition. A referee at this level can move to level 2 after a year.

2. Level 2: A referee at this level should participate at least six times per year in the competition. A referee at this level can move to level 1 after two years.

3. Level 1: A referee at this level should participate at least eight times per year in the competition. A referee at this level can be an international level after three years.

4. International level: A level 1 referee can be recommended to be an international referee by the KSU. They can officially become an international referee after passing an examination of the ISU.

Purposive sampling is widely used in research for the identification and selection of information rich cases related to the phenomenon of interest. In purposive sampling, the researcher selects individuals who are considered representative (Palinkas et al., 2015).

Therefore, the targets of the interview are individuals in each professional group. Also, the professionals in the target groups can introduce other experts to the researcher. In this process, the researcher can clarify not only the criteria of the subjects but also the outlines of the

interview. This is because the researcher can obtain the expert knowledge of the statement of the problem. The sampling continues until the researcher senses that saturation has been reached. The type of saturation the researcher is aiming for may not be theoretical saturation.

“Saturation of knowledge” is a better term (Bertaux, 1981). Bertaux (1981) describes how the researcher is surprised or learns a great deal from the first few interviews. By the 15^th

interview, the researcher recognizes patterns in the interviewees’ experiences. More

interviews confirm what the researcher has already sensed. How saturation of knowledge is

reached or passed during sampling is uncertain. According to Mason (2010), it is more likely Ph.D. students using qualitative interviews will stop sampling when the number of samples is a multiple of ten rather than when saturation has occurred. Thus, the researcher planed to conducts the interview with ten in the position of referees, other operational officials, and coaches: (a) three referees at international level; (b) one to five referees in level 1, 2, and 3; (c) three other officials; and (f) three of coaches. In the interview, the participants firstly choose the App functions which are needed for each procedure before, during and after the

competition, and then they evaluate the each App function as one of the quality factor in the Kano model. The researcher stops the interview when the similarity of complete responses is over 80%. The similarity of responses can be presented by duplication of answering subjects.

However, 7 people finally consented to participate in this interview, and others did not want to participate in this research.