• 沒有找到結果。

Establishing a nationwide emergency department-based syndromic surveillance system for better public health responses in Taiwan

N/A
N/A
Protected

Academic year: 2021

Share "Establishing a nationwide emergency department-based syndromic surveillance system for better public health responses in Taiwan"

Copied!
13
0
0

加載中.... (立即查看全文)

全文

(1)

Open Access

Research article

Establishing a nationwide emergency department-based syndromic

surveillance system for better public health responses in Taiwan

Tsung-Shu Joseph Wu

1

, Fuh-Yuan Frank Shih

2

, Muh-Yong Yen

3,5

,

Jiunn-Shyan Julian Wu

1,4

, Shiou-Wen Lu

4

, Kevin Chi-Ming Chang

4

, Chao Hsiung

7

,

Jr-How Chou

4

, Yu-Tseng Chu

1

, Hang Chang

5

, Chan-Hsien Chiu

4,5

,

Fu-Chiang Richard Tsui

6

, Michael M Wagner

6

, Ih-Jen Su

4,7

and

Chwan-Chuen King*

1

Address: 1Institute of Epidemiology, College of Public Health, National Taiwan University, Taipei City, Taiwan, 2Department of Emergency

Medicine, NTU Hospital, Taipei City, Taiwan, 3Taipei City Hospital, Taipei City, Taiwan, 4Centers for Disease Control in Taiwan, Department of

Health, Taiwan, 5Department of Health, Taipei City, Taiwan, 6The RODS Laboratory, Center for Biomedical Informatics, University of Pittsburgh,

Pittsburgh, PA, USA and 7National Health Institute of Research, Taiwan

Email: Tsung-Shu Joseph Wu - wcsg@msn.com; Fuh-Yuan Frank Shih - fystone@mail2000.com.tw; Muh-Yong Yen - myyen1121@gmail.com; Jiunn-Shyan Julian Wu - julianwu77@hotmail.com; Shiou-Wen Lu - lsw@cdc.gov.tw; Kevin Chi-Ming Chang - kevin@cdc.gov.tw;

Chao Hsiung - hsiung@nhri.org.tw; Jr-How Chou - jchou@cdc.gov.tw; Yu-Tseng Chu - littlepppiiiggg@yahoo.com.tw;

Hang Chang - emergency@ms.skh.org.tw; Chan-Hsien Chiu - zschou@cdc.gov.tw; Fu-Chiang Richard Tsui - tsui@cbmi.pitt.edu; Michael M Wagner - mmw@cbmi.pitt.edu; Ih-Jen Su - suihjen@nhri.org.tw; Chwan-Chuen King* - cc_king99@hotmail.com * Corresponding author

Abstract

Background: With international concern over emerging infectious diseases (EID) and bioterrorist

attacks, public health is being required to have early outbreak detection systems. A disease surveillance team was organized to establish a hospital emergency department-based syndromic surveillance system (ED-SSS) capable of automatically transmitting patient data electronically from the hospitals responsible for emergency care throughout the country to the Centers for Disease Control in Taiwan (Taiwan-CDC) starting March, 2004. This report describes the challenges and steps involved in developing ED-SSS and the timely information it provides to improve in public health decision-making.

Methods: Between June 2003 and March 2004, after comparing various surveillance systems used

around the world and consulting with ED physicians, pediatricians and internal medicine physicians involved in infectious disease control, the Syndromic Surveillance Research Team in Taiwan worked with the Real-time Outbreak and Disease Surveillance (RODS) Laboratory at the University of Pittsburgh to create Taiwan's ED-SSS. The system was evaluated by analyzing daily electronic ED data received in real-time from the 189 hospitals participating in this system between April 1, 2004 and March 31, 2005.

Results: Taiwan's ED-SSS identified winter and summer spikes in two syndrome groups:

influenza-like illnesses and respiratory syndrome illnesses, while total numbers of ED visits were significantly higher on weekends, national holidays and the days of Chinese lunar new year than weekdays (p < 0.001). It also identified increases in the upper, lower, and total gastrointestinal (GI) syndrome Published: 18 January 2008

BMC Public Health 2008, 8:18 doi:10.1186/1471-2458-8-18

Received: 25 April 2007 Accepted: 18 January 2008 This article is available from: http://www.biomedcentral.com/1471-2458/8/18

© 2008 Wu et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

(2)

groups starting in November 2004 and two clear spikes in enterovirus-like infections coinciding with the two school semesters. Using ED-SSS for surveillance of influenza-like illnesses and enteroviruses-related infections has improved Taiwan's pandemic flu preparedness and disease control capabilities.

Conclusion: Taiwan's ED-SSS represents the first nationwide real-time syndromic surveillance

system ever established in Asia. The experiences reported herein can encourage other countries to develop their own surveillance systems. The system can be adapted to other cultural and language environments for better global surveillance of infectious diseases and international collaboration.

Background

With the recent global concern over emerging infectious diseases (EID) and the challenges of the 2003 SARS epi-demics, government health officials in SARS-affected countries have begun to consider various measures of improving their infectious disease surveillance systems [1-4]. Infectious disease epidemiologists and several leading public health administrators at the Centers for Disease Control in Taiwan (Taiwan-CDC) becoming aware of the importance of early detection of EID or bioterrorism, started developing an automatic alert system. Therefore, the Automatic Syndromic Surveillance Planning Task Force Committee was created and recruited infection phy-sicians, epidemiologists, biostatisticians, and information technology (IT) experts in July 2003 to oversee the initia-tion and development of Taiwan's first medical informat-ics-based emergency department syndromic surveillance system (ED-SSS).

To prepare for this project, we reviewed the syndromic surveillance systems of other countries and officials of health informatics at Taiwan-CDC started collaborating with the Real-time Outbreak and Disease Surveillance (RODS) Laboratory at the University of Pittsburgh to develop a real-time syndromic surveillance system for Tai-wan in August 2003 [1,4-8]. RODS, used during the 2002 Olympic Winter Games, is the first commonly used syn-dromic surveillance system in the United States and has been found to efficiently process and analyze data in a timely manner [9-11]. Together, the task force and the RODS group aimed to establish a nationwide syndromic surveillance system within six months to meet the chal-lenges of potential avian flu outbreaks for up-coming win-ter seasons and other future EIDs. To gain more operational level experiences, we also visited the Depart-ment of Health in New York City, where syndromic sur-veillance system was established and has been in daily operation since 2001 [12]. There, the task force members observed routine workflow processes and became familiar with other practical concerns of operating an ED-SSS on a daily basis. Based on these experiences and high popula-tion density in Taiwan, we decided to create a napopula-tionwide surveillance system. To this nationwide ED-SSS, we added

geographical information system (GIS) technology, meant to facilitate epidemiological investigation and feedback between data providers and decision-makers [13].

Using the electronic data from the health information sys-tems already in place in about eighty percent of the hospi-tals in Taiwan required by the National Health Insurance Payment Program and the technical support of the RODS Laboratory at the University of Pittsburgh, Taiwan's ED-SSS has been in operation since March, 2004 [14]. It is the first time in Taiwan that information technology and timely data directly from hospitals has been used with sys-tematic approaches to facilitate public health surveillance. This report shares our experience of establishing an ED-SSS in a non-English-speaking country. It covers the proc-ess of taking into account the various needs at different levels of hospitals, discusses the stages of developing the system, and highlights the characteristics of ED-SSS data collected during the first year. The experiences reported here may benefit other countries seeking to establish or improve their own surveillance systems for infectious dis-ease.

Methods

Preparation and Emergency-Care Hospitals Selected for Establishing an Automatic Syndromic Surveillance System in Taiwan

Initially, two Taipei City Municipal Hospitals that kept electronic files of their emergency department patients' medical information were selected as pilot sites. From these two pilot hospitals, we had learned work flow involved in the process of data transfer, format of Chinese chief complaints, practical concern of ED (such as heavy workload etc.) during and after the 2003 outbreak of SARS, and available electronic ED information from nationwide emergency care hospitals. To obtain more rep-resentative data from various geographical areas, we grad-ually enlisted the cooperation of 189 hospitals nationwide, all offering emergency healthcare. Because many outbreaks of EIDs require emergency health care, these emergency care-designated hospitals were required

(3)

transmit their ED triage and patient data to the Taiwan-CDC electronically on a daily basis (Figure 1).

Process to Develop Taiwan's ED-SSS

Data Collection and Transmission

Nurses at the triage stations at all participating hospitals generated the bulk of the information needed for syndro-mic surveillance. That information included time and date of admission, date of birth, gender, home zip-code, body temperature, triage categories and chief complaints for patients admitted to their EDs. Because the National Health Insurance requires hospitals to keep clinical data written in ICD-9 codes based on the criteria of the inter-national classification of diseases, 9th revision, clinical modification (ICD-9-CM) for billing purposes, we were also able to collect clinical data from initial assessment of each case by an ED physician. These fundamental data were provided in either the health level-seven protocol (HL-7) format or extensible Markup Language (XML) for-mat, if HL-7 was not used by a hospital during the time of the study. Thus, ED-SSS is capable of accepting these data of above-mentioned variables (Table 1), including the patients' clinical and demographical information, and hospital identification numbers, in either format.

All the sentinel hospitals recruited into our system had independent MySQL servers on which their data were saved, plus a remote connecting program for automatic

Table 1: Variables of Patients Collected in both XML-Tag and HL7 Segments/Fields from Emergency Departments of the 189 Emergency-Care Designated Hospitals*

Field Variables XML Tag HL7

Gender of Patients Sex PID.8

Age of Patients Calculated from Date of Birth

Birthday PID.7.2

Address ZIP Codes of Patients ZipCode PID.11.5

Hospital identification number Hospital PV1.3.4

Admission Date/Time of Patients AdmitTime PV1.44

Major ICD-9-CM of ED Patients ICD9_1 DG1.3

Second ICD-9-CM of ED Patients ICD9_2 DG1.3

Third ICD-9-CM of ED Patients ICD9_3 DG1.3

Fourth ICD-9-CM of ED Patients ICD9_4 DG1.3

Chief complaints of ED patients Subject DG1.4

Major diagnostic category of ED Patients

Access Category DG1.7

Body temperature (°C) of ED Patients Temperature OBX

*Only variables of patients' medical information are presented. All the data of ED patients were de-identified before sending them to the Taiwan-CDC.

The System Architecture of Nation-Wide Hospital Emergency Department-based Syndromic Surveillance System (ED-SSS) in Taiwan, Established in 2003

Figure 1

The System Architecture of Nation-Wide Hospital Emergency Department-based Syndromic Surveillance System (ED-SSS) in Taiwan, Established in 2003.

(4)

transfer of data. Data files generated by the 189 hospitals, including data from their triage classification systems, hospital information systems (HIS) and clinical informa-tion systems (CIS), were firstly de-identified and then transferred hourly to a Microsoft SQL Server 2000 at the Taiwan-CDC. Hyper text transfer protocol over secured sockets layer (HTTPS) or secured file transfer protocol (SFTP) was used in this process. All communication histo-ries were recorded in a log file in the SQL server at the Tai-wan-CDC and monitored daily by health informatics personnel. A program was written into the system so that each transfer attempt to the Taiwan-CDC would automat-ically generate an e-mail to the hospital notifying them whether the transfer had been successful or not.

Data Processing

Three different data storage tables were designed to proc-ess the data in the Taiwan-CDC's syndromic surveillance database. All information received is initially fed into the first table, with a serial number generated in an additional column for each case. The system picks up the data from the first table every five minutes and moves it into a sec-ond temporary table for a logic check and data cleansing. At this point, the system checks for unambiguously erro-neous data, e.g., a birth date later than the admission date or other variables such as body temperatures that fall out-side of reasonable ranges. The data cleansing work is accomplished through a system algorithm written with SQL commands. The cleaned-up data are transferred to the third table for further epidemiological analysis, aber-ration detection, and then sent them to related local pub-lic health agencies.

Data Cleansing and Standardization

Although only a few variables were collected from each hospital on consecutive days, one major difficulty we had was the data presented by discontinuous data, i.e. data that sometimes be there and sometimes not. Sometimes data were repeated. To handle this problem, specific crite-ria of data cleansing were used for different vacrite-riables, including the logic checks described above and double checks for possible presence of duplicate patient records. If data in the chief complaint field was written as "test" or the field was left empty or if the ICD-9 field was written as "test" or left empty, they were deleted before data analysis. Hospital ID, date of birth, admission time, gender, and home zip-code were used as key indicators of whether a listing is a duplicate listing and be deleted as repeated data. The system was capable of performing frequent and rapid checks of any subject of hospital identification code and time format of all time fields. It was capable of mov-ing erroneous data to an "error table" for storage. Incor-rectly formatted ICD-9-CM data were also moved to the error table. All deletion and removal operations were recorded in the log file for monitoring. In certain

situa-tions in case possible systematic errors were found (i.e., aberrant number of ED visits on certain days or occasion-ally inconsistent formats of ICD-9 codes), the data exam-iner would contact the medical informatics officers of those specific hospitals to discuss improving data entry.

Data Analysis

After the data cleansing, we categorized ED visits into 11 different syndromic groups important in Taiwan. There were: (1) fever, (2) respiratory, (3) skin, (4) neurological, (5) upper gastrointestinal (GI), (6) lower GI, (7) haemor-rhagic, (8) influenza-like illness (ILI), (9) asthma, (10) enterovirus-related infection (EVI) syndrome, and (11) syndrome for severe illness or death. Since only about 25% of all chief complaints were written fully in English and the grouping of syndromes by chief-complaints due to Chinese language barriers would have effects on the outbreak detection ability, we first analyzed our data according to the ICD-9 coded syndrome groups [15]. Def-initions of clinical syndromes were based on two different sources: (1) those associated with bioterrorism-related agents as announced by the Centers for Disease Control and Prevention (CDC) in the U.S.; and (2) those identi-fied as important by the ED-SSS Advisory Committee in Taiwan, whose members include infectious disease physi-cians, emergency doctors, pediatriphysi-cians, and epidemiolo-gists [16]. For example, because the epidemics of enterovirus 71 caused severe fatal cases in Taiwan in the years of 1998, 2000 and 2001, the EVI syndrome group was considered as an important syndrome group locally (ICD-9 codes listed in Table 2) [17]. All patient informa-tion was de-identified and only aggregated data was used for data analysis. The protocol for this study was approved by the Research Ethical Committee (Institutional Review Board) of National Taiwan University.

Table 2: ICD-9 Codes for Enterovirus-related Infection Syndrome Group

ICD9 Codes ICD9 Description

074 Specific diseases due to Coxsackie virus

079.2 Coxsackie virus: Viral and chlamydial infection in

conditions classified elsewhere and of unspecified site

047.0 Coxsackie virus: meningitis

074.0 Herpangina, Vesicular pharyngitis

074.1 Epidemic pleurodynia, Bornholm disease, Devil's grip;

Epidemic: myalgia, myositis

074.2 Coxsackie carditis

074.20 Coxsackie carditis, unspecified

074.21 Coxsackie pericarditis

074.22 Coxsackie endocarditis

074.23 Coxsackie myocarditis, Aseptic myocarditis of

newborn

074.3 Hand, foot, and mouth disease Vesicular stomatitis

and exanthem

074.8 Other specified diseases due to Coxsackie virus,

(5)

Although the ED-SSS data started transferring on March 10, 2004, we confined our analysis to data collected between April 1, 2004 (when the data became more stabi-lized) and March 31, 2005. Data were organized using sta-tistical programs to perform a descriptive analysis of the daily and weekly plots of different syndrome cases and obtain a baseline pattern for each syndrome in Taiwan. We initially generated the SQL commands for data query-ing and data groupquery-ing into the 11 different syndromic groups. To increase the sensitivity of this ED-SSS in mon-itoring regional patterns of these 11 syndrome groups, we categorized ED-SSS data by four different geographical areas (northern, central, southern and eastern Taiwan), based on major regional variations in the types of

infec-tious diseases. In analyzing the seasonal patterns of ED visits, the correlation between the ILI syndrome and respi-ratory or asthma syndrome was assessed by the value of Pearson's coefficient (R).

Results

Experiences from Planning to Implementation of the Taiwan's ED-SSS

As of December 2005, Taiwan's ED-SSS had the coopera-tion of 187 hospitals distributed across northern, central, eastern and southern Taiwan (Figure 2). Off the main island, where two additional hospitals are located on Kin-men Island and Matsu Island, bring to the total to 189 hospitals transmitting ED data in the required format to

Geographical Distributions of the Participated Hospitals in Nation-wide ED-based Syndromic Surveillance System and Cover-age Rates of the 4 Regions in Taiwan

Figure 2

Geographical Distributions of the Participated Hospitals in Nation-wide ED-based Syndromic Surveillance System and Cover-age Rates of the 4 Regions in Taiwan.

(6)

the Taiwan-CDC on a daily basis. The greatest challenge as began to develop this system was communication with different hospitals. Because different hospitals were using different information systems and inputting different data with various formats, it took long time to agree which var-iables and their data format should be collected. At the very beginning to build the ED-SSS, we had at first intended to collect information on a large set of epidemi-ologically useful variables, including occupation, travel history, family clustering, other exposure-related factors, and address for each patient to help detect possible zoon-osis. However, such data were not collected during rou-tine medical examination and care. Finally, we decided to capture only parameters usually collected by the hospitals during examination, intake and care.

During the planning phase, it was necessary to gain a full understanding of what not only just public health person-nel expected but also what the medical staff at participat-ing hospitals expected from the ED-SSS. Public health officials tended to prefer a timely and sensitive surveil-lance system able to detect all possible outbreaks of emerging or known infectious diseases. Mostly concerned over the limited public health resources, they wanted more evidence to prove the cost-effectiveness of ED-SSS and fewer false positive signals from pilot studies before integrating the system into routine public health surveil-lance workflow. On the other hand, the hospitals and their medical staff had three major expectations. First, the hospitals expected an easily operated feedback mecha-nism and quick feedback of useful information for better decision-making. Those who had experienced nosocomial infection of SARS during the 2003 SARS outbreak were particularly interested having analyzed information, based on their own hospital or regional/national hospital data, quickly fed back them. They believed that this would provide incentive for them to share hospital data and rou-tinely maintain the high quality of their data for public health usage. Second, the hospitals anticipated two-way communication with public health agencies, as they fre-quently been requested or even forced to send data on short notice when they were too busy or too involved in emergency care. What made matters worse, despite their compliance; they had difficulty in obtaining useful feed-back information from the public health agencies so that they could improve their care of patients at the time of an outbreak crisis. Third, the hospital decision-makers wanted immediate firsthand feedback, particularly with regard to control of nosocomial infection and hospital management in order that their health-care workers could be protected during regional outbreaks. Considering the expectations of both public health agencies and hospitals, we learned that the syndromic surveillance system should provide efficient means of feedback and effective two-way communication.

Overview of ED-SSS Data

From April 1, 2004 to March 31, 2005, data transmitted from the 189 hospitals on 2,692,325 ED visits were col-lected and stored in the Taiwan-CDC database. Initially, we appointed two computer engineers to cleanse the data by checking the log files and inform the hospitals by tele-phone on weekdays to correct errors or provide missing data. Then, these cleaned data on daily counts of ED visits collected from ED-SSS were analyzed. The time series plot of rough data on daily numbers of ED visits in our nation-wide ED-SSS during the study period is shown in Figure 3. The computer system shut down twice during this period. The first time occurred from August 8th to August 9th,

when no daily procedure was installed to monitor the quality of uploaded data. The second time was from March 1st to March 15th, 2005, because there was a

mas-sive influx of data during the Chinese New Year holidays. To help both hospitals and public health agencies per-form routine data quality checks, we installed a computer program having check-up procedures of data quality after each data transfer from the hospital to the Taiwan-CDC for automatic quality control of data. This program records all the logs of each data sending from the partici-pated hospitals. If Taiwan-CDC doesn't receive data from hospitals, program will send e-mail automatically to inform the personnel of health informatics in that hospi-tal about failure sending. System maintenance personnel need to check the log daily and make a phone call to the hospital to verify successful data transfer and quality of data if there are no data transfers in two consecutive days.

Only 5.04% of hospitals failed to send ICD-9-CM data, but almost half (47.4%) failed to send chief complaints. For example, of the 239,617 sets of cleaned data received in July 2005, about 7.1% of ICD-9-CM information was lacking or filled out as 'null' and 54.82% of cases did not include chief complaints. Additionally, certain hospitals transmitted the patients' chief complaints in Chinese, fur-ther complicating the analysis. Because of these difficul-ties, this report focuses on the data based on ICD-9-CM diagnostic codes only. The time-series plots of the 11 syn-drome groups (Figure 4, 5) that may correlate to infec-tious diseases and important health problems in Taiwan (e.g., asthma has become an important pediatric problem in recent years) were analyzed.

Characteristics of Taiwan's Data of ED visits in ED-SSS Understanding the characteristics and patterns of num-bers of ED visits over time from our established ED-SSS in Taiwan is very crucial before we set up appropriate thresh-old levels of different syndrome groups for outbreak detection, There was a significant difference in daily counts between weekdays and weekends, which occurred on a weekly basis. ED visits were 1.288-fold-higher on weekends than on weekdays (p < 0.001), while national

(7)

Daily Taiwan Nation-wide ED-SSS time series plots of total ED visits of the 11 syndrome groups plus asthma visits, Apr. 1, 2004 – Mar. 31, 2005

Figure 4

Daily Taiwan Nation-wide ED-SSS time series plots of total ED visits of the 11 syndrome groups plus asthma visits, Apr. 1, 2004 – Mar. 31, 2005.

Daily ED Counts in Nation-wide Hospital Emergency Department-based Syndromic Surveillance System in Taiwan, April 1, 2004 – March 31, 2005

Figure 3

Daily ED Counts in Nation-wide Hospital Emergency Department-based Syndromic Surveillance System in Taiwan, April 1, 2004 – March 31, 2005. ˃ ˈ˃˃˃ ˄˃˃˃˃ ˄ˈ˃˃˃ ˅˃˃˃˃ ˅ˈ˃˃˃ ˅˃˃ˇˀˇˀ˄ ˅˃˃ˇˀˈˀ˄ ˅˃˃ˇˀˈˀˆ˄ ˅˃˃ˇˀˉˀˆ˃ ˅˃˃ˇˀˊˀˆ˃ ˅˃˃ˇˀˋˀ˅ˌ ˅˃˃ˇˀˌˀ˅ˋ ˅˃˃ˇˀ˄˃ˀ˅ˋ ˅˃˃ˇˀ˄˄ˀ˅ˊ ˅˃˃ˇˀ˄˅ˀ˅ˊ ˅˃˃ˈˀ˄ˀ˅ˉ ˅˃˃ˈˀ˅ˀ˅ˈ ˅˃˃ˈˀˆˀ˅ˊ ˖˴̆˸ʳˡ̂ˁ ˖˴̆˸ʳˡ̂ˁ ˖˴̆˸ʳˡ̂ˁ ˖˴̆˸ʳˡ̂ˁ ˗˴̇˸ ˗˴̇˸ ˗˴̇˸ ˗˴̇˸ System down

Chinese Lunar New Year 2005.2.8-2.14

System down

(8)

holidays had significantly higher counts than weekends. The Chinese New Year holidays starting on the eve of the new year, February 8th to February 14th (Tuesday-Monday)

of 2005, had a significantly greater number of daily visits than weekends (15,326 ± 3,560 vs. 9115 ± 2172) (p < 0.05).

During this first year study, the ED-SSS found patients throughout Taiwan were more likely to seek emergency medical services at medical centers than at district or local hospitals. Most patients visiting ED were 60 years old or older (21.46%) or below the age of 10 years old (18.55%). These two groups were also at greatest risk for various infectious diseases, especially influenza (Table 3). Young adults between 20 to 39 years old ranked the third most frequent visitors to ED (17.43%), though traffic acci-dents, not infectious diseases, were the main reasons for their visits. These age distributions suggest that the newly established ED-SSS was capable of providing information for the age groups most at risk for severe cases of infec-tious diseases in Taiwan. Male ED patients slightly out-numbered female ED patients (male : female = 1.12:1), which approximates the general distribution of gender in Taiwan (male/female ratio = 1.10). For elderly ED patients (age > 65 years old), the male/female ratio in our sample was the same as general population (male: female = 1.10:1).

Patterns of the Important 11 Syndrome Groups and Asthma in ED-SSS

To understand the epidemiological characteristics of the eleven important syndrome groups and asthma syndrome in ED-SSS, data of their daily and weekly counts were plot-ted and shown in Figure 4 and 5, respectively. As can been seen in time series plots in Figure 6, the seasonal patterns for ED visits due to respiratory syndrome and ILI syn-drome were quite similar with high correlation (R = 0.98), while that for asthma syndrome, which had distinct peaks, was nonetheless not highly correlated with ILI syn-drome (R = 0.78) nor respiratory synsyn-drome (R = 0.77). Importantly, the ED-SSS was able to detect peaks of these respiratory-related syndromes even occurred in or around the summer season (July to September), though their most noticeable peaks were found during the Chinese new year holidays (Figure 5B, 5C, 5D). Like respiratory infection syndrome, visits due to the fever syndrome also showed another peak during the summer (July to Septem-ber) (Figure 4A). ED visits for respiratory syndrome peaked earlier (mid-September) than those visits for ILI (mid-October) and asthma syndrome (end of September, e.g. the transition period between summer and autumn). Visits for pediatric asthma syndrome for children 12 years old and below peaked in mid-autumn, around mid-Octo-ber (data not shown). Later during winter season (between November and February), there was an increase

Weekly Taiwan Nation-wide ED-SSS time series plots of total ED visits of the 11 syndrome groups plus asthma visits, Apr. 1, 2004 – Mar. 31, 2005

Figure 5

Weekly Taiwan Nation-wide ED-SSS time series plots of total ED visits of the 11 syndrome groups plus asthma visits, Apr. 1, 2004 – Mar. 31, 2005.

(9)

in all respiratory-infection related syndrome, particularly high during the Chinese New Year holidays.

Because Taiwan had a large-scale nationwide outbreak of enterovirus 71 (EV71) with high mortality in 1998 [18],

we also monitored the syndrome of enteroviruses-like ill-nesses (EVI). The ED-SSS found two clear, separate peaks for visits related to EVI, one for each of the two school semesters (Figure 4E, 5E).

Daily Taiwan Nation-wide ED-SSS time series plots of total ED visits of respiratory and ILI syndrome groups plus asthma visits, Apr. 1, 2004 – Mar. 31, 2005

Figure 6

Daily Taiwan Nation-wide ED-SSS time series plots of total ED visits of respiratory and ILI syndrome groups plus asthma visits, Apr. 1, 2004 – Mar. 31, 2005. 0 1,000 2,000 3,000 4,000 5,000 6,000 7,000 8,000 9,000 20 04 /04 /0 1 20 04 /04 /1 5 20 04 /04 /2 9 20 04 /05 /1 3 20 04 /05 /2 7 20 04 /06 /1 0 20 04 /06 /2 4 20 04 /07 /0 8 20 04 /07 /2 2 20 04 /08 /0 5 20 04 /08 /1 9 20 04 /09 /0 2 20 04 /09 /1 6 20 04 /09 /3 0 20 04 /10 /1 4 20 04 /10 /2 8 20 04 /11 /1 1 20 04 /11 /2 5 20 04 /12 /0 9 20 04 /12 /2 3 20 05 /01 /0 6 20 05 /01 /2 0 20 05 /02 /0 3 20 05 /02 /1 7 20 05 /03 /0 3 20 05 /03 /1 7 20 05 /03 /3 1 N o . of Re sp. an d IL I S y n d ro m e 0 10 20 30 40 50 60 70 80 90 100 No. o f As th ma Sy nd ro me

ILI Syndrome Respiratory Syndrom Asthma Visits

Table 3: Demographical Analysis between ED Visits in Nation-wide Hospital ED-based Syndromic Surveillance System and Population Composite in Taiwan, April 1, 2004 – March 31, 2005

Age Groups (Years) Number of ED Visits Percent of Total ED Visits (%) Proportion of Total Population in Taiwan, 2005 (%)

0–9 499,457 18.55% 11.63% 10–19 241,724 8.98% 14.06% 20–29 469,214 17.43% 16.98% 30–39 353,422 13.13% 16.04% 40–49 308,509 11.46% 16.40% 50–59 242,167 8.99% 11.73% 60–69 200,846 7.46% 6.57% 70–79 235,134 8.73% 4.69% 80–89 121,753 4.52% 1.70% 90–100 20,009 0.74% 0.20% >100 90 0.00% 0.01% Gender Males 1,423,835 52.87% 50.78% Females 1,269,193 47.13% 49.22% Total 2,692,325 100.0% 100%

(10)

In gastrointestinal (GI) syndromes, visits due to upper GI or lower GI or total GI started increasing November 2004 and peaked during the Chinese New Year holidays (Figure 4F, 4G, 4H). Interestingly, cases of hemorrhagic syndrome also increased slightly in the winter season (Figure 4I).

For those syndrome groups with severe symptoms, including skin rash, neurological symptoms and death/ coma that might be related to bioterrorism attacks, there was no significantly cyclic or seasonal patterns (Figure 4J, 4K and 4L). One spike of syndrome cases with clinical severity (severe syndrome) appeared in mid-May, but that occurred as a result of one hospital sending duplicate data that escaped from our check algorithm (Figure 4L).

Discussion

Taiwan has very high population density (Taiwan, 632.23 persons/km2; Taipei, 9662.53 persons/km2), which

increases the spread of many human-to-human infectious diseases [19]. This makes the surveillance of infectious diseases very important for this island. Taiwan's ED-SSS is the first syndromic surveillance system to be implemented in Asia. It also represents the first time that Taiwan's pub-lic health agencies have attempted active nationwide sur-veillance. Its automatic data collection mechanism is capable of capturing comprehensive population-based health information and providing important details on current disease epidemics at the community level. The information it provides can also be used as community baseline data for further infectious disease modeling and can also improve the detection of emerging infectious dis-eases.

In addition to the information that the ED-SSS can pro-vide for disease control, it can open avenues for further investigation. For example, in addition to the neurologi-cal syndrome, asthma syndrome, and syndrome for severe symptoms, there were clear and consistent weekend and holiday increases in the visits of other nine syndrome groups. Because cost of ED visits in Taiwan is not as expen-sive as it is in other countries, especially the United States, it is very likely that many patients seek ED medical care when local clinics are closed on weekends and holidays. It is also possible that the gathering of people on the holi-days would increase the transmission of certain patho-gens, particularly on cold days in closed spaces where respiratory viruses including influenza virus are easily transmitted. Therefore, future research might want to investigate the effect of holidays on the aberration detec-tion of outbreaks and predicdetec-tion of number of cases for certain infectious diseases using Taiwan's ED-SSS.

We also found differences in seasonal trends in visits due to symptoms/signs related to respiratory, influenza-like illness and asthma syndromes. Our ED-SSS found a

sum-mer peak in visits for cases with influenza-like illnesses in 2004. This has seldom been found by the previous passive surveillance systems used in Taiwan. These summer cases of influenza-like illness occurred before annual vaccina-tions usually done in October or November. Therefore, a further longitudinal analysis of influenza-like syndrome patterns is needed to formulate the best vaccination policy on human influenza.

Another epidemiological finding from our ED-SSS was an increasing trend in visits due to gastrointestinal syndrome starting late autumn 2004. Such trends have not been detected by other infectious disease surveillance systems in Taiwan. There are two possible explanations for this finding. One reason for the increases might be related to the increased activity of certain pathogens, including rota-virus or nororota-virus, during winter season, as was found during the winter of 2006 in both Japan and Taiwan [20-27]. Another reason might be the social habits of Taiwan-ese who like to dip raw meats and seafood into boiling water fondues and eat from the chafing pot during the winter season. This would increase the change that inex-perienced or careless diners would consume undercook seafood or use chopsticks contaminated by raw seafood.

The findings of our ED-SSS, the first time in Taiwan to use daily rather than weekly data, suggest further directions for research into GI syndrome and many other diseases of significant interest to public health. For example, during the 1998, 2000 and 2001 enterovirus 71 epidemics, chil-dren aged 3 years and younger who were at higher risk of severe or fatal cases of the disease were identified for more effective prevention only after the occurrence of several cases of sudden deaths from weekly sentinel physician surveillance and later retrospective epidemiological data analysis on those cases when sample size became larger. Therefore, prospective monitoring of daily ongoing data of EVI syndrome in this high risk age group and early ED-SSS detection of enterovirus activities by local public health personnel might help minimize social panic among parents. Furthermore, the results on seasonal pat-tern of enterovirus-like infection in our ED-SSS was con-sistent with the previous epidemic patterns in Taiwan, again demonstrating the usefulness of ED-SSS to avoid future large-scale or severe epidemics caused by enterovi-ruses [18]. In summary, these initial findings suggest that it is necessary to develop algorithms capable of detecting aberrations for different syndrome groups from patients in different geographical areas of Taiwan, taking into account variations in the levels of medical care and the effect of weekends and holidays on ER visit.

The ED-SSS did not, however, reveal obvious trends in all syndrome groups. For example, it was hard to find sea-sonal patterns or secular trends in cases of coma/death,

(11)

skin rash, or neurological symptoms – the three syndrome groups that might be useful in the detection of severe out-breaks caused by bioterrorism, e.g., anthrax, during the study period without bioterrorism attacks [28,29]. Cer-tainly, continuous monitoring for these syndrome groups at both local and national levels will be very helpful in detecting possible bioterrorism or EIDs in future years. Using those trends in coma/death and other syndrome groups of clinical severity or unexpected symptoms/signs, our ED-SSS data have provided directions for further research in the areas of pathogen detection, epidemiolog-ical clues, and improvement in public health policies. Therefore, future investigations have to control the week-end and holiday effects of ED visits for better aberration detection even during long holidays.

In daily public health practice to monitor the data of ED-SSS, careful verification and systematic management is needed once the aberration signals are detected. The server needs an automatic error feedback system function instead of the original use of engineers to double check for data errors would increase the efficiency and complete-ness of surveillance. Future efforts require closer collabo-ration between computer-science professionals and medical informatics personnel at the Taiwan-CDC to establish a system with the standard operating procedures (SOP) for database maintenance and to provide more continuous on-job training for both hospital users and local and central public health agencies [30].

The major difficulty in developing our ED-SSS was diverse formats for different types of data, including categories of chief complaints, the ways to fill out ICD-9-CM codes, and even the different number of digits used in home zip codes in different participated hospitals. For example, most Taiwan hospital ED physicians/nurses EDs only write down one chief complaint, which is very different from the ED reports made by most U.S. hospitals which list all possible complaints (with text format) in English. Several participating hospitals only had a paper system for recording triage chief complaint data. A standard format for select syndromes and variables needs to be established and continuously reevaluated to improve data quality and stability of data transmission. There are needs to have more research into the chief complaints with Chinese styles, the suitability of chief complaints vs. ICD-9 codes, how to combine symptoms/signs and link data to improve sensitivity.

Conclusion

With regard to the current epidemics of avian influenza H5N1 in China and many other southeast Asian coun-tries, an ED-SSS like the one we developed in Taiwan may play an important role in detecting an outbreak possibly caused by human-to-human transmission even when

cluster size is small [31-34]. Through early detection, ED-SSS may help minimize the adaptation of avian influenza virus to human populations. Because of the large volume of business traffic, international travelers, and workers from Southeast Asia coming to Taiwan, it has previously been difficult to do real-time surveillance for imported infectious diseases, including dengue, malaria, acquired immunodeficiency syndrome (AIDS) and SARS. How-ever, using the ED-SSS to monitor health status at the community level may help public health decision-makers handle unexpected health threats. Because countries are so interconnected today, it is imperative that we share our health information and experiences with other countries if international health is to be guarded. Our ED-SSS has equipped Taiwan the ability to closely monitor avian influenza and other potential EIDs in Asia and worldwide. We hope that by sharing our experiences developing ED-SSS, other countries can be encouraged to develop and improve their own surveillance systems for infectious dis-ease.

Competing interests

The author(s) declare that they have no competing inter-ests.

Authors' contributions

TSJW was in charge of epidemiological data analysis, improvement of the ED – Syndromic Surveillance System, and manuscript writing. FYFS initiated the thoughts on Syndromic Surveillance for detecting emerging infectious diseases in 2003 and contributed to syndrome groupings, selection of variables for ED-SSS, and system improve-ment based on clinical data analysis. MYY contributed to syndrome groupings, initiating the standard format for collecting Chinese Chief-Complaints in our ED-SSS, and system improvement with regard to clinical aspects. JSJW initiated the thoughts on Syndromic Surveillance for Emerging Infectious Disease in 2003. SWL worked on computer programming on ED-SSS and health informat-ics for surveillance systems of infectious disease at Tai-wan-CDC. KCMC was a leader and coordinator on health informatics for surveillance systems of infectious diseases at Taiwan-CDC and gave the most administrative support on systematic improvement in health informatics. CH provided statistical consultation and chose the best statis-tical modeling method for outbreak detection in the initi-ation stage of establishing the ED-SSS. JHC was the Deputy Director at Taiwan-CDC in charge of improving surveillance of infectious diseases, coordinated the 189 hospitals designated for emergency health care to partici-pate the ED-SSS, and provided strong administrative sup-port on ED-SSS. YTC was a research assistant of ED-SSS in charge of the data analysis and project administrative assistance. HC was the Director of Department of Health in Taipei City and participated in the task force meetings

(12)

from planning to implementation of ED-SSS in the per-spective of the local government. CHC was the Section Chief of Department of Health in Taipei City in charge of surveillance, prevention and control of infectious diseases in Taipei City and gave suggestions health informatics and practical concerns from the viewpoints of local govern-ment. FCRT helped set up the Real-time Outbreak and Disease Surveillance (RODS) system at Taiwan-CDC. MMW introduced our public health officials and scholars in Taiwan to the practical applications of RODS in the USA and informed us of recent progress of RODS. IJS, the former director of Taiwan-CDC, had the vision to invite scholars to discuss the improvement of infectious surveil-lance system in Taiwan right after the 2003 outbreak of SARS. CCK, involved in the improvement of infectious disease surveillance in Taiwan for more than twelve years, initiated research on syndromic surveillance, coordinated each trouble-shooting step as the ED-SSS was developed and implemented, and was involved the revision of the manuscript. All authors read and approved the final man-uscript.

Acknowledgements

This work was supported by both the Taiwan-CDC SARS Research Grant (No. DOH92-DC-SA03) and the Taiwan NSC Grant (No. 92-2571-B-002-020-Y). We would also like to thank Ms. Huei Che Yu at the Dept. of Biostatistics of the National Health Research Institute (NHRI) for her sin-cere efforts in trying different abnormal algorithm detection methods dur-ing our pilot study period. We greatly appreciate administrative support from Taiwan-CDC right at the start of the 2003 SARS outbreak and Dr. Mei-Hsiang Ho at Academia Sinica for her sincere recommendations during the research process and development of this new syndromic surveillance system. We also acknowledged the strong computer technical supports from Ms. Louisa Ho, Mr. Jason Hsu in INQGEN Technology Co., Ltd. and Mr. Jamii Wu in TATUNG System Technology Inc. We would also like to express our sincere appreciation to the three English editors – Mr. James Steed, Ms. Po-Ju Chen, and Mr. Andres Su.

References

1. Irvin CB, Nouhan PP, Rice K: Syndromic analysis of

computer-ized emergency department patients' chief complaints: an opportunity for bioterrorism and influenza surveillance. Ann

Emerg Med 2003, 41(4):447-452.

2. Frenk J, Gomez-Dantes O: Globalization and the challenges to

health systems. Health Aff (Millwood) 2002, 21(3):160-165.

3. Green MS, Kaufman Z: Surveillance for early detection and

monitoring of infectious disease outbreaks associated with bioterrorism. Isr Med Assoc J 2002, 4(7):503-506.

4. Department of Health NYC: Syndromic surveillance for

bioter-rorism following the attacks on the World Trade Center--New York City, 2001. MMWR Morb Mortal Wkly Rep 2002, 51 Spec No:13-15.

5. Mandl KD, Overhage JM, Wagner MM, Lober WB, Sebastiani P,

Mos-tashari F, Pavlin JA, Gesteland PH, Treadwell T, Koski E, Hutwagner L, Buckeridge DL, Aller RD, Grannis S: Implementing syndromic

surveillance: a practical guide informed by the early experi-ence. J Am Med Inform Assoc 2004, 11(2):141-150.

6. CDC US: National Electronic Disease Surveillance System

(NEDSS): a standards-based approach to connect public health and clinical medicine. J Public Health Manag Pract 2001, 7(6):43-50.

7. Carrico R, Goss L: Syndromic surveillance: hospital emergency

department participation during the Kentucky Derby Festi-val. Disaster Manag Response 2005, 3(3):73-79.

8. Lazarus R, Kleinman KP, Dashevsky I, DeMaria A, Platt R: Using

automated medical records for rapid identification of illness syndromes (syndromic surveillance): the example of lower respiratory infection. BMC Public Health 2001, 1(1):9.

9. Gesteland PH, Gardner RM, Tsui FC, Espino JU, Rolfs RT, James BC,

Chapman WW, Moore AW, Wagner MM: Automated syndromic

surveillance for the 2002 Winter Olympics. J Am Med Inform

Assoc 2003, 10(6):547-554.

10. Espino JU, Wagner M, Szczepaniak C, Tsui FC, Su H, Olszewski R, Liu

Z, Chapman W, Zeng X, Ma L, Lu Z, Dara J: Removing a barrier

to computer-based outbreak and disease surveillance--the RODS Open Source Project. MMWR Morb Mortal Wkly Rep 2004, 53 Suppl:32-39.

11. Tsui FC, Espino JU, Dato VM, Gesteland PH, Hutman J, Wagner MM:

Technical description of RODS: a real-time public health sur-veillance system. J Am Med Inform Assoc 2003, 10(5):399-408.

12. Heffernan R, Mostashari F, Das D, Karpati A, Kuldorff M, Weiss D:

Syndromic surveillance in public health practice, New York City. Emerg Infect Dis 2004, 10(5):858-864.

13. Rolfhamre P, Grabowska K, Ekdahl K: Implementing a public web

based GIS service for feedback of surveillance data on com-municable diseases in Sweden. BMC Infect Dis 2004, 4:17.

14. Liao HC, Wu TY, Chien YM: The Critical Factors Affecting

Hos-pital Adoption of Electronic Medical Records in Taiwan: A Secondary Data Analysis. Journal of Information Management (in

Chinese) 2005, 12(S):45-65.

15. Reis BY, Mandl KD: Syndromic surveillance: the effects of

syn-drome grouping on model accuracy and outbreak detection.

Ann Emerg Med 2004, 44(3):235-241.

16. Syndrome Definitions for Diseases Associated with Critical Bioterrorism-associated Agents October 23, 2003. Edited by:

Services DHH. Centers for Disease Control and Prevention, Atlanta, Georgia, USA; 2003.

17. Lin TY, Chang LY, Hsia SH, Huang YC, Chiu CH, Hsueh C, Shih SR,

Liu CC, Wu MH: The 1998 enterovirus 71 outbreak in Taiwan:

pathogenesis and management. Clin Infect Dis 2002, 34 Suppl 2:S52-7.

18. Ho M, Chen ER, Hsu KH, Twu SJ, Chen KT, Tsai SF, Wang JR, Shih

SR: An epidemic of enterovirus 71 infection in Taiwan.

Tai-wan Enterovirus Epidemic Working Group. N Engl J Med 1999, 341(13):929-935.

19. Statistical Yearbook of Interior, R.O.C. Edited by: Statistics D.

Ministry of the Interior, R.O.C.; 2004.

20. Miyoshi T, Uchino K, Matsuo M, Ikeda Y, Yoshida H, Sibata H, Fujii F,

Tanaka T: Characteristics of Norovirus outbreaks during a

non-epidemic season. Jpn J Infect Dis 2006, 59(2):140-141.

21. Payne CM, Ray CG, Borduin V, Minnich LL, Lebowitz MD: An

eight-year study of the viral agents of acute gastroenteritis in humans: ultrastructural observations and seasonal distribu-tion with a major emphasis on coronavirus-like particles.

Diagn Microbiol Infect Dis 1986, 5(1):39-54.

22. Subekti D, Lesmana M, Tjaniadi P, Safari N, Frazier E, Simanjuntak C,

Komalarini S, Taslim J, Campbell JR, Oyofo BA: Incidence of

Nor-walk-like viruses, rotavirus and adenovirus infection in patients with acute gastroenteritis in Jakarta, Indonesia.

FEMS Immunol Med Microbiol 2002, 33(1):27-33.

23. Chen SM, Ni YH, Chen HL, Chang MH: Microbial etiology of

acute gastroenteritis in hospitalized children in Taiwan. J

For-mos Med Assoc 2006, 105(12):964-970.

24. Iritani N, Seto Y, Kubo H, Haruki K, Ayata M, Ogura H: Prevalence

of "Norwalk-like virus" infections in outbreaks of acute non-bacterial gastroenteritis observed during the 1999-2000 sea-son in Osaka City, Japan. J Med Virol 2002, 66(1):131-138.

25. Froggatt PC, Barry Vipond I, Ashley CR, Lambden PR, Clarke IN, Caul

EO: Surveillance of norovirus infection in a study of sporadic

childhood gastroenteritis in South West England and South Wales, during one winter season (1999-2000). J Med Virol 2004, 72(2):307-311.

26. Balter S, Weiss D, Hanson H, Reddy V, Das D, Heffernan R: Three

years of emergency department gastrointestinal syndromic surveillance in New York City: what have we found? MMWR

Morb Mortal Wkly Rep 2005, 54 Suppl:175-180.

27. Phan TG, Nguyen TA, Kuroiwa T, Kaneshi K, Ueda Y, Nakaya S,

Nishimura S, Nishimura T, Yamamoto A, Okitsu S, Ushijima H: Viral

diarrhea in Japanese children: results from a one-year epide-miologic study. Clin Lab 2005, 51(3-4):183-191.

(13)

Publish with BioMed Central and every scientist can read your work free of charge "BioMed Central will be the most significant development for disseminating the results of biomedical researc h in our lifetime."

Sir Paul Nurse, Cancer Research UK

Your research papers will be:

available free of charge to the entire biomedical community peer reviewed and published immediately upon acceptance cited in PubMed and archived on PubMed Central yours — you keep the copyright

Submit your manuscript here:

http://www.biomedcentral.com/info/publishing_adv.asp

BioMedcentral

28. Jernigan DB, Raghunathan PL, Bell BP, Brechner R, Bresnitz EA, Butler

JC, Cetron M, Cohen M, Doyle T, Fischer M, Greene C, Griffith KS, Guarner J, Hadler JL, Hayslett JA, Meyer R, Petersen LR, Phillips M, Pinner R, Popovic T, Quinn CP, Reefhuis J, Reissman D, Rosenstein N, Schuchat A, Shieh WJ, Siegal L, Swerdlow DL, Tenover FC, Traeger M, Ward JW, Weisfuse I, Wiersma S, Yeskey K, Zaki S, Ash-ford DA, Perkins BA, Ostroff S, Hughes J, Fleming D, Koplan JP, Ger-berding JL: Investigation of bioterrorism-related anthrax,

United States, 2001: epidemiologic findings. Emerg Infect Dis

2002, 8(10):1019-1028.

29. Reissman DB, Whitney EA, Taylor TH Jr., Hayslett JA, Dull PM, Arias

I, Ashford DA, Bresnitz EA, Tan C, Rosenstein N, Perkins BA:

One-year health assessment of adult survivors of Bacillus anthra-cis infection. Jama 2004, 291(16):1994-1998.

30. Chen HF, S S, Friedman C, Hersh W: Medical Informatics. In

Inte-grated Series in Information Systems Volume 8. Hardcover; 2005.

31. Cyranoski D: China's chicken farmers under fire for antiviral

abuse. Nature 2005, 435(7045):1009.

32. Parry J: Hong Kong under WHO spotlight after flu outbreak.

Bmj 2003, 327(7410):308.

33. Wuethrich B: Infectious disease. An avian flu jumps to people.

Science 2003, 299(5612):1504.

34. Zarocostas J: WHO increases pressure on China over bird flu.

Bmj 2005, 331(7511):254.

Pre-publication history

The pre-publication history for this paper can be accessed here:

數據

Table 1: Variables of Patients Collected in both XML-Tag and  HL7 Segments/Fields from Emergency Departments of the 189  Emergency-Care Designated Hospitals*
Table 2: ICD-9 Codes for Enterovirus-related Infection  Syndrome Group
Table 3: Demographical Analysis between ED Visits in Nation-wide Hospital ED-based Syndromic Surveillance System and Population  Composite in Taiwan, April 1, 2004 – March 31, 2005

參考文獻

相關文件

Bootstrapping is a general approach to statistical in- ference based on building a sampling distribution for a statistic by resampling from the data at hand.. • The

“Asymptomatic persons who had visited Fook Wai Buddhist Temple on or after 25 January are advised to call our hotline 21251122 for quarantine or medical surveillance

The original curriculum design for the Department of Construction Engineering of CYUT was to expose students to a broad knowledge in engineering and applied science rather than

Cause: A software bug known existed in General Electric Energy's Unix-based XA/21 energy management

• Environmental Report 2020 of Transport Department, Hong Kong: to provide a transport system in an environmentally acceptable manner to align with the sustainable development of

For terminating simulations, the initial conditions can affect the output performance measure, so the simulations should be initialized appropriately. Example: Want to

Department of Education (1995) A guide to safe practice in art &amp; design.. (1990) Artists handbook 2 health &amp; safety: making

[3] Haosong Gou, Hyo-cheol Jeong, and Younghwan Yoo, “A Bit collision detection based Query Tree protocol for anti-collision in RFID system,” Proceedings of the IEEE