- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Article Processing Charges ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Recently Accepted Articles ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Volume 2012 (2012), Article ID 875253, 26 pages
The Past, Present, and Future of Public Health Surveillance
1Injury Prevention Research Centre, Medical College of Shantou University, Shantou 515041, China
2Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, ON, K1H 8M5, Canada
Received 21 June 2012; Accepted 11 July 2012
Academic Editors: K. Eriksson and G. Mastrangelo
Copyright © 2012 Bernard C. K. Choi. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
This paper provides a review of the past, present, and future of public health surveillance—the ongoing systematic collection, analysis, interpretation, and dissemination of health data for the planning, implementation, and evaluation of public health action. Public health surveillance dates back to the first recorded epidemic in 3180 B.C. in Egypt. Hippocrates (460 B.C.–370 B.C.) coined the terms endemic and epidemic, John Graunt (1620–1674) introduced systematic data analysis, Samuel Pepys (1633–1703) started epidemic field investigation, William Farr (1807–1883) founded the modern concept of surveillance, John Snow (1813–1858) linked data to intervention, and Alexander Langmuir (1910–1993) gave the first comprehensive definition of surveillance. Current theories, principles, and practice of public health surveillance are summarized. A number of surveillance dichotomies, such as epidemiologic surveillance versus public health surveillance, are described. Some future scenarios are presented, while current activities that can affect the future are summarized: exploring new frontiers; enhancing computer technology; improving epidemic investigations; improving data collection, analysis, dissemination, and use; building on lessons from the past; building capacity; enhancing global surveillance. It is concluded that learning from the past, reflecting on the present, and planning for the future can further enhance public health surveillance.
The term “surveillance”, derived from the French roots, sur (over) and veiller (to watch) , is defined in the dictionary as the “close and continuous observation of one or more persons for the purpose of direction, supervision, or control” . For the purpose of this paper, the following definition is used, “Public health surveillance is the ongoing systematic collection, analysis, interpretation and dissemination of health data for the planning, implementation and evaluation of public health action” (see Section 2.3 below).
Public health surveillance is considered to be an essential public health function [3, 4]. A public health system is said to have five essential functions: population health assessment, health surveillance, health promotion, disease and injury prevention, and health protection . Public health surveillance is considered the best weapon to avert epidemics .
The objective of this paper is to provide a review of the past, present, and future of public health surveillance. The section on the past includes an account of major epidemics in human history, the historical milestones in the development of public health surveillance, and the historical evolvement of the concepts and definitions of public health surveillance. As much as possible, original historical documents have been consulted and quoted in this paper. The section on the present describes the uses and components of public health surveillance as we know it today. The section on the future reviews the literature concerning possible scenarios and proposed directions by various authors for future development of public health surveillance.
2. The Past
2.1. Records of Major Epidemics in Human History
Public health surveillance dates back to the time of Pharaoh Mempses in the First Dynasty, when an epidemic was first recorded in human history . Manetho, the Egyptian priest and historian, stated in his list of pharaohs, “Mempses, for eighteen years. In his reign many portents and a great pestilence occurred” [8, 9]. The “great pestilence” is now known to have occurred in 3180 B.C. (Table 1). Table 1 provides a list of major epidemics recorded in history. It also provides the necessary background and context for the discussion below of the major milestones and historical development of the concepts and definitions of public health surveillance.
According to Marks and Beatty, the three most devastating epidemics to hit the human race were “The Plague of Justinian” (A.D. 541–591) which lasted 50 years, "The Black Death" (1348–1351) which lasted 4 years, and “Spanish Influenza” (1918) which lasted five months  (Table 1). From an analysis of Table 1, it can be seen that three types of information were included in the historical records of epidemics. These are health outcomes, risk factors, and interventions (Table 2). These are also the types of information that should be included in a modern day public health surveillance system. They are the forces guiding the changes in public health. Health outcomes measure the state of public health. Risk factors move the state of public health towards undesirable health outcomes, and interventions if successful move the state of public health towards desirable health outcomes.
2.2. Major Milestones in the Historical Development of Public Health Surveillance
Simply recording epidemics is not exactly public health surveillance as we know it today. Major milestones in the historical development of concepts in public health surveillance are given in Table 3. The first record of an epidemic was made in 3180 B.C., starting the practice of collecting and recording data.
The idea of collecting and analyzing data dates back to Hippocrates (460 B.C.–370 B.C.) , an ancient Greek physician who is also known as the father of medicine and the first epidemiologist [40, 41]. He is credited with being the first person to believe that diseases were caused naturally and not because of superstition and gods . Disease was a consequence of local conditions, which had to be favourable for a particular disease to occur. He introduced the concept of categorizing illnesses as acute (short duration) or chronic (long lasting). He also coined the terms endemic (for diseases usually found in some places but not in others; steady state) and epidemic (for diseases that are seen at some times but not others; abrupt change in incidence) [31, 43]. In his book On Airs, Waters, and Places he wrote, “The men are subject to attacks of dysentery, diarrhea, hepialus, chronic fevers in winter, of epinyctis, frequently, and of hemorrhoids about the anus. Pleurisies, peripneumonies, ardent fevers, and whatever diseases are reckoned acute, do not often occur, for such diseases are not apt to prevail where the bowels are loose. Ophthalmies occur of a humid character, but not of a serious nature, and of short duration, unless they attack epidemically from the change of the seasons. And when they pass their fiftieth year, defluxions supervening from the brain, render them paralytic when exposed suddenly to strokes of the sun, or to cold. These diseases are endemic to them, and, moreover, if any epidemic disease connected with the change of the seasons, prevail, they are also liable to it.” . According to the Hippocratic definition, an endemic is a disease determined by the nature of a certain place, and climatic, hydrological, and behavioural determinants are seen as the main forces . This provides the concept of collecting data on place, natural environment and people for determination of illness.
The first public health action that can be attributed to surveillance occurred during the 1348 bubonic plague epidemic which started the “Black Death”. The Venetian Republic appointed 3 guardians of public health to detect and exclude ships which had infected people aboard [26, 27]. Quarantine as a means to control the spread of infectious diseases was used again in 1377 in Marseilles to detain travellers from plague-infected areas for 40 days .
The concept of systematic ongoing collection of mortality data was first used in 1532 when the town council of London, England started to keep a count of the number of persons dying from the plague . These Bills of Mortality were collected on and off for over 100 years . However, these data were not used for surveillance purpose until the 1600s, when the clerks of London reported the number of burials and causes of death to the Hall of the Parish Clerk’s Company and released in a weekly Bill of Mortality .
Comprehensive analysis and interpretation was introduced by John Graunt (1620–1674), a haberdasher and serious amateur scientist in London, who analyzed the weekly bills and published in 1662 his book Natural and Political Observations Made upon the Bills of Mortality . For this work he was subsequently elected a fellow of the Royal Society, whose members initially were uncomfortable with the idea of a haberdasher being elected . Graunt was the first to quantify the patterns of disease and to understand that numerical data on a population could be used to study the cause of disease . He was the first to estimate the population of London and to count the number of deaths from specific causes.
The practice of epidemic field investigation began with the personal diary Samuel Pepys (1633–1703) kept from 1660 until 1669. His diary is an important primary source of data and first-hand account for London, with personal revelation and eyewitness reports of many great events . During the “Great Plague of London” in 1665, Pepys’ diary made almost daily reference to the epidemic, “15th [June]… The towne grows very sickly, and people to be afeard (afraid) of it: there dying this last week of the plague 112, from 43 the week before… 20th [July]…Walked to Redriffe, where I hear the sickness is, and indeed is scattered almost every where, there dying 1089 of the plague this week… 31st [August]… In the City died this week 7496, and of them 6102 of the plague… 30th [November]… Great joy we have this week in the weekly Bill, it being come to 544 in all, and but 333 of the plague” . Not using the modern terminology, he actually introduced the concept of proportionate mortality, or the proportion of total deaths resulting from the index disease . According to the numbers kept in Pepys’ diary, the proportionate mortality for plague was 81% (6102/7496) on August 31, 1665, which decreased to 61% (333/544) on November 30, 1665 when the epidemic started to subside (Table 4). These numbers recorded by Pepys from the beginning of June to the end of November indicate the effectiveness of the natural intervention, that is, the coming of the November frosts and the winter . The plague ended with the “Great Fire of London” in 1666 that destroyed and cleansed the overcrowded neighbourhoods .
Legislation for surveillance was first introduced in 1741 in the Americas, when the colony in Rhode Island passed an act requiring tavern keepers to report contagious disease among their patrons. In 1743, the colony passed a law requiring the reporting of smallpox, yellow fever, and cholera . This started the concept of compulsory reporting of infectious diseases.
Surveillance was felt to need to link to policy development. In 1776, Johann Peter Frank in Germany advocated a comprehensive form of public health surveillance which dealt with school health, injury prevention, maternal and child health, and public water and sewage treatment . Frank formulated comprehensive health policy which had considerable impact both within Germany and in countries such as Hungary, Italy, Denmark, and Russia that had close cultural contact with Germany .
In addition, leaders of the French revolution (1788–1799) declared that the health of the people was the responsibility of the state . This started the concept of a welfare state.
Surveillance efforts were used to develop legislation and social change. Sir Edwin Chadwick, secretary of the Poor Law Commission in England, using surveillance data, demonstrated the link between poverty and disease . He published the report of 1834 recommending the reform of the old Poor Law. The new Poor Law system was in existence until the emergence of the modern welfare state after the Second World War (1939–1945) . The New Poor Law is considered to be one of the most “far-reaching pieces of legislation of the entire Nineteenth Century” . At about the same time, Louis-René Villermé (1782–1863) studied the mortality rate variations across the 12 arrondissements (districts) of Paris 1817–1826, by district, population density, and income and showed the association between poverty and mortality .
William Farr (1807–1883) is recognized as the founder of the modern concept of surveillance . In 1836, the General Register Office was established in England and Wales to provide more accurate and complete mortality data . Medical certification of death and universal death registration was introduced in 1837 . Farr was the first Compiler of Abstract (medical statistician) at the General Register Office. He began the practice of collecting and analyzing vital statistics to describe the impact of diseases in various populations . From 1838 to 1879 (for 41 years), he concentrated his efforts on collecting vital statistics, on assembling and evaluating those data, and on reporting his results to both the responsible authorities and to the general public  and created a modern surveillance system .
Surveillance was proposed to link to statewide public health infrastructure. In the United States, Lemuel Shattuck published in 1850 his “Report of the Massachusetts Sanitary Commission”, based on the survey of sanitary conditions in Massachusetts . This report was a landmark publication that related death, infant and maternal mortality, and communicable diseases to living conditions . In this report, Shattuck proposed the creation of a permanent statewide public health infrastructure and recommended establishing health offices at the state and local levels in order to gather statistical information on public health conditions . He recommended a decennial census, standardization of nomenclature for diseases and causes of death, and the collection of health data by age, sex, occupation, socioeconomic level, and locality . Although the legislature did not adopt his comprehensive plan, his specific proposals became routine public health activities over the course of the twentieth century.
John Snow (1813–1858), an anaesthesiologist, is famous for his investigations into the causes of the 19th century cholera epidemics and is also known as the father of modern epidemiology [33, 58]. In 1849, Snow mapped cholera cases in London and identified the source of the outbreak as the public water pump on Broad Street (now Broadwick Street). Using a dot map, he illustrated the cluster of cholera cases around the pump. Snow wrote: “On proceeding to the spot, I found that nearly all the deaths had taken place within a short distance of the [Broad Street] pump. There were only ten deaths in houses situated decidedly nearer to another street-pump. In five of these cases the families of the deceased persons informed me that they always sent to the pump in Broad Street, as they preferred the water to that of the pumps which were nearer. In three other cases, the deceased were children who went to school near the pump in Broad Street… With regard to the deaths occurring in the locality belonging to the pump, there were 61 instances in which I was informed that the deceased persons used to drink the pump water from Broad Street, either constantly or occasionally… The result of the inquiry, then, is, that there has been no particular outbreak or prevalence of cholera in this part of London except among the persons who were in the habit of drinking the water of the above-mentioned pump well. I had an interview with the Board of Guardians of St James’s parish, on the evening of Thursday, 7th September, and represented the above circumstances to them. In consequence of what I said, the handle of the pump was removed on the following day” . On September 8, 1854, Snow removed the pump handle and the epidemic waned [13, 60]. Snow’s work is a good illustration of collection, analysis, interpretation, and dissemination of data leading to public health intervention.
Systematic reporting of various diseases started in the United States in 1874 in Massachusetts . The Massachusetts State Board of Health inaugurated a plan for weekly voluntary reporting of prevalent diseases by physicians . A sample postcard was designed to “reduce to the minimum the expenditure of time and trouble incident to the service asked of busy medical men” . In Europe mandatory reporting of infectious diseases started in Italy in 1888, and in the United Kingdom in 1890. Finally, the 20th century brought the expansion and diversification of public health surveillance systems. Table 3 gives some of the more important events related to the development of surveillance in the last century.
The United States has been taking a lead in the development of concepts and models for public health surveillance. A detailed account of the development of the public health surveillance system in the United States for 1850–1950 is given elsewhere [30, 36, 62]. It is of interest to know the brief history of the US agency known as “CDC” that is responsible for public health surveillance in the United States. The CDC was founded in 1942 as the Office of National Defense Malaria Control Activities [63, 64]. Atlanta was chosen as the location because malaria was endemic in the Southern US. In 1946, the agency changed its name to Communicable Disease Center, and hence the acronym “CDC” . In 1947, CDC took over the Public Health Service Plague Laboratory in San Francisco, thus acquiring an Epidemiology Division. In 1955, CDC established the Polio Surveillance Program, in order to prove that an epidemic could be traced to a single vaccine manufacturer . In 1961, CDC took over publication of Morbidity and Mortality Weekly (MMWR). The Communicable Disease Center was renamed the Center for Disease Control in 1970, then the Centers for Disease Control effective 1980 [63, 64]. An act of the United States Congress appended the words “and Prevention” to the name effective 1992. However, Congress also specified that the agency continue to use the acronym “CDC” because of its recognition within the public health community and among the public .
Globally, the public health surveillance program is coordinated by the World Health Organization (WHO). In 1965, the Director General of the World Health Organization established the epidemiological surveillance unit in WHO’s Division of Communicable Diseases [33, 38]. The first communicable disease surveillance report was published in 1966. In 1968, the 21st World Health Assembly established surveillance as an essential function of public health practice  (Table 3).
2.3. Historical Development of the Concepts and Definitions of Public Health Surveillance
Table 5 shows the historical evolvement of the concepts and associated definitions of public health surveillance.
In 1662, John Graunt first suggested in his book Natural and Political Observations Made upon the Bills of Mortality the need for ongoing systematic collection of data and proposed the basic principles for data analysis and interpretation, although he did not conceptualize the link of surveillance information to public health practice  (Table 5).
In those days, mortality data collection was simple but routine. Every night, towards twelve o’clock, a cart goes about with a lantern and a bellman (or sexton), and as he rings the bell, he cries out, “Bring out your dead!” As described by Graunt, “When any one dies, then, either by tolling, or ringing of a Bell, or by bespeaking of a Grave of the Sexton, the same is known to the Searchers, corresponding with the said Sexton. The Searchers hereupon repair to the place where the dead Corps lies, and by view of the same, and by other enquiries, they examine by what Disease or Casualty the Corps died. Hereupon they make their Report to the Parish Clerk, and he, every Tuesday night, carries in an Accompt of all the Burials and Christnings happening that Week, to the Clerk of the Hall. On Wednesday the general Accompt is made up and printed, and on Thursday published and dispersed to the several Families who will pay four Shillings per Annum for them” .
Graunt’s method of data analysis was to reduce voluminous data to a few perspicuous tables (Table 5). Using this method, he was the first to recognize that there were more male than female deaths in London. He tried to interpret the findings and was able to explain the observation by noticing that there were more males than females by counting the number of births, and he suggested that this phenomenon in London should be searched for elsewhere. In Graunt’s words, “There have been Buried from the year 1628, to the year 1662, exclusivè, 209436 Males, and but 190474 Females: but it will be objected, that in London it may indeed be so, though otherwise elsewhere; because London is the great Stage and Shop of business, wherein the Masculine Sex bears the greatest part. But we Answer, That there have been also Christned within the same time, 139782 Males, and but 130866 Females, … What the Causes hereof are, we shall not trouble our selves to conjecture, as in other Cases, onely we shall desire, that Travellers would enquire whether it be the same in other Countries” .
Graunt’s concepts described in 1662 (Table 5) can be translated to a first definition of public health surveillance as follows: surveillance is the successful analysis of population-based ongoing data (such as death records) to reduce volumes of data to a few easy-to-understand tables, then interpret them, and prepare a few brief and precise paragraphs, so as to gain profit from the data analysis, in order to understand the increase and decrease of diseases .
A contemporary of Graunt, Sir William Petty, in his 1687 essay on “Mankind and political arithmetic”, termed the science of Graunt “Political Arithmetic” [46, 66, 83]. This term is a good description for today’s public health surveillance, which requires arithmetic skills for analysis of data and a keen political sense for interpretation of results.
Before 1963, the term surveillance was used initially in public health to describe the close monitoring of persons who, because of an exposure, were at risk for developing highly contagious and virulent infectious diseases . These persons were monitored so that, if they exhibited symptoms of disease, they could be quarantined to prevent spreading the disease to others.
In his classic 1963 paper, Alexander Langmuir (1910–1993), chief epidemiologist of US CDC, defined surveillance for a disease to mean “the continued watchfulness over the distribution and trends of incidence through the systematic collection, consolidation, and evaluation of morbidity and mortality reports and other relevant data” . He illustrated this application with four communicable diseases: malaria, poliomyelitis, influenza, and hepatitis . He explained that the data and their interpretations must be disseminated to all who have contributed and to all others who need to know . But his definition did not include direct responsibility for disease control activities .
In 1968, the 21st World Health Assembly adopted the concept of population surveillance which was defined as “the systematic collection and use of epidemiologic information for the planning, implementation, and assessment of disease control” . The Assembly expanded Langmuir’s definition to include the assumption that surveillance information is collected in order to take appropriate action to improve health outcomes . In other words, surveillance is “information for action” . The Assembly also affirmed the three main features of surveillance: (a) the systematic collection of pertinent data, (b) the orderly consolidation and evaluation of these data, and (c) the prompt dissemination of results to those who need to know, particularly those in position to take action .
The 1986 CDC definition of surveillance reflects Langmuir’s view  that the concept of surveillance did not encompass direct responsibility for control activities and avoids the use of the term surveillance for control activities, although it states that the final link in the surveillance chain is the application of these data to prevention and control .
The 1988 definition by Stephen Thacker and Ruth Berkelman is very similar to the 1986 CDC definition. While the 1986 CDC definition uses the term “epidemiologic surveillance,” the 1988 Thacker and Berkelman definition introduces the new term “public health surveillance.” Epidemiologic surveillance focuses on using surveillance information for epidemiologic research, while public health surveillance focuses more on public health practice [85, 86]. Thacker and Berkelman compared the distinctions between public health surveillance and epidemiologic research and decided that the term epidemiologic surveillance is misleading, and surveillance does not equal research .
In his 1998 paper on “Perspectives on epidemiologic surveillance in the 21st century”, Bernard Choi presents arguments why it is important for epidemiologic surveillance to come back full circle in the 21st century and become once again the focus of health research: “Epidemiologic surveillance dates back to the time of John Graunt … In the subsequent 300 years, however, the focus of health research shifted to sample-based studies: cross-sectional, cohort and case-control studies, and clinical trials. In recent decades, awareness of the limitations of sample-based epidemiologic studies has grown. … [H]ealth research can be conducted in the next century using well-maintained and well-validated surveillance databases” . Epidemiologic research studies that are sample-based are subject to errors caused by the “False Positive Research Cycle”: false positive associations (positive associations that are not true) will continue to be confirmed by a multitude of subsequent studies that are designed to test a hot topic due to an initial false positive report that is incorrect (hot topic bias), and subsequent amplification of the errors through cycles caused by the tendency of authors to write up and submit positive findings but not the true negative findings (positive results bias) and of editors to accept and publish positive findings (editor’s bias) [74, 87, 88]. One way to resolve these errors is population-based epidemiologic surveillance. Choi’s 1998  definition of surveillance stresses on the concept of “population-based” (Table 5). Resources required for population-based epidemiologic surveillance systems can be formidable, but progress in technology and informatics may soon make implementation much easier to achieve .
More recent definitions of surveillance, including the 2001 US Centers for Disease Control and Prevention (CDC)  and 2006 Public Health Agency of Canada (PHAC)  definitions, emphasize on “public health action.” The World Health Organization has three webpages that provide definitions of surveillance. The definitions are very similar, except that the phrase “action can be taken” on one webpage is interpreted as “the planning, implementation, and evaluation of public health practice” on the other two webpages (Table 5).
Table 6 shows a comparison of the evolvement of definitions of public health surveillance over time, from 1662 to 2012. It can be seen that while the components “ongoing,” “systematic,” “collection,” “analysis,” “interpretation,” and “dissemination” have been consistent in the definitions, there are changes in the other components. For example, “epidemiologic surveillance” shifts to “public health surveillance”; “mortality data” to “health data,” and “disease control” to “public health action” (Table 6).
Based on an examination of the trend of use of terms and the most popular components of various definitions given in Table 6, the working definition of surveillance for the purpose of this paper is “Public health surveillance is the ongoing systematic collection, analysis, interpretation and dissemination of health data for the planning, implementation and evaluation of public health action.”
3. The Present
It is useful to provide an overview of the current status of public health surveillance and its basic principles and concepts.
For further information, interested readers can consult books written on the basic principles of public health surveillance [85, 90–92]. The 2000 book edited by Teutsch and Churchill  was considered in a 2001 article in the American Journal of Epidemiology  as a wonderful one-stop source of information on public health surveillance. There is one book which specifically addresses global surveillance of behavioural risk factors . There are books on the statistical methods for public health surveillance  and public health informatics [96, 97].
3.1. Uses of Public Health Surveillance
The World Bank described six categories of uses of public health surveillance .(1)Recognize cases or clusters of cases to trigger interventions to prevent transmission or reduce morbidity and mortality.(2)Assess the public health impact of health events or determine and measure trends.(3)Demonstrate the need for public health intervention programs and resources, and allocate resources during public health planning.(4)Monitor effectiveness of prevention and control measures and intervention strategies.(5)Identify high-risk population groups or geographic areas to target interventions and guide analytic studies.(6)Develop hypotheses that lead to analytic studies about risk factors for disease causation, propagation, or progression.
Table 7 shows the above six categories of uses, with examples from various sources to illustrate the categories.
3.2. Components of Public Health Surveillance
Public health surveillance starts with defining the type of data to collect (systematic data framework development) , and then the public health surveillance process cycles through three stages: data collection, analysis and interpretation, and the timely dissemination of findings . In addition, the surveillance system should be able to evaluate public health actions (including the surveillance system itself which is a public health action).
A step-by-step guide is available for the creation of a new surveillance system when existing systems cannot answer a specific public health questions or address new information need .
3.2.1. Data Framework
The first question when setting up a new surveillance system is what categories of information should be tracked by the surveillance system . The data framework is usually defined in terms of indicators. An indicator is a measurable factor that allows decision makers to estimate objectively the size of a health problem and monitor the processes, the products, or the effects of an intervention on the population . The number of potential indicators for tracking is enormous and must be systematically narrowed down . Three criteria for indicator framework development are sound, practical, and usable . The process of indicator framework development involves several steps: conducting literature review, expert consultation, and Delphi surveys to get a consensus on a list of indicators and evaluating availability and quality of data . Delphi survey is a method that requires experts to answer questionnaires in two or more cycles, with a feedback summary of experts’ opinion after each cycle, in order to converge towards a consensus .
A conceptual framework for health information, the Health Template, was put forward in 1991 by the National Task Force on Health Information . The Health Template classifies health information into three major areas: individual characteristics, external milieu, and “health-affecting” interventions and can potentially be used as a model for selecting indicators. Among the indicators, the definition of what constitutes a “case” is important, especially in infectious disease surveillance . Case definitions for surveillance purposes may be different from the criteria used for clinical diagnosis . For noncommunicable diseases, the World Health Organization recommends a stepwise approach to surveillance that has a core and expanded set of indicators .
3.2.2. Data Collection
After defining the public health decisions that require information (data framework), the data collection stage begins by choosing the best sources and methods for gathering the data that are needed. This may need to balance competing needs for timeliness, simplicity, and completeness.
Key data collection approaches include the following.(1)Health surveys: examples are surveys of the environmental, behavioural (e.g., smoking and physical activity), and biological risk factors of populations . (2)Administrative data: routine administrative data come from many sources , including population-based systems (e.g., vital records), provider-based systems (e.g., physician, laboratory, and hospital records), payor systems (e.g., Medicare), and the records of administrative entities set up for other purposes (e.g., the Environmental Protection Agency or judicial sources) .(3)Mandatory reports: examples are mandatory reporting of communicable disease cases (e.g., tuberculosis, syphilis, and whooping cough) .(4)Voluntary reports: examples are voluntary reports on adverse outcomes due to drugs, vaccines, consumer products, accidents, and vaccine-preventable or notifiable diseases .(5)Studies of special groups: examples are detailed studies of selected population subgroups (e.g., people living with HIV and AIDS) and of “cases” with particular characteristics in both human and animal populations (e.g., identifying cases of variant Creutzfeldt Jacob disease in people and bovine spongiform encephalopathy or “Mad Cow Disease” in cattle) .
Data sources vary from country to country depending on the stage of development and sophistication of public health services and laboratory facilities , and the availability of computers and computer networks . Advantages and disadvantages have been discussed of the following data sources for public health surveillance: death certificates, case reporting, epidemic reporting, laboratory reporting of etiological agents, individual case investigation, epidemic field investigation, infectious disease markers surveys, animal reservoir and vector distribution studies, demographic data, environmental data, hospital records, general practitioners records, public health laboratory reports, disease registries, drug and biologics utilization and sales data, absenteeism from school or work, health and general population surveys, and newspaper and news broadcasting reports .
For noncommunicable diseases, the World Health Organization’s stepwise approach to surveillance collects data through questionnaire, physical measurements, and biochemical measurements .
3.2.3. Data Analysis/Interpretation
The analysis and interpretation stage includes expert analysis of the data that have been collected to determine the occurrence of a health concern and the characteristics and behaviours of people with a health concern as well as changes over time. Surveillance data initially should be analysed in terms of time, place, and person [109, 110], by looking at time trends and geographic distribution and comparing age, sex, and population groups .
More advanced data analysis for surveillance data are available . Examples include space-time clustering , time-series analysis [113, 114], geospatial analysis , life tables , logistic regression , trend and small area analysis , mathematical models to study the dynamics of infection within communities of people [118, 119], and methods for the forecast of epidemics based on surveillance data [120–122].
Data analysis must be followed by interpretation. Interpretation involves consideration of whether the apparent increases in disease occurrence, within a specific population at a particular time and place, represent true increases. Possibilities for variation include an increase in population size, improvement in diagnostic procedures, enhanced reporting, duplicate reporting, and other changes in the system . Understanding of the sources of possible study biases can help interpretation of results [124, 125]. In many instances it may be difficult to decide if the change detected is real or artificial, but this question must be answered before action can be contemplated .
3.2.4. Information Products/Dissemination
The final stage in the public health surveillance process—the timely communication of information to users—is important for follow-up action . Users of surveillance are those who need to know for program planning and decision-making purposes . They include public health practitioners, health planners, epidemiologists, researchers, and policy-makers  as well as members of the public and the media . In addition, recipients should include those who provide reports and those who collect the data .
Public health decision making depends on three types of knowledge (surveillance, scientific research, and lay experience) . Surveillance knowledge includes statistics that measure health outcomes, health care performance, and other determinants of health. Public health practitioners need to understand and effectively communicate these three complementary types of knowledge. This may involve the use of a variety of communication vehicles such as formal surveillance reports or bulletins, annual reports, teleconferences with partners, media conferences, media releases, and public advisories .
While control efforts are not normally seen as a part of surveillance, the link to public health practice is essential. The reason for collecting, analyzing, and disseminating information on a disease is to control that disease. It has been suggested that “collection and analysis should not be allowed to consume resources if action does not follow” .
3.2.5. Evaluation of Surveillance Systems
Every surveillance system should be evaluated periodically to ensure that it is serving a useful public health function and is meeting its objectives [127, 128]. Several guidelines have been proposed for the evaluation of surveillance systems [75, 127, 129–131].
A systematic evaluation should address the following six aspects: (1) importance , (2) objectives and components , (3) usefulness , (4) cost [133, 134], (5) data quality (accuracy, representativeness and completeness) , and (6) quality of surveillance system (simplicity , flexibility , portability , stability , acceptability , sensitivity [136–141], predictive value positive [138, 141], representativeness [138, 142], and timeliness ). Data and system architecture of a surveillance system should follow four design principles: automated, real-time, routinely useful, and locally useful .
A number of limitations have been identified for the current surveillance systems.(1)The current surveillance practice is unable to address adequately either current or new potential challenges to public health .(2)The current approach to public health surveillance is fragmented, as the various systems are not well coordinated [107, 144]. Ongoing public health information systems are not always integrated with public health surveillance and prevention activities. Instead, over time, a collection of independent and poorly coordinated surveillance systems has evolved in response to various needs .(3)It is difficult to address a new emerging health problem because surveillance for the specific problem usually does not exist . New health problems are not detected through the collection of routine surveillance data. (4)Existing surveillance systems may not provide timely data . Timeliness has two components: timeliness after the occurrence of the health event and timeliness of access to data.(5)Inadequate funding has been a problem with current systems of surveillance .
3.2.6. Evaluation of Public Health Actions and Practice
When surveillance information is used to plan and implement public health practice (policies, programs), the surveillance system should also serve to evaluate the success of the public health practice [79, 80]. The objective of program evaluation is to determine as systematically and objectively as possible the relevance, effectiveness, and impact of programs with respect to their objectives . The basic principles of program evaluation involves information, expectation, and attribution . Step-by-step guides for program evaluation are available [148–150].
3.2.7. Some Current Topics: Surveillance Dichotomies
There are a number of concepts in surveillance that are currently under discussion. These dichotomies are described below.
Epidemiologic Surveillance versus Public Health Surveillance. In 1965, the World Health Organization established the epidemiologic surveillance unit in the Division of Communicable Diseases . The Division director, Karel Raska, defined surveillance to include “the epidemiological study of a disease as a dynamic process involving the ecology of the infectious agent, the host, the reservoirs, and the vectors, as well as the complex mechanisms concerned in the spread of infection and the extent to which this spread occurs” . The 1968 World Health Organization definition of surveillance includes “the use of epidemiologic information” .
On the other hand, Thacker and Berkelman in 1988 started using the term “public health surveillance” and gave the following reasons: “the use of the term epidemiologic to modify surveillance is misleading. Epidemiology is a broad discipline that incorporates research and training that is distinct from a public health process that we call surveillance. … For this reason, in this paper, we will not adhere to the current practice of using the term epidemiologic to modify surveillance. We propose that a more appropriate term is public health surveillance, because its use retains the original benefits of the term epidemiologic cited previously and removes some of the confusion surrounding current practice” .
Surveillance versus Research. According to Thacker and Berkelman “Surveillance does not encompass research” and they noted distinctions between public health surveillance and epidemiologic research . Reasons why surveillance is not research include “Public health surveillance is essentially descriptive in nature. It describes the occurrence of injury or disease and its determinants in the population, and leads to public health action. Research, in contrast, is experimental in design, aimed at testing a hypothesis by comparing and contrasting groups. Surveillance data are usually limited in detail and relatively inexpensive to obtain, … Research data are often quite complex and detailed and are usually expensive to produce. If we confuse surveillance with research, we may be motivated to collect large amounts of detailed data on each case. The burden of this approach is too great for the resources available for surveillance systems and usually leads to failure” .
On the other hand, others pointed out that there are biases and problems in the current sample-based research, what Graunt’s work published in 1662 was population-based research, and hope that in the future, population-based research may once again become possible through epidemiologic surveillance. “Graunt’s approach for the analysis of … Bills of Mortality … is consistent with the modern technique of population-based epidemiologic surveillance. In the subsequent 300 years, however, the focus of health research shifted to sample-based studies: cross-sectional, cohort and case-control studies, and clinical trials. It appears that epidemiologic surveillance may come back full circle in the 21st century and become once again the focus of health research” . With the advance in information technology, it becomes possible that “health research can be conducted in the next century using well-maintained and well-validated surveillance databases” .
Surveillance Ending with Information Dissemination versus Surveillance Ending with Public Health Action. Langmuir in 1963 advocated limiting the use of the term surveillance to the collection, analysis, and dissemination of data. His construct of surveillance ended with “dissemination of (health outcome-specific) data to those who need to know”  and did not encompass direct responsibility for control activities [36, 56]. Others also felt that although data are important for informing policy making, they may not lead immediately to action . Surveillance, per se, does not include the public health actions resulting from the interpretation of the data, as few would envisage the inherent responsibility of surveillance practitioners (i.e., those public health officials responsible for interpreting the data collected) for prevention and control actions .
On the other hand, Raska in 1965 defined surveillance much more broadly than Langmuir . In the case of malaria, Raska saw surveillance as encompassing control and prevention activities . Indeed, the WHO definition of malaria surveillance included not only case detection, but also the obtaining of blood films, drug treatment, epidemiologic investigation, and followup . Former CDC director William Foege also felt an essential relationship between information and action: “The reason for collecting, analyzing, and disseminating information on a disease is to control that disease. Collection and analysis should not be allowed to consume resources if action does not follow” [126, 153].
Surveillance versus Monitoring. “Surveillance is the routine tracking of disease (disease surveillance) or, less commonly, risk behaviour (behavioural surveillance) using the same data collection system over time” . Surveillance helps describe an epidemic and its spread and can contribute to predicting future trends and developing prevention programmes. In other words, surveillance is the routine tracking before (or without) an intervention (policy, program, or action), which can lead to the development of an intervention.
On the other hand, “monitoring is the routine tracking of priority information about a program and its intended outcomes” . Monitoring helps determine which areas are in need of greater effort and flags questions which might contribute to an improved response but that can only be answered by more refined outcome research methods than those used in routine surveillance and monitoring. In other words, monitoring is the routine tracking after an intervention is implemented and can lead to the improvement of the intervention.
Surveillance versus Evaluation. “Evaluation is a collection of activities designed to determine the value or worth of a specific programme, intervention or project” . In other words, it is the determination of the relevance, effectiveness and impact of a program with respect to its objectives . It involves three steps: information, expectation, and attribution . Evaluation uses the same methods as in surveillance to collect information. But it goes two steps further than surveillance. It compares the actual program impacts to the expected level as specified by the program objectives (expectation). It also tries to attribute the changes to the development and implementation of the program (attribution).
There is a difference between a program’s monitoring and evaluation . Monitoring tracks changes in outcomes following the implementation of a program or project but is not able to attribute those changes directly to the intervention. Evaluation is designed specifically to be able to attribute the changes to the intervention itself and not the result of nonprogram factors.
When a surveillance system (as a public health action) is monitored or evaluated, that means a second surveillance system is created on the surveillance system itself . While the surveillance system uncovers problems in the general population, the second surveillance system uncovers problems in the surveillance system. In other words, the evaluation of surveillance is “surveillance of surveillance” . For monitoring or evaluation of policies, the aim is to “police the policies” .
Passive Surveillance versus Active Surveillance. Passive surveillance systems refer to routine notifiable-disease reporting . This is simple and not burdensome to the health department but is limited by incompleteness in reporting . Also, because passive surveillance depends on people in different institutions to provide data, data quality and timeliness are difficult to control .
To overcome limitations of passive systems, active surveillance systems involve regular outreach to potential reporters to stimulate the reporting of specific diseases . This can be used to validate the representativeness and completeness of passive reporting . As active surveillance employs staff members to regularly contact heath care providers or the population to seek information about health conditions, it provides the most accurate and timely information, but it is also expensive .
Chronic Disease Surveillance versus Communicable Disease Surveillance. There are differences between chronic and communicable disease surveillance methodologies, in terms of temporality, disease course, cause of disease, public health intervention, data sources, data collection, legislation and regulations, and comorbidity .
Surveillance System versus Health Information System. Surveillance systems have the capacity to collect, analyze, and disseminate data to public health programs and regularly evaluate the effectiveness of the disseminated data [30, 67, 158, 159].
On the other hand, health information systems include a variety of data sources essential to public health and are often used for surveillance; however, they lack some critical elements of surveillance systems. For example, they may not focus on specific outcomes (e.g., vital statistics), are not ongoing (e.g., a onetime or occasional survey), or are not linked directly to public health practices (e.g., insurance claims data) . Health information systems encompass all the different data collection systems available to a ministry of health, including information from hospitals, clinics, and providers (such as the numbers of patients, diagnoses, procedures, and outcomes; personnel, and pharmaceutical and other procurement systems; program-specific data such as vaccinations, prenatal care, and disease treatment outcomes) . However, it has been suggested that “public health surveillance is one component of the health information system” .
Vertical Surveillance versus Integrated Surveillance. Vertical surveillance systems focus on one disease or injury. Information is then fed back into the specific disease control program .
On the other hand, an integrated surveillance system envisages a common system for multiple diseases using similar structure, processes, and personnel. This requires coordination but is more efficient and less costly, because it allows building on existing resources and capacity. It also promotes the most effective use of health resources .
Universal Surveillance versus Sentinel Surveillance. Universal surveillance attempts to gather surveillance data from all reporting sources (e.g., hospitals, agencies, health care workers). Universal surveillance is preferred for chronic diseases, where all cases can be ascertained through routine administrative databases, such as hospital records.
On the other hand, sentinel surveillance selects, either randomly or intentionally, a small group of reporting sources who agree to report all cases of one or more notifiable conditions. These designated reporting sources then receive greater attention from health authorities than would be possible with universal surveillance . Sentinel surveillance may require more time and resources, but can often produce more detailed data on cases of illness. For example, sentinel influenza surveillance can collect nasopharyngeal swabs from each patient at selected sites to identify the type of influenza virus, but collection of such data from all patients would not be possible . Others propose that notification of all cases is only necessary for the very limited group of diseases which are rare or for which case finding may be necessary. Information for epidemiological purposes is required for a very wide range of relatively common infectious diseases and could best be obtained from a small number of sentinels . This would give a more accurate picture of a sample of the population, from which extrapolation for national and international comparisons could be done .
4. The Future
The future cannot be predicted with certainty. This section on the future of surveillance is based on a review of articles that have presented views on the future. Also some current efforts and activities that may affect future directions are also summarized below.
4.1. Exploring New Frontiers for Public Health Surveillance
Historically, surveillance focused on infectious disease, then broadened to other topics, including chronic diseases, such as cancer, then diabetes . The 1980s and 1990s also saw surveillance concepts applied to such new areas of public health as occupational health [163, 164], environmental health [101, 165], hazard surveillance (toxic chemicals and physical and biological agents) , emerging infectious diseases , injury control [168, 169], behavioural risk factors , events following disasters , pharmacosurveillance , and firearm-related injury . At this time, mental health and mental illness are also recognized as domains in public health surveillance . It is expected that further new frontiers will be explored in the future for surveillance.
New frontiers mean new challenges and solutions. Let us take mental health and mental illness as an example. According to the World Health Organization, mental illnesses account for more collective disability burden in developed countries than any other group of illnesses, such as cancer and heart disease . Although mental health measures are now included in established health surveys, there are challenges not seen before. The ways different surveys define and measure mental illnesses often vary and are based on different approaches (such as symptoms, duration, frequency, reference periods, mental health measures, and method of data collection) . In discussing future directions for public health surveillance, Freeman and colleagues suggest that “(F)uture public health surveillance systems should incorporate measures of positive psychological function as both a protective factor against poor health outcomes and a mental health indicator of interest in its own right” . Surveillance has traditionally focused largely on established disease or symptoms, but collection of additional data on resilience, coping skills, protective factors, and aspects of positive mental health are considerations in devising strategies for disease prevention and mental health promotion. Maintaining focus on the overall health of our population will be critical in the next decades, as will leaving behind the commonly accepted divide between mental and physical illnesses, “despite the fact that both exist within individuals in an exquisitely integrated fashion” . In the future, an optimal surveillance system will examine interactions among biological, social, psychological, and environmental factors to support health promotion, intervention programs, and both mental illness and chronic disease prevention.
4.2. Enhancing the Use of Computer Technology in Public Health Surveillance
Use of computer technology, although not without problems , continues to contribute to the evolution of public health surveillance [36, 178]. For example, by 1991 in the United States, the National Electronic Telecommunications Systems for Surveillance (NETSS) had linked all state health departments in the country by computer for the routine collection, analysis, and dissemination of information on notifiable conditions . In 2001, the US CDC began implementing the National Electronic Disease Surveillance System (NEDSS) to better manage and enhance the large number of current surveillance systems and allow the public health community to respond more quickly to public health threats (e.g., outbreaks of emerging infectious diseases and bioterrorism) . In 2007, 35 US states had integrated public health surveillance systems as articulated in the NEDSS vision . When NEDSS is fully implemented across the United States, public health professionals and government agencies will be able to quickly recognize and respond in real-time to disease outbreaks or bioterrorism attacks. The Minitel system used in France has also demonstrated the essential utility of office-based surveillance for a variety of conditions of public health importance [36, 181].
Public health surveillance relies on public health information systems that have been defined to include a variety of data sources essential to public health action . Computer technology can improve these public health information systems which vary from a simple system collecting data from a single source, to electronic systems that receive data from many sources in multiple formats, to complex surveys. As the number and variety of systems will likely increase, future efforts of public health surveillance should focus on advances in electronic data interchange and integration of data, which will also heighten the importance of patient privacy, data confidentiality, and system security .
There is great interest over the potential that new computer technology will improve the quality, capacity, and effectiveness of public health surveillance systems. One example is the use of a promising interactive health information technology called “eHealth” . eHealth (also written e-health) is a relatively recent term for healthcare practice supported by electronic processes and communication . Other technologies include a novel approach that was presented for detecting influenza outbreaks using search engine query data . Historical logs of more than 50 million of the most common online Web search queries in the United States were analyzed to track influenza-like illness in different areas and regions of the country. There was a high correlation of Google queries (influenza-like illness-related search queries) with the percentage of physician visits in patients with influenza-like symptoms. Another example is a recent analysis of how Internet surveillance tools can assist in the early identification of disease outbreaks . The study found that Web-based sources of information allow timely detection of outbreaks, reduce cost, increase reporting transparency, and presented a list of major advantages and disadvantages of “Internet-based surveillance.”
New terms like “infodemiology” and “infoveillance” have been coined for the use of informatics methods to analyze queries from the Internet search engines to predict disease outbreaks . Public health informatics is “the systematic application of information and computer science and technology to public health practice, research, and learning” . Public health informatics can introduce new applications to broaden public health perspectives, strengthen prevention in public health, and build healthier communities [188, 189].
4.3. Improving Methods of Epidemic Investigations
New science and technology will continue to improve the approach to epidemiologic outbreak investigations. Rapid technology development in the laboratory has improved diagnostic precision and reduced the time necessary to make a diagnosis. These improvements should continue, for example, to identify pathogens in imported foods at the place of importation and among persons who now travel more extensively and more rapidly around the globe . Similarly, increased use of electronic health records (one form of eHealth ) will facilitate more timely and accurate data collection as well as real-time dissemination of recommended control measures to clinicians and health-care facilities. Statisticians continue to develop new statistical methods that will provide insights through refined data analysis. For example, mathematical modeling, especially in complex and time-consuming investigations (e.g., pandemic influenza), can enable application of control measures to reduce the number of cases that are epidemic related. Improved techniques for training also need to be developed so that the technology of epidemic investigations can be used effectively by public health practitioners .
4.4. Improving Methods of Data Collection
Telephone surveys have been a powerful tool for data collection. However, the use of telephone-based random-digit-dialling methods in public health surveys and surveillance is now at a crossroads . Rapid changes in telecommunication, declines in participation rates, increases in the required level of effort and associated costs are becoming key challenges for telephone surveys.
It will be important to continue to improve existing methodology and develop new cost-effective and valid data collection methodologies for the future. There has been recent success. Split-sample experiments conducted to examine the impact on survey participation rates of sending advance letters and leaving scripted messages on the answering machines of potential sample members found that whereas advance letters significantly increased response rates, decreased initial refusal rates, and increased refusal conversion rates, leaving messages on telephone answering machines was not an effective strategy [192, 193]. A time-series study found that the “Do Not Call Registry” available in many countries has no significant impact on survey response rates . Real-time interpretation during a telephone survey, which can expand the number of languages in which surveys are offered, was found to produce favourable results . Other studies examined using mixed survey modes, such as internet and mail questionnaires, to increase participation in telephone surveys [196, 197]. Recent survey methodology studies also found address-based sampling to be promising [198, 199] and cellular telephone surveys to be able to reach the young age groups that were most likely to be excluded by random digit dialling [200, 201]. The American Association for Public Opinion Research 2012 Conference discussed new frontiers in public opinion research, including cell phone surveys, surveys with proxies and with immigrants, dual frame sample, mixed mode survey, optimal sample allocation, interactive and gaming techniques, and linking data with action .
Future surveys should collect physical measurements as part of its ongoing operation, as several studies have examined the limitations of self-reported survey data and their impact on estimates such as obesity and blood pressure using national surveys [203, 204].
In future, standards need to be developed that are common to all datasets as well as unique to individual datasets. Examples include minimum lists of demographic variables and ICD codes, standardized codes for demographic variables, a minimum set of statistical tests, common definitions of statistical tests, and rules for minimum cell size suppression. Examples of standards unique to individual datasets include rules governing the development of life tables from mortality datasets and the development of fertility rates from birth files .
A number of methodological research areas to improve data collection in the 21st century have been suggested such as systematic process for indicator selection; methodology to convert results from different health surveys with different indicator definitions to a standard and compatible level; methodology to increase survey response rates by population subgroups; methodology to collect proxy indicators; incorporation of laboratory data in routine population health surveillance; development of automatic, laboratory-based, and electronic reporting of diseases .
4.5. Improving Methods of Epidemiologic and Statistical Analysis
A renewed activity associated with public health surveillance is that of the methods of epidemiologic and statistical analysis . Since the 1980s, applications and methods of time series methods have enabled more meaningful analysis and interpretation of data collected from surveillance . More sophisticated techniques such as geographical and spatial methods and space-time monitoring will continue to be applied to public health surveillance as they are developed .
Postsurvey adjustments are becoming an increasingly important means of maintaining the representativeness of survey data. New weighting methods have been developed for adjusting the data for sex, age, race, education, marital status, and telephone coverage , and for nontelephone coverage .
A number of methodological research areas to improve data analysis in the 21st century include application of “capture-recapture” methodology to identify missing cases in routine data; conditions in which age-standardized techniques can be used for time trend and geographic comparisons; development of economic analysis models; methodology for multilevel analyses .
4.6. Improving Methods of Information Dissemination
Since the latter part of the 19th century, the dissemination of surveillance information generally has been done by “weekly reports” of diseases of critical health or strategic importance . In the United States, the Weekly Abstract of Sanitary Reports , published since 1886, has included morbidity and mortality information for most cities and ports of the United States and many countries of the world . Until recently, surveillance information was disseminated as written documents published periodically by government agencies .
Although printed paper reports will continue to be produced, there is a need to explore new methods of information dissemination, such as paperless or electronic media . Associated with ready electronic access to detailed personal information from surveillance are ethical and legal concerns that might constrain access to data of potential public health importance .
A number of methodological research areas to improve information dissemination in the 21st century are methodology to alert health professionals and the general public about forthcoming health risks; innovative and nontraditional methods for information dissemination; methods to put our current knowledge of risk assessment and management into perspective so the general public knows what health risks to avoid (e.g., publication of “Handbook of Health Risks”) and what healthy activities to pursue (e.g., publication of “Handbook of Healthy Practices”); ongoing and timely information dissemination system; survey of the general public for their regular and most effective channels of obtaining health information; development of summary indicators for health, risk and intervention (e.g., for Canada, Canadian Health Index, Canadian Heart Health Index, Canadian Diet Index) in a way similar to the Consumer Price Index or stock market indices; development of 365 health, risk, and intervention indicators for reporting to the general public after the evening television news, one indicator a day; computer software to calculate probability of risks of selected diseases or overall health outcomes, based on input concerning personal lifestyle, demographics, diet, and smoking (e.g., as “hands-on” project to be placed in science museums) .
4.7. Improving Use of Surveillance Information by Decision Makers
Perhaps most importantly, surveillance information should be used more by decision makers [4, 36]. It must, however, be recognized that while public health surveillance is the cornerstone of public health practice , it is not the only source of information for evidence-based public health , as surveillance is only one element in the package of evidence to influence healthy public policies . There are at least 5 tools/processes for decision makers on public health actions: meta-analysis, risk assessment, economic evaluation, public health surveillance, and expert panels/consensus conferences . In addition to scientific evidence, policy making is also based on values, emotions, and the wishes of interest groups .
Because public health surveillance and action are crucial to effective public health practice, the World Health Organization has initiated consensus meetings at the regional and national level to review and reform surveillance and action systems [217–220]. These meetings emphasized improved epidemic preparedness and epidemic response. They also highlight the need to facilitate and standardize surveillance and action assessments and to include integration strategies in the reform process.
In 1992, “The Nation’s Health Report Card”, published by the American Public Health Association, provides state-by-state rates of health status, health risk, health determinants, and health service indicators . In the future, the concept of a national health report card can be extended to “community health report cards”, using data on residents of an entire community [222, 223].
4.8. Building the Future Based on Lessons Learned from the Past
Summarizing the lessons learned from a review of historical perspective of epidemics from the past five millennia, Choi and Pak proposed 12 future challenges for public health surveillance in the 21st century to (1) expand the current surveillance system to include besides deaths also new cases for diseases; (2) develop long-term plans for surveillance systems and to avoid ad hoc systems; (3) develop ground rules on when and how to add or delete or change the definitions of variables under surveillance when new scientific evidence arises; (4) develop large scale and widespread data collection systems which are population-based (see also ); (5) expand the current surveillance system based mainly on health outcomes to also include risk factors and intervention indicators; (6) develop novel analysis tools and new statistics to facilitate development of disease prevention and control strategies; (7) develop surveillance systems that are closely integrated with etiologic research; (8) develop better and more accurate methods for forecasting; (9) develop a more direct and effective mechanism to feed information into the public health decision making process; (10) develop better evaluation protocols for public health programs and intervention using surveillance data; (11) develop better ways of dissemination of information to all those who need to know; (12) ensure that the surveillance system would achieve health for all, on an equal basis and without prejudice .
4.9. Building Surveillance Capacity
To avoid fragmentation in national surveillance efforts [107, 144], there is a need for federal agencies to provide national facilitation to foster interstate and intercounty collaboration. Central guidance can lead to coordination across states and counties, interstate technology transfer, and opportunity to learn from the successes and failures of other localities. Needless expense, unnecessary development time, and failure to rapidly share information on innovative systems can be avoided . No attempt to meet the current challenges in public health surveillance will succeed unless it recognizes the fundamental importance of providing and maintaining a cadre of highly trained and motivated public health professionals in every local health agency in the country . To use surveillance information to better prioritize, plan, deliver, and evaluate programming, public health staff must possess the required knowledge and skills. While it is neither feasible nor necessary for all staff to receive postgraduate academic training, a greater proportion of the public health workforce will need to acquire the knowledge and skills necessary to effectively understand and use surveillance concepts and techniques. Public health surveillance systems must be strengthened by (1) allocating resources, including human resources, for the effective use of health surveillance data and tools and (2) recognizing the need for existing staff to acquire new skills .
4.10. Enhancing Global Public Health Surveillance
Globalization of trade and the economy has resulted in a constant massive mobilization of commodities and people across countries and continents at unprecedented speed. It takes only a few hours to transport or mobilize thousands of people and goods across the globe. It is possible to travel between most places in the world in less time than the incubation period for many infectious diseases . There is also a need for global surveillance for risk factors for chronic diseases, as risk factors are transferable. International migrants bring with them their cooking styles, hygiene practices, and so forth, thereby affecting both the infectious and chronic disease patterns in the host country . In this sense, chronic noncommunicable diseases like cardiovascular diseases can be considered communicable .
Three directions of global surveillance are transforming the functions of public health in a globalized world: (1) the role of the new International Health Regulations (IHR) [231, 232], (2) the emergence of new global health surveillance networks, and (3) the reshaping of guidelines for the collection, dissemination, and interventions in global surveillance . The revised IHR of 2005 encourage a new paradigm of global public health intelligence . With mandatory reporting procedures and requirements for building surveillance and response capacity, the revised IHR are a move toward more effective global health security .
In 1997, the “Global Public Health Intelligence Network” was proposed by the World Health Organization in partnership with the Public Health Agency of Canada to help identify significant disease outbreaks around the world taking advantage of the existing globalized virtual communications . This global surveillance initiative is an Internet surveillance system that gathers data and public health reports from diverse countries in 7 languages, aiming to disseminate timely alerts to help control outbreaks, the spread of infectious disease, contamination of food and water, bioterrorism, natural disasters, and exposure to chemical agents and nuclear materials. This system investigates and confirms outbreak reports of global health significance  and also monitors questions related to the safety of medications and medical products .
The World Health Organization has created a global network of national influenza centres in 83 countries , the “FluNet”  and “DengueNet” , as Internet sites dedicated to monitoring global influenza and dengue-related information. A network of Internet-based surveillance, “ProMED-mail”, initiated by the International Society of Infectious Diseases, is considered to be one of the largest publicly available Internet-based reporting networks for emerging diseases in the world [240, 241].
In global chronic disease surveillance, new global health surveillance networks have also emerged. Examples include the World Alliance for Risk Factor Surveillance (WARFS)  and the Americas’ Network for Chronic Disease Surveillance (AMNET) . WARFS is the Global Working Group on Surveillance of the International Union for Health Promotion and Education (IUHPE). It supports the development of behavioural risk factor surveillance as a tool for evidence-based public health, acknowledging the importance of this information source to inform, monitor, and evaluate disease prevention and health promotion policies, services, and interventions. There has been a series of biennial global conferences on risk factor surveillance, beginning in USA (Atlanta), 1999; Finland (Tuusula), 2001; Australia (Noosaville), 2003; Uruguay (Montevideo), 2005; Italy (Rome), 2007; Italy (Venice), 2009; Canada (Toronto), 2011. AMNET was established in Uruguay in 2003 as a regional network for the purposes of sharing information and experiences as well as providing opportunities for enhancing chronic disease surveillance in the WHO Region of Americas (North, Central and South America, and the Caribbean) .
Global health is seen in several developed countries as a pillar of their foreign policy [244, 245]. Several governments, including US , Canada , and UK , are expanding their investment in global health and global security.
Emerging infectious diseases, such as human immunodeficiency virus/acquired immunodeficiency syndrome (HIV/AIDS), severe acute respiratory syndrome (SARS), and pandemic influenza, and emerging chronic conditions, such as the global obesity epidemic, have demonstrated that we remain vulnerable to health threats . The importance of strengthening public health surveillance to provide early warning and develop actions has been a primary focus in public health. However, despite improvements in the past decades, public health surveillance capabilities remain limited and fragmented, with uneven global coverage.
It is hoped that learning from the past, reflecting on the present, and planning for the future can further enhance public health surveillance for the good of humankind.
- P. S. Brachman, “Chapter 2. Public health surveillance,” in Bacterial Infections of Humans: Epidemiology and Control, P. S. Brachman and E. Abrutyn, Eds., Springer, New York, NY, USA, 2009.
- Merriam-Webster, Merriam-Webster's Dictionary of English Usage, Merriam-Webster, Springfield, Mass, USA, 1976.
- W. W. Holland, “A dubious future for public health?” Journal of the Royal Society of Medicine, vol. 95, no. 4, pp. 182–188, 2002.
- S. Stachenko, “Challenges and opportunities for surveillance data to inform public health policy on chronic non-communicable diseases: canadian perspectives,” Public Health, vol. 122, no. 10, pp. 1038–1041, 2008.
- Canadian Institutes of Health Research, The Future of Public Health in Canada: Developing a Public Health System for the 21st Century, CIHR, Ottawa, Canada, 2003.
- Disease Control Priorities Project, “Public Health Surveillance—The Best Weapon to Avert Epidemics,” May 2008, http://www.dcp2.org/file/153/dcpp-surveillance.pdf.
- B. C. K. Choi and A. W. P. Pak, “Lessons for surveillance in the 21st century: a historical perspective from the past five millennia,” Sozial- und Praventivmedizin, vol. 46, no. 6, pp. 361–368, 2001.
- W. G. Waddell, Manetho, Harvard University Press, Cambridge, Mass, USA, 1940, http://www27.us.archive.org/stream/manethowithengli00maneuoft#page/n69/mode/2up.
- G. Marks and W. K. Beatty, Epidemics, C. Scribner’s Sons, New York, NY, USA, 1976.
- E. Bascombe, A History of Epidemic Pestilence from the Earliest Ages, J. Churchill, London, UK, 1851.
- A. E. R. Boak, A History of Rome to 565 AD, Macmillan Company, New York, NY, USA, 1947.
- A. S. Evans, “Surveillance and seroepidemiology,” in Viral Infections of Humans, A. S. Evans, Ed., pp. 43–64, Plenum Press, New York, NY, USA, 1982.
- N. Hirschorn and W. B. Greenough, “Cholera,” Scientific American, vol. 225, p. 15, 1971.
- F. Russell, “A journal of the plague: the 1918 influenza,” Yale Review, vol. 47, p. 219, 1958.
- A. E. Aiello, V. Perez, R. M. Coulborn, B. M. Davis, M. Uddin, and A. S. Monto, “Facemasks, hand hygiene, and influenza among young adults: a randomized intervention trial,” PLoS ONE, vol. 7, no. 1, Article ID e29744, 2012.
- R. Doll and A. B. Hill, “Smoking and carcinoma of the lung; preliminary report,” British Medical Journal, vol. 2, no. 4682, pp. 739–748, 1950.
- R. Doll and R. Peto, “Mortality in relation to smoking: 20 years' observations on male British doctors,” British Medical Journal, vol. 2, no. 6051, pp. 1525–1536, 1976.
- R. Peto, A. D. Lopez, J. Boreham, M. Thun, and C. Heath, “Mortality from tobacco in developed countries: Indirect estimation from national vital statistics,” The Lancet, vol. 339, no. 8804, pp. 1268–1278, 1992.
- T. D. Sterling, W. L. Rosenbaum, and J. J. Weinkam, “Risk attribution and tobacco-related deaths,” American Journal of Epidemiology, vol. 138, no. 2, pp. 128–139, 1993.
- J. P. Adams and P. G. Murphy, “Obesity in anaesthesia and intensive care,” British Journal of Anaesthesia, vol. 85, no. 1, pp. 91–108, 2000.
- K. Robert, Treatment of the Obese Patient, vol. 158, Humana Press, Totowa, NJ, USA, 2007.
- D. Haslam, “Obesity: a medical history,” Obesity Reviews, vol. 8, pp. 31–36, 2007.
- B. Caballero, “The global epidemic of obesity: an overview,” Epidemiologic Reviews, vol. 29, no. 1, pp. 1–5, 2007.
- World Health Organization, “Obesity and overweight,” 2012, http://www.who.int/mediacentre/factsheets/fs311/en/index.html.
- R. L. Berkelman, D. F. Stroup, and J. W. Buehler, “Public health surveillance,” in Oxford Textbook of Public Health: The Methods of Public Health, R. Detels, J. McEwen, R. Beaglehole, and H. Tanake, Eds., Oxford University Press, Oxford, UK, 4th edition, 2002.
- M. L. Moro and A. McCormick, “Surveillance for communicable disease,” in Surveillance in Health and Disease, W. J. Eylenbosh and N. D. Noah, Eds., pp. 166–182, Oxford University Press, Oxford, UK, 1988.
- S. Declich and A. O. Carter, “Public health surveillance: historical origins, methods and evaluation,” Bulletin of the World Health Organization, vol. 72, no. 2, pp. 285–304, 1994.
- R. Pearl, Introduction to Medical Biometry and Statistics, vol. 27, WB Saunders, Philadelphia, Pa, USA, 1940.
- J. Graunt, Natural and Political Observations Made Upon the Bills of Mortality. London 1662, The Johns Hopkins University Press, Baltimore, Md, USA, 1939.
- S. B. Thacker and R. L. Berkelman, “Public health surveillance in the United States,” Epidemiologic Reviews, vol. 10, pp. 164–190, 1988.
- W. J. Eylenbosch and N. D. Noah, “Historical aspects,” in Surveillance in Health and Disease, W. J. Eylenbosch and N. D. Noah, Eds., pp. 166–182, Oxford University Press, Oxford, UK, 1988.
- A. D. Langmuir, “William Farr: founder of modern concepts of surveillance,” International Journal of Epidemiology, vol. 5, no. 1, pp. 13–18, 1976.
- L. R. Johnson and D. L. Heymann, “Public Health Surveillance,” in Encyclopedia of Life Support Systems (EOLSS), Eolss Publishers, Ramsey, Isle of Man, 2004.
- J. W. Trask, “Vital statistics: a discussion of what they are and their uses in public health administration,” Public Health Reports, supplement 12, pp. 31–34, 1915.
- H. I. Bowditch, D. L. Webster, J. C. Hoadley, et al., “Letter from the Massachusetts State Board of Health to physicians,” Public Health Reports, supplement 12, p. 30, 1915.
- S. B. Thacker, “Chapter 1. Historical development,” in Principles & Practice of Public Health Surveillance, L. M. Lee, S. M. Teutsch, S. B. Thacker, and M. E. St. Louise, Eds., pp. 1–17, Oxford University Press, New York, NY, USA, 2010.
- National Office of Vital Statistics, “Reported incidence of selected notifiable disease: United States, each division and state, 1920–50,” Vital Statistics Special Reports, vol. 37, pp. 1180–1181, 1953.
- K. Raska, “National and international surveillance of communicable diseases,” WHO Chronicle, vol. 20, no. 9, pp. 315–321, 1966.
- A. O. Lucas, “The surveillance of communicable diseases,” WHO Chronicle, vol. 22, pp. 439–444, 1968.
- A. Morabia, History of Epidemiologic Methods and Concepts, Birkhäuser, Basel, Switzerland, 2004.
- R. M. Merrill, Introduction to Epidemiology, Jones & Bartlett Learning, Burlington, Mass, USA, 5th edition, 2010.
- Wikipedia, Hippocrates, 2012, http://en.wikipedia.org/wiki/Hippocrates.
- D. F. Duncan, Epidemiology: Basis for Disease Prevention and Health Promotion, Macmillan, New York, NY, USA, 1988.
- Hippocrates, “On Airs, Waters, and Places,” Written 400 BC, Translated by Francis Adams, 1796–1861, http://classics.mit.edu/Hippocrates/airwatpl.html.
- D. Waltner-Toews, “An ecosystem approach to health and its applications to tropical and emerging diseases,” Cadernos de Saude Publica, vol. 17, pp. 7–36, 2001.
- R. R. Monson, Occupational Epidemiology, CRC Press, Boca Raton, Fla, USA, 1980.
- Wikipedia, John Graunt, 2012, http://en.wikipedia.org/wiki/John_Graunt.
- Wikipedia, Samuel Pepys, 2012, http://en.wikipedia.org/wiki/Samuel_Pepys.
- S. Pepys, “The Diary of Samuel Pepys—Daily entries from the 17th century London diary,” 1665, http://www.pepysdiary.com/archive/.
- D. G. Kleinbaum, L. L. Kupper, and H. Morgenstern, Epidemiologic Research: Principles and Quantitative Methods, Lifetime Learning Publications, Belmont, Calif, USA, 1982.
- “Surveillance,” International Journal of Epidemiology, vol. 5, pp. 3–4, 1976.
- Wikipedia, English Poor Laws, 2012, http://en.wikipedia.org/wiki/English_Poor_Laws.
- M. Bloy, “The Poor Law: introduction,” Last modified 8 November 2002, http://www.victorianweb.org/history/poorlaw/plintro.html.
- C. Julia and A. J. Valleron, “Louis-René Villermé (1782–1863), a pioneer in social epidemiology: Re-analysis of his data on comparative mortality in Paris in the early 19th century,” Journal of Epidemiology and Community Health, vol. 65, no. 8, pp. 666–670, 2011.
- N. S. Galbraith, “Communicable disease surveillance,” in Recent Advances in Community Medicine, A. Smith, Ed., pp. 127–142, Churchill Livingstone, London, UK, 2nd edition, 1982.
- S. B. Thacker and R. L. Berkelman, “Chapter 1. History of public health surveillance,” in Public Health Surveillance, W. Halperin and E. L. Baker, Eds., pp. 1–15, Van Nostrand Reinhold, New York, NY, USA, 1992.
- J. Koslow, Shattuck, Lemuel, Encyclopedia of Public Health, Macmillan Reference USA, 2002, http://www.enotes.com/shattuck-lemuel-reference/shattuck-lemuel.
- D. Vachon, “Father of modern epidemiology,” Old News, vol. 16, no. 8, pp. 8–10, 2005.
- J. Snow, On the Mode of Communication of Cholera, John Churchill, London, UK, 1855, http://www.ph.ucla.edu/epi/snow/snowbook2.html .
- R. Porter, The Greatest Benefit to Mankind: A Medical History of Humanity from Antiquity to the Present, Harper Collins, London, UK, 1997.
- T. L. Chorba, R. L. Berkelman, S. K. Safford, N. P. Gibbs, and H. F. Hull, “Mandatory reporting of infectious diseases by clinicians,” Journal of the American Medical Association, vol. 262, no. 21, pp. 3018–3026, 1989.
- S. B. Thacker, “Historical development,” in Principles and Practice of Public Health Surveillance, S. M. Teutsch and R. E. Churchill, Eds., pp. 1–16, Oxford University Press, New York, NY, USA, 2nd edition, 2000.
- Wikipedia, Centers for Disease Control and Prevention, 2012, http://en.wikipedia.org/wiki/Centers_for_Disease_Control_and_Prevention#cite_note-NARA-3.
- Guide to Federal Records, Records of the Centers for Disease Control and Prevention (Record Group 442) 1921–2004, United States: National Archives and Records Administration, 2012, http://www.archives.gov/research/guide-fed-records/groups/442.html.
- Centers for Disease Control and Prevention, “CDC: the nation's prevention agency,” Morbidity and Mortality Weekly Report, vol. 41, no. 44, p. 833, 1992.
- W. Petty, “Mankind and Political Arithmetic,” 1687, http://manybooks.net/titles/pettysiretext04mkpa10.html.
- A. D. Langmuir, “The surveillance of communicable diseases of national importance,” The New England Journal of Medicine, vol. 268, pp. 182–192, 1963.
- A. D. Langmuir, “Evolution of the concept of surveillance in the United States,” Proceedings of the Royal Society of Medicine, vol. 64, no. 6, pp. 681–684, 1971.
- World Health Organization, Report of the Technical Discussions at the 21st World Health Assembly on National and Global Surveillance of Communicable Disease, World Health Organization, Geneva, Switzerland, 1968.
- World Health Organization, STEPS: A Framework for Surveillance. The WHO STEPwise Approach to Surveillance of Noncommunicable Diseases (STEPS), World Health Organization, Geneva, Switzerland, 2003.
- Centers for Disease Control, Comprehensive Plan for Epidemiologic Surveillance, Centers for Disease Control, Atlanta, Ga, USA, 1986.
- K. E. Nelson and F. Sifakis, “Chapter 4. Surveillance,” in Infectious Disease Epidemiology: Theory and Practice, K. E. Nelson and C. M. Williams, Eds., Jones & Bartlett Learning, Sudbury, Mass, USA, 2nd edition, 2007.
- M. A. Stoto, Public Health Surveillance: A Historical Review with a Focus on HIV/AIDS, RAND, Santa Monica, Calif, USA, 2003.
- B. C. K. Choi, “Perspectives on epidemiologic surveillance in the 21st century,” Chronic Diseases in Canada, vol. 19, pp. 145–151, 1998.
- Centers for Disease Control and Prevention, “Updated guidelines for evaluating public health surveillance systems: recommendations from the guidelines working group,” Morbidity and Mortality Weekly Report, vol. 50, no. 13, pp. 1–35, 2001.
- E. J. Freeman, L. J. Colpe, T. W. Strine et al., “Public health surveillance for mental health,” Preventing Chronic Disease, vol. 7, no. 1, p. A17, 2010.
- L. W. Chambers, A. Ehrlich, K. S. O'Connor, P. Edwards, and J. Hockin, “Health surveillance: an essential tool to protect and promote the health of the public,” Canadian Journal of Public Health, vol. 97, no. 3, supplement 2–8, 2006.
- World Health Organization, “Surveillance,” 2012, http://www.who.int/tobacco/surveillance/about_surveillance/en/index.html.
- World Health Organization, “Public Health Surveillance,” 2012, http://www.who.int/immunization_monitoring/burden/routine_surveillance/en/print.html.
- World Health Organization, “Public health surveillance,” 2012, http://www.who.int/topics/public_health_surveillance/en/.
- J. Graunt, The Economic Writings of Sir William Petty, together with The Observations upon Bills of Mortality, more probably by Captain John Graunt,, Cambridge University Press, 1662. Charles Henry Hull ed, Cambridge, UK, 1899, http://oll.libertyfund.org/?option=com_staticxt&staticfile=show.php%3Ftitle=1680&chapter=30684&layout=html&Itemid=27.
- J. Graunt, “John Graunt’s “Bills of Mortality” VIII,” 1662, http://www.edstephan.org/Graunt/8.html.
- O. L. Dick, Aubrey’s Brief Lives, University of Michigan Press, Ann Arbor, Mich, USA, 1957.
- Centers for Disease Control and Prevention, “Lesson 5: public health surveillance,” in Principles of Epidemiology in Public Health Practice: An Introduction to Applied Epidemiology and Biostatistics, CDC, Atlanta, Ga, USA, 3rd edition, 2006, http://www.cdc.gov/osels/scientific_edu/SS1978/Lesson5/index.html .
- W. Halperin and E. L. Baker, Public Health Surveillance, Van Nostrand Reinhold, New York, NY, USA, 1992.
- S. M. Teutsch and R. E. Churchill, Principles and Practice of Public Health Surveillance, Oxford University Press, New York, NY, USA, 1st edition, 1994.
- B. C. K. Choi and L. H. Kuller, “Invited commentary: circular epidemiology. Letter to the Editor,” American Journal of Epidemiology, vol. 151, no. 10, pp. 1036–1037, 2000.
- B. C. K. Choi, “Twelve essentials of science-based policy,” Preventing Chronic Disease, vol. 2, no. 4, 2005.
- B. C. K. Choi, J. Frank, J. S. Mindell, et al., “Vision for a global registry of anticipated public health studies,” American Journal of Public Health, vol. 97, supplement 1, pp. S82–S87, 2007.
- W. J. Eylenbosch and N. D. Noah, Surveillance in Health and Disease, Oxford University Press, Oxford, UK, 1988.
- S. M. Teutsch and R. E. Churchill, Principles and Practice of Public Health Surveillance, Oxford University Press, New York, NY, USA, 2nd edition, 2000.
- L. M. Lee, S. M. Teutsch, S. B. Thacker, and M. E. St. Louise, Principles and Practice of Public Health Surveillance, Oxford University Press, New York, NY, USA, 2010.
- G. W. Rutherford, “Principles and practices of public health surveillance, second edition,” American Journal of Epidemiology, vol. 154, pp. 385–386, 2001.
- D. McQueen and P. Puska, Global Behaviour Risk Factor Surveillance, Klawer Academic/Plenum Publishers, New York, NY, USA, 2003.
- R. Brookmeyer and D. F. Stroup, Monitoring the Health of Populations: Statistical Principles and Methods for Public Health Surveillance, Oxford University Press, New York, NY, USA, 2004.
- J. S. Lombardo and D. L. Buckeridge, Disease Surveillance: A Public Health Informatics Approach, John Wiley & Sons, Hoboken, NJ, USA, 2007.
- P. W. O’Carroll, W. A. Yasnoff, M. E. Ward, L. H. Ripp, and E. L. Martin, Public Health Informatics and Information Systems, Springer, New York, NY, USA, 2010.
- A. Garcia-Albreu, W. Halperin, and I. Danel, Public Health Surveillance Toolkit: A Guide for Busy Task Managers, World Bank, Washington, DC, USA, 2002.
- S. M. Teutsch, “Chapter 2. Considerations in planning a surveillance sytem,” in Principles & Practice of Public Health Surveillance, L. M. Lee, S. M. Teutsch, S. B. Thacker, and M. E. St. Louise, Eds., pp. 18–31, Oxford University Press, New York, NY, USA, 2010.
- M. K. Glynn and L. C. Backer, “Chapter 4. Collecting public health surveillance data: creating a surveillance sytem,” in Principles & Practice of Public Health Surveillance, L. M. Lee, S. M. Teutsch, S. B. Thacker, and M. E. St. Louise, Eds., pp. 44–64, Oxford University Press, New York, NY, USA, 2010.
- A. Abelsohn, J. Frank, and J. Eyles, “Environmental public health tracking/surveillance in Canada: a commentary,” Healthcare Policy, vol. 4, no. 3, pp. 37–52, 2009.
- P. Nsubuga, M. E. White, S. B. Thacker, et al., “Chapter 53. Public health surveillance: a tool for targeting and monitoring interventions,” in Disease Control Priorities in Developing Countries, D. T. Jamison, J. G. Breman, A. R. Measham, et al., Eds., The World Bank and Oxford University Press, Washington, DC, USA, 2nd edition, 2006.
- B. Beech, “Studying the future: a Delphi survey of how multi-disciplinary clinical staff view the likely development of two community mental health centres over the course of the next two years,” Journal of Advanced Nursing, vol. 25, no. 2, pp. 331–338, 1997.
- M. B. Wilk, “Health information for Canada: report of the National Task Force on Health Information,” Final Draft, Statistics Canada, Ottawa, Canada, 1991.
- Centers for Disease Control and Prevention, “Case definitions for infectious conditions under public health surveillance,” Morbidity and Mortality Weekly Report, vol. 46, pp. 1–55, 1997.
- J. Chubak, O. Yu, G. Pocobelli et al., “Administrative data algorithms to identify second breast cancer events following early-stage invasive breast cancer,” Journal of the National Cancer Institute, vol. 104, no. 12, pp. 931–940, 2012.
- S. B. Thacker and D. F. Stroup, “Future directions for comprehensive public health surveillance and health information systems in the United States,” American Journal of Epidemiology, vol. 140, no. 5, pp. 383–397, 1994.
- T. L. Chorba, R. L. Berkelman, S. K. Safford, N. P. Gibbs, and H. F. Hull, “Mandatory reporting of infectious diseases by clinicians,” Morbidity and Mortality Weekly Report, vol. 39, no. -9, pp. 1–17, 1990.
- P. Fraser, V. Beral, and C. Chilvers, “Monitoring disease in England and Wales: methods applicable to routine data-collecting systems,” Journal of Epidemiology and Community Health, vol. 32, no. 4, pp. 294–302, 1978.
- P. S. Brachman, “Chapter 2. Public health surveillance,” in Bacterial Infections of Humans, A. S. Evans and H. L. Feldman, Eds., pp. 51–67, Plenum Press, New York, NY, USA, 1982.
- G. H. Reynolds, “Symposium on Statistics in Surveillance, May 1988,” Statistics in Medicine, vol. 8, pp. 251–400, 1989.
- Centers for Disease Control, “Guidelines for investigation clusters of health events,” Morbidity and Mortality Weekly Report, vol. 39, pp. 1–23, 1990.
- R. M. Anderson, B. T. Grenfell, and R. M. May, “Oscillatory fluctuations in the incidence of infectious disease and the impact of vaccination: time series analysis,” Journal of Hygiene, vol. 93, no. 3, pp. 587–608, 1984.
- K. Choi and S. B. Thacker, “An evaluation of influenza mortality surveillance, 1962–1979 I. Time series forecasts of expected pneumonia and influenza deaths,” American Journal of Epidemiology, vol. 113, no. 3, pp. 215–226, 1981.
- S. Baker, K. E. Holt, A. C. A. Clements, et al., “Combined high-resolution genotyping and geospatial analysis reveals modes of endemic urban typhoid fever transmission,” Open Biology. In press.
- D. M. Parkin and T. Hakuliner, “Chapter 12. Analysis of survival,” in Cancer Registration: Principles and Methods, O. M. Jensen, D. M. Parkin, R. MacLennan, C. S. Muir, and R. G. Skeet, Eds., IARC Scientific Publications no. 95, International Agency for Research on Cancer, Lyon, France, 1991.
- D. W. Hosmer and S. Lemeshow, Applied Logistic Regression, John Wiley & Sons, Jokoken, NJ, USA, 2000.
- R. M. Anderson and R. M. May, “Age-related changes in the rate of disease transmission: implications for the design of vaccination programmes,” Journal of Hygiene, vol. 94, no. 3, pp. 365–436, 1985.
- S. B. Thacker and J. D. Millar, “Mathematical modeling and attempts to eliminate measles: a tribute to the late Professor George Macdonald,” American Journal of Epidemiology, vol. 133, no. 6, pp. 517–525, 1991.
- A. M. Downs, R. A. Ancelle-Park, and J. B. Brunet, “Surveillance of AIDS in the European Community: recent trends and predictions to 1991,” AIDS, vol. 4, no. 11, pp. 1117–1124, 1990.
- I. M. Longini, P. E. M. Fine, and S. B. Thacker, “Predicting the global spread of new infectious agents,” American Journal of Epidemiology, vol. 123, no. 3, pp. 383–391, 1986.
- B. R. Tennison and S. Hagard, “AIDS: Predicting cases nationally and locally,” British Medical Journal, vol. 297, no. 6650, pp. 711–713, 1988.
- Centers for Disease Control, “Lesson five. Public health surveillance,” in Principles of Epidemiology. Self-Study Course 3030-G, Field test version 4, Atlanta, Ga, USA, 2nd edition, 1992.
- D. M. Cain and A. S. Detsky, “Everyone's a little bit biased (even physicians),” Journal of the American Medical Association, vol. 299, no. 24, pp. 2893–2895, 2008.
- J. Adam, “Statistical bias in cross-sequential studies of aging,” Experimental Aging Research, vol. 3, no. 4-5, pp. 325–333, 1977.
- W. H. Foege, R. C. Hogan, and L. H. Newton, “Surveillance projects for selected diseases,” International Journal of Epidemiology, vol. 5, no. 1, pp. 29–37, 1976.
- Centers for Disease Control, “Guidelines for evaluating surveillance systems,” Morbidity and Mortality Weekly Report, vol. 37, supplement S-5, pp. 1–18, 1988.
- S. B. Thacker, R. G. Parrish, F. L. Trowbridge et al., “A method for evaluating systems of epidemiological surveillance,” World Health Statistics Quarterly, vol. 41, no. 1, pp. 11–18, 1988.
- World Health Organization, Protocol for the Evaluation of Epidemiological Surveillance Systems, World Health Organization, Geneva, Switzerland, 1997.
- R. A. Romaguera, R. R. German, and D. N. Klaucke, “Evaluating public health surveillance,” in Principles and Practice of Public Health Surveillance, S. M. Teutsch and R. E. Churchill, Eds., Oxford University Press, New York, NY, USA, 2nd edition, 2000.
- Health Canada, Framework and Tools for Evaluating Health Surveillance Systems, Health Canada, Ottawa, Ontario, Canada, 2004.
- A. Carter, “Establishing goals, techniques and priorities for national communicable disease surveillance,” The Canadian Journal of Infectious Diseases, vol. 2, pp. 37–40, 1991.
- B. P. Weiss, M. A. Strassburg, and S. L. Fannin, “Improving disease reporting in Los Angeles County: trial and results,” Public Health Reports, vol. 103, no. 4, pp. 415–421, 1988.
- R. L. Vogt, D. LaRue, D. N. Klaucke, and D. A. Jillson, “Comparison of an active and passive surveillance system of primary care providers for hepatitis, measles, rubella, and salmonellosis in Vermont,” American Journal of Public Health, vol. 73, no. 7, pp. 795–797, 1983.
- W. Schaffner, H. D. Scott, B. J. Rosenstein, and E. B. Byrne, “Innovative communicable disease reporting,” HSMHA Health Reports, vol. 86, no. 5, pp. 431–436, 1971.
- R. Marier, “The reporting of communicable diseases,” American Journal of Epidemiology, vol. 105, no. 6, pp. 587–590, 1977.
- R. A. Haward, “Scale of undernotification of infectious diseases by general practitioners,” The Lancet, vol. 1, no. 7808, pp. 873–874, 1973.
- S. B. Thacker, S. Redmond, and R. B. Rothenberg, “A controlled trial of disease surveillance strategies,” American Journal of Preventive Medicine, vol. 2, no. 6, pp. 345–350, 1986.
- D. M. Reisler, D. Brachott, and J. W. Mosley, “Viral hepatitis in israel: morbidity and mortality data,” American Journal of Epidemiology, vol. 92, no. 1, pp. 62–72, 1970.
- I. L. Sherman and A. D. Langmuir, “Usefulness of communicable disease reports,” Public Health Reports, vol. 67, no. 12, pp. 1249–1257, 1952.
- T. Randall, “National morbidity data have their beginnings in offices of private practice physicians,” Journal of the American Medical Association, vol. 263, no. 19, pp. 2564–2565, 1990.
- A. M. Kimball, S. B. Thacker, and M. E. Levy, “Shigella surveillance in a large metropolitan area: assessment of a passive reporting system,” American Journal of Public Health, vol. 70, no. 2, pp. 164–166, 1980.
- S. Fan, C. Blair, A. Brown et al., “A multi-function public health surveillance system and the lessons learned in its development: the Alberta Real Time Syndromic Surveillance Net,” Canadian Journal of Public Health, vol. 101, no. 6, pp. 454–458, 2010.
- Institute of Medicine, The Future of Public Health, National Academy Press, Washington, DC, USA, 1988.
- G. S. Birkhead, “Moving public health surveillance onto the health agenda: the perspective of a district health officer,” Morbidity and Mortality Weekly Report, vol. 41, supplement, pp. 29–35, 1992.
- J. M. Last, A Dictionary of Epidemiology, Oxford University Press, New York, NY, USA, 1995.
- B. C. K. Choi, “Understanding the basic principles of programme evaluation,” Journal of Epidemiology and Community Health, vol. 62, no. 11, p. 946, 2008.
- G. James, “Evaluation in public health practice,” American Journal of Public Health, vol. 52, pp. 1145–1154, 1962.
- N. Porteous, B. Sheldrick, and P. Steward, Program Evaluation Tool Kit, Ottawa-Carleton Health Department, Ottawa, Ontario, Canada, 1997.
- Centers for Disease Control and Prevention, “Framework for Program Evaluation in Public Health,” Morbidity and Mortality Weekly Report, vol. 48, pp. 1–40, 1999.
- S. J. N. McNabb, S. Chungong, M. Ryan et al., “Conceptual framework of public health surveillance and action and itsapplication in health sector reform,” BMC Public Health, vol. 2, article 1, pp. 1–9, 2002.
- World Health Organization, “Terminology of malaria and of malaria eradication,” Report for Drafting Committee, World Health Organization, Geneva, Switzerland, 1963.
- D. F. Stroup and R. L. Berkelman, “History of statistical methods in public health,” in Statistics in Public Health: Quantitative Approaches to Public Health Problems, D. F. Stroup and S. M. Teutsch, Eds., pp. 1–18, Oxford University Press, New York, NY, USA, 1998.
- UNAIDS, National AIDS Programmes: A Guide to Monitoring and Evaluation, Joint United Nations Programme on HIV/AIDS (UNAIDS), Geneva, Switzerland, 2000.
- B. C. K. Choi, G. J. M. Eijkemans, and L. M. Tennassee, “Prioritization of occupational sentinel health events for workplace health and hazard surveillance: the Pan American Health Organization Experience,” Journal of Occupational and Environmental Medicine, vol. 43, no. 2, pp. 147–157, 2001.
- B. C. K. Choi, S. J. Corber, D. V. McQueen et al., “Enhancing regional capacity in chronic disease surveillance in the Americas,” Pan American Journal of Public Health, vol. 17, no. 2, pp. 130–141, 2005.
- Health Canada, Chronic Disease Surveillance in Canada: A Background Paper, Health Canada, Ottawa, Ontario, Canada, 2003.
- S. B. Thacker, R. L. Berkelman, and D. F. Stroup, “The science of public health surveillance,” Journal of Public Health Policy, vol. 10, no. 2, pp. 187–203, 1989.
- D. N. Klaucke, J. W. Buehler, S. B. Thacker, et al., “Guidelines for evaluating surveillance systems,” Morbidity and Mortality Weekly Report, vol. 37, pp. 1–18, 1988.
- London School of Hygiene and Tropical Medicine, “Types of surveillance,” in The Use of Epidemiological Tools in Conflict-Affected Populations: Open-Access Educational Resources for Policy-Makers, London School of Hygiene and Tropical Medicine, London, UK, 2009, http://conflict.lshtm.ac.uk/page_75.htm.
- M. Dunstone, T. Macharper, S. Cameron, and C. White, “Surveillance and sentinel systems,” Australian Family Physician, vol. 19, no. 8, pp. 1267–1272, 1990.
- S. B. Thacker, D. F. Stroup, R. B. Rothenberg, and R. C. Brownson, “Public health surveillance for chronic conditions: a scientific basis for decisions,” Statistics in Medicine, vol. 14, no. 5-7, pp. 629–641, 1995.
- E. L. Baker, J. M. Melius, and J. D. Millar, “Surveillance of occupational illness and injury in the United States: current perspectives and future directions,” Journal of Public Health Policy, vol. 9, no. 2, pp. 198–221, 1988.
- E. L. Baker and T. P. Matte, “Chapter 13. Surveillance of occupational illness and injury,” in Public Health Surveillance, W. Halperin, E. L. Baker, and R. R. Monson, Eds., pp. 178–194, Van Nostrand Reinhold, New York, NY, USA, 1992.
- S. B. Thacker, D. F. Stroup, G. Parrish, and H. A. Anderson, “Surveillance in environmental public health: Issues, systems, and sources,” American Journal of Public Health, vol. 86, no. 5, pp. 633–638, 1996.
- D. H. Wegman, “Chapter 6. Hazard surveillance,” in Public Health Surveillance, W. Halperin, E. L. Baker, and R. R. Monson, Eds., pp. 62–75, Van Nostrand Reinhold, New York, NY, USA, 1992.
- Centers for Disease Control, “Preventing emerging infectious diseases: a strategy for the 21st century; overview of the updated CDC plan,” Morbidity and Mortality Weekly Report, vol. 18, pp. 191–198, 1987.
- P. L. Graitcer, “The development of state and local injury surveillance systems,” Journal of Safety Research, vol. 18, no. 4, pp. 191–198, 1987.
- P. L. Graitcer, “Chapter 11. Injury surveillance,” in Public Health Surveillance, W. Halperin, E. L. Baker, and R. R. Monson, Eds., pp. 142–156, Van Nostrand Reinhold, New York, NY, USA, 1992.
- Centers for Disease Control and Prevention, Behavioral Risk Factor Surveillance System Operational and User’s Guide, Version 3.0, US Department of Health and Human Services, CDC, Atlanta, Ga, USA, 2004.
- R. I. Glass and E. K. Noji, “Chapter 14. Epidemiologic surveillance following disasters,” in Public Health Surveillance, W. Halperin, E. L. Baker, and R. R. Monson, Eds., pp. 195–205, Van Nostrand Reinhold, New York, NY, USA, 1992.
- H. H. Tilson, “Chapter 15. Pharmacosurveillance: public health monitoring of medication,” in Public Health Surveillance, W. Halperin, E. L. Baker, and R. R. Monson, Eds., pp. 206–230, Van Nostrand Reinhold, New York, NY, USA, 1992.
- M. L. Rosenberg and W. R. Hammond, “Surveillance the key to firearm injury prevention,” American Journal of Preventive Medicine, vol. 15, no. 3, supplement 1, 1998.
- World Health Organization, Promoting Mental Health: Concepts, Emerging Evidence, Practice, World Health Organization, Geneva, Switzerland, 2004.
- J. F. Epstein, P. R. Barker, and L. A. Kroutil, “Mode effects in self-reported mental health data,” Public Opinion Quarterly, vol. 65, no. 4, pp. 529–549, 2001.
- J. Lando and S. M. Williams, “Uniting mind and body in our health care and public health systems.,” Preventing Chronic Disease, vol. 3, no. 2, p. A31, 2006.
- L. Lenert and D. N. Sundwall, “Public health surveillance and meaningful use regulations: a crisis of opportunity,” American Journal of Public Health, vol. 102, pp. e1–e7, 2012.
- T. D. Vacalis, C. Bartlett, and C. G. Shapiro, “Electronic communication and the future of international public health surveillance,” Emerging Infectious Diseases, vol. 1, no. 1, pp. 34–35, 1995.
- Centers for Disease Control, “Current trends: national electronic telecommunications systems for surveillance—United States 1990-1991,” Morbidity and Mortality Weekly Report, vol. 40, pp. 502–503, 1991.
- Centers for Disease Control and Prevention, “National Electronic Disease Surveillance System,” Fact sheet, August 2007, http://www.cdc.gov/phin/library/phin_fact_sheets/111759_NEDSS.pdf.
- A. J. Valleron, E. Bouvet, and P. Garnerin, “A computer network for the surveillance of communicable diseases: the French experiment,” American Journal of Public Health, vol. 76, no. 11, pp. 1289–1292, 1986.
- Wikipedia, eHealth, 2012, http://en.wikipedia.org/wiki/EHealth.
- V. Della Mea, “What is e-health (2): the death of telemedicine?” Journal of Medical Internet Research, vol. 3, no. 2, pp. 6–7, 2001.
- J. Ginsberg, M. H. Mohebbi, R. S. Patel, L. Brammer, M. S. Smolinski, and L. Brilliant, “Detecting influenza epidemics using search engine query data,” Nature, vol. 457, no. 7232, pp. 1012–1014, 2009.
- K. Wilson and J. S. Brownstein, “Early detection of disease outbreaks using the Internet,” Canadian Journal of Medical Association, vol. 180, no. 8, pp. 829–831, 2009.
- G. Eysenbach, “Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet,” Journal of Medical Internet Research, vol. 11, no. 1, p. e11, 2009.
- W. A. Yasnoff, P. W. O'Carroll, D. Koo, R. W. Linkins, and E. M. Kilbourne, “Public health informatics: improving and transforming public health in the information age,” Journal of Public Health Management and Practice, vol. 6, no. 6, pp. 67–75, 2000.
- A. Friede, H. L. Blum, and M. McDonald, “Public Health Informatics: how Information-Age technology can strengthen public health,” Annual Review of Public Health, vol. 16, pp. 239–252, 1995.
- R. Kukafka and W. A. Yasnoff, “Public health informatics,” Journal of Biomedical Informatics, vol. 40, no. 4, pp. 365–369, 2007.
- P. S. Brachman and S. B. Thacker, “Evolution of epidemic investigations and field epidemiology during the MMWR era at CDC—1961–2011,” Morbidity and Mortality Weekly Report, vol. 60, pp. 22–26, 2011.
- A. H. Mokdad, “The behavioral risk factors surveillance system: past, present, and future,” Annual Review of Public Health, vol. 30, pp. 43–54, 2009.
- M. Link and A. Mokdad, “Leaving answering machine messages: do they increase response rates for the Behavioral Risk Factor Surveillance System?” International Journal of Public Opinion Research, vol. 17, pp. 239–250, 2005.
- M. Link and A. Mokdad, “Use of prenotification letters: an assessment of benefits, costs, and data quality,” Public Opinion Quarterly, vol. 69, pp. 572–587, 2005.
- M. W. Link, A. H. Mokdad, D. Kulp, and A. Hyon, “Has the national do not call registry helped or hurt state-level response rates?: a time series analysis,” Public Opinion Quarterly, vol. 70, no. 5, pp. 794–809, 2006.
- M. Link, L. Osborn, M. Induni, et al., “Behavior coding of real-time survey interpreters,” in Proceedings of the Survey Research Methods Section of the American Statistical Association, pp. 4164–4171, Alexandria, Va, USA, 2006.
- M. W. Link and A. H. Mokdad, “Alternative modes for health surveillance surveys: an experiment with Web, mail, and telephone,” Epidemiology, vol. 16, no. 5, pp. 701–704, 2005.
- M. Link and A. Mokdad, “Can Web and mail survey modes improve participation in an RDD-based national health surveillance?” Journal of Official Statistics, vol. 22, no. 2, pp. 293–312, 2006.
- M. W. Link, M. P. Battaglia, M. R. Frankel, L. Osborn, and A. H. Mokdad, “Address-based versus random-digit-dial surveys: comparison of key health and risk indicators,” American Journal of Epidemiology, vol. 164, no. 10, pp. 1019–1025, 2006.
- M. W. Link, M. P. Battaglia, M. R. Frankel, L. Osborn, and A. H. Mokdad, “A comparison of address-based sampling (ABS) versus random-digit dialing (RDD) for general population surveys,” Public Opinion Quarterly, vol. 72, no. 1, pp. 6–27, 2008.
- M. W. Link, M. P. Battaglia, M. R. Frankel, et al., “Reaching the US cell phone generation: comparison of cell phone survey results with an ongoing landline telephone survey,” Public Opinion Quarterly, vol. 71, no. 5, pp. 814–839, 2007.
- M. W. Link, M. Town, and A. H. Mokdad, “Telephone number portability and the prevalence of cell phone numbers in random digit-dialed telephone survey samples,” International Journal of Public Opinion Research, vol. 19, no. 4, pp. 504–511, 2007.
- American Association for Public Opinion Research, “Evaluating new frontiers in public opinion and social research,” Conference Abstracts (AAPOR), Orlando, Fla, USA, 289 pages, May 2012, http://www.aapor.org/AM/Template.cfm?Section=AAPOR_Annual_Conference&Template=/CM/ContentDisplay.cfm&ContentID=5179.
- M. Ezzati, H. Martin, S. Skjold, S. Vander Hoorn, and C. J. L. Murray, “Trends in national and state-level obesity in the USA after correction for self-report bias: analysis of health surveys,” Journal of the Royal Society of Medicine, vol. 99, no. 5, pp. 250–257, 2006.
- M. Ezzati, S. Oza, G. Danaei, and C. J. L. Murray, “Trends and cardiovascular mortality effects of state-level blood pressure and uncontrolled hypertension in the United States,” Circulation, vol. 117, no. 7, pp. 905–914, 2008.
- D. J. Friedman, M. Anderka, J. W. Krieger, G. Land, and D. Solet, “Accessing population health information through interactive systems: lessons learned and future directions,” Public Health Reports, vol. 116, no. 2, pp. 132–147, 2001.
- D. F. Stroup, M. Wharton, K. Kafadar, and A. G. Dean, “Evaluation of a method for detecting aberrations in public health surveillance data,” American Journal of Epidemiology, vol. 137, no. 3, pp. 373–380, 1993.
- P. S. Sullivan, M. T. McKenna, L. A. Waller, et al., “Chapter 6. Analysing and interpreting public health surveillance data,” in Principles & Practice of Public Health Surveillance, L. M. Lee, S. M. Teutsch, S. B. Thacker, and M. E. St. Louise, Eds., pp. 88–145, Oxford University Press, New York, NY, USA, 2010.
- M. P. Battaglia, M. R. Frankel, and M. W. Link, “Improving standard poststratification techniques for random digit-dialed telephone surveys,” Survey Research Methods, vol. 2, pp. 11–19, 2008.
- M. R. Frankel, K. Srinath, D. C. Hoglin, et al., “Adjustments for nontelephone bias in random-digit-dialing surveys,” Statistics in Medicine, vol. 22, pp. 1611–1626, 2003.
- C. Castillo-Salgado, “Trends and directions of global public health surveillance,” Epidemiologic Reviews, vol. 32, no. 1, pp. 93–109, 2010.
- Weekly Abstract of Sanitary Reports, vol. 6, US Public Health Service, Washington, DC, USA, 1891.
- Centers for Disease Control and Prevention, “Notice to readers update: availability of electronic MMWR on Internet,” Morbidity and Mortality Weekly Report, vol. 44, pp. 759–759, 1995.
- A. L. Fairchild, R. Bayer, and J. Colgrove, Searching Eyes: Privacy, the State, and Disease Surveillance in America, University of California Press, Berkeley, Calif, USA, 2007.
- S. B. Thacker, “Public health surveillance and the prevention of injuries in sports: what gets measured gets done,” Journal of Athletic Training, vol. 42, no. 2, pp. 171–172, 2007.
- R. C. Brownson, J. G. Gurney, and G. H. Land, “Evidence-based decision making in public health,” Journal of Public Health Management and Practice, vol. 5, no. 5, pp. 86–97, 1999.
- B. C. K. Choi, T. Pang, V. Lin et al., “Can scientists and policy makers work together?” Journal of Epidemiology and Community Health, vol. 59, no. 8, pp. 632–637, 2005.
- World Health Organization, International Health Regulations, World Health Organization, Geneva, Switzerland, 1983.
- World Health Organization, “Disease surveillance – WHO's role,” Weekly Epidemiological Record, vol. 73, pp. 333–334, 1998.
- World Health Organization, Report on Infectious Diseases – Removing Obstacles to Healthy Development, World Health Organization, Geneva, Switzerland, 1999.
- World Health Organization, “An integrated approach to communicable disease surveillance,” Weekly Epidemiological Record, vol. 75, pp. 1–8, 2000.
- American Public Health Association, America’s Public Health Report Card: a state-by-state report on the health of the public, APHA, Washington, DC, USA, 1992.
- E. L. Baker, R. J. Melton, P. V. Strange, et al., “Health reform and the health of the public,” Journal of the American Medical Association, vol. 272, pp. 1276–1282, 1994.
- E. L. Baker and D. Ross, “Information and surveillance systems and community health: building the public health information infrastructure,” Journal of Public Health Management Practice, vol. 2, no. 4, pp. 58–60, 1996.
- R. R. Monson, “Editorial commentary: epidemiology and exposure to electromagnetic fields,” American Journal of Epidemiology, vol. 131, no. 5, pp. 774–775, 1990.
- The Joint Task Group on Public Health Human Resources, Building the Public Health Workforce for the 21 Century, Public Health Agency of Canada, Ottawa, Ontario, Canada, 2005.
- G. O. Andze, A. Namsenmo, B. A. Illunga, et al., “Central African Field Epidemiology and Laboratory Training Program: building and strengthening regional workforce capacity in public health,” The Pan African Medical Journal, vol. 10, supplement 1, pp. 4–10, 2011.
- F. Wurapa, E. Afari, C. Ohuabunwo, et al., “One Health concept for strengthening public health surveillance and response through Field Epidemiology and Laboratory Training in Ghana,” Pan African Medical Journal, vol. 10, supplement 1, pp. 6–15, 2011.
- E. R. Choffnes, “Improving infectious disease surveillance,” Bulletin of Atomic Scientists, 2008.
- B. C. K. Choi, R. Bonita, and D. V. McQueen, “The need for global risk factor surveillance,” Journal of Epidemiology and Community Health, vol. 55, no. 6, p. 370, 2001.
- M. Ackland, B. C. K. Choi, and P. Puska, “Rethinking the terms non-communicable disease and chronic disease,” Journal of Epidemiology and Community Health, vol. 57, no. 11, pp. 838–839, 2003.
- World Health Organization, 48th World Health Assembly. 2005. Resolution WHA58.3: Revision of the International Health Regulations, World Health Organization, Geneva, Switzerland, 2005.
- World Health Organization, International Health Regulations, World Health Organization, Geneva, Switzerland, 2nd edition, 2008.
- R. Katz and S. Rosenbaum, “Challenging custom: Rethinking national population surveillance policy in a global public health age,” Journal of Health Politics, Policy and Law, vol. 35, no. 6, pp. 1027–1055, 2010.
- A. M. Kimball, M. Moore, H. M. French et al., “Regional infectious disease surveillance networks and their potential to facilitate the implementation of the international health regulations,” Medical Clinics of North America, vol. 92, no. 6, pp. 1459–1471, 2008.
- E. Mykhalovskiy and L. Weir, “The global public health intelligence network and early warning outbreak detection: a Canadian contribution to Global Public Health,” Canadian Journal of Public Health, vol. 97, no. 1, pp. 42–44, 2006.
- US General Accounting Office, Global Health: Challenges in Improving Infectious Disease Surveillance Systems, US General Accounting Office, Washington, DC, USA, 2001.
- Public Health Agency of Canada, Global Public Health Intelligence Network (GPHIN), PHAC, Ottawa, Ontario, Canada, 2004.
- World Health Organization, Global Influenza Programme (Flu Net), World Health Organization, Geneva, Switzerland, 2009.
- World Health Organization, DengueNet, World Health Organization, Geneva, Switzerland, 2009.
- L. C. Madoff, “ProMED-mail: an early warning system for emerging diseases,” Clinical Infectious Diseases, vol. 39, no. 2, pp. 227–232, 2004.
- L. C. Madoff and J. P. Woodall, “The internet and the global monitoring of emerging diseases: lessons from the first 10 years of ProMED-mail,” Archives of Medical Research, vol. 36, no. 6, pp. 724–730, 2005.
- WARFS, “Global working group on surveillance: World Alliance for Risk Factor Surveillance (WARFS), 2012,” http://www.iuhpe.org/?page=497&lang=en.
- AMNET, Americas’ Network for Chronic Disease Surveillance (AMNET), 2012, http://www.amnet.info/.
- R. Horton, “Health as an instrument of foreign policy,” The Lancet, vol. 369, no. 9564, pp. 806–807, 2007.
- D. M. Fox and J. S. Kassalow, “Making health a priority of US foreign policy,” American Journal of Public Health, vol. 91, no. 10, pp. 1554–1556, 2001.
- T. E. Novotny, “US Department of Health and Human Services: a need for global health leadership in preparedness and health diplomacy,” American Journal of Public Health, vol. 96, no. 1, pp. 11–13, 2006.
- C. Blouin, J. Foster, and R. Laborte, Canada Foreign Policy and Health, Toward Policy Coherence, Commission on the Future of Health Care in Canada, Ottawa, Canada, 2002.
- L. Donaldson and N. Banatvala, “Health is global: proposals for a UK Government-wide strategy,” The Lancet, vol. 369, no. 9564, pp. 857–861, 2007.
- S. S. Morse, “Public health surveillance and infectious disease detection,” Biosecurity and Bioterrorism: Biodefense Strategy, Practice, and Science, vol. 10, pp. 6–16, 2012.