Skip to main content

Nonparametric intensity bounds for the delineation of spatial clusters

Abstract

Background

There is considerable uncertainty in the disease rate estimation for aggregated area maps, especially for small population areas. As a consequence the delineation of local clustering is subject to substantial variation. Consider the most likely disease cluster produced by any given method, like SaTScan, for the detection and inference of spatial clusters in a map divided into areas; if this cluster is found to be statistically significant, what could be said of the external areas adjacent to the cluster? Do we have enough information to exclude them from a health program of prevention? Do all the areas inside the cluster have the same importance from a practitioner perspective?

Results

We propose a method to measure the plausibility of each area being part of a possible localized anomaly in the map. In this work we assess the problem of finding error bounds for the delineation of spatial clusters in maps of areas with known populations and observed number of cases. A given map with the vector of real data (the number of observed cases for each area) shall be considered as just one of the possible realizations of the random variable vector with an unknown expected number of cases. The method is tested in numerical simulations and applied for three different real data maps for sharply and diffusely delineated clusters. The intensity bounds found by the method reflect the degree of geographic focus of the detected clusters.

Conclusions

Our technique is able to delineate irregularly shaped and multiple clusters, making use of simple tools like the circular scan. Intensity bounds for the delineation of spatial clusters are obtained and indicate the plausibility of each area belonging to the real cluster. This tool employs simple mathematical concepts and interpreting the intensity function is very intuitive in terms of the importance of each area in delineating the possible anomalies of the map of rates. The Monte Carlo simulation requires an effort similar to the circular scan algorithm, and therefore it is quite fast. We hope that this tool should be useful in public health decision making of which areas should be prioritized.

Background

There are many methods for the detection and inference of geographic clusters [110]. A large number of methods rely on the Spatial Scan Statistic [11], a development of the Naus spatial scan statistic [12]. Based on this statistic, several extensions were proposed, modifying the shape of the circular window used in the circular scan statistic [13] to include irregular shapes [1420], see [21] for a recent review. However, those methods generally do not discuss the possible uncertainty in the delineation of the most likely cluster found.

There exists nowadays a crescent demand of interactive software for the visualization of spatial clusters [22]. A technique was presented [23] to visualize relative risk and statistical significance simultaneously. Given a map of k areas, with their respective centroids, the procedure builds a grid of equidistant points between all combinations of two, three and four adjacent area centroids. For each grid point the distances to the areas centroids are computed and sorted. These distances are used to define almost circular groupings of areas, with their respective cumulative numbers of observed and expected cases. The relative risk and the likelihood ratio are then calculated for each circular grouping. The likelihood ratio values are compared to the results of a Monte Carlo simulation under the null hypothesis that there are no clusters and the cases are uniformly distributed in the population, such that the expected number of cases in each area is proportional to its population. Groupings with likelihood ratios values exceeding 95% of those obtained from the simulation are stored and stratified into ten levels of relative risk. Within each risk level, the grouping with largest likelihood ratio is then mapped. Circular groupings with lower likelihood ratio are also mapped if they did not overlap any grouping previously mapped. The final result is a ten color shaded map of areas with statistically significant relative risks, providing a very effective visualization tool to grasp these two concepts.

A visual tool was developed [24] to find circular clusters using SaTScan, repeating the search for a set of S different values for the maximum cluster size parameter. The reliability of an area i is defined as the number of times this area is part of a significant circular cluster found by SaTScan, divided by the number S. A typical value of S is 8, with maximum-sizes ranging from 5% to 49%, as given in the paper. This approach allows the interactive visual identification the so-called "core clusters", which are loosely defined as those clusters which appear more consistently through the S multiple runs varying the maximum-size parameters. This method reveals additional information about the cluster structure, although restricted to the circular shape delineation imposed by formalism of the circular scan.

The program SaTScan [17] detects a spatial cluster in aggregated-area maps and compute its significance based on Monte Carlo simulations. This approach allows the characterization of a potential map anomaly, dividing the map into two areas, the cluster and the area outside it. In this work we are interested in pursuing further questions regarding the properties of individual areas inside and outside the detected cluster. We would like to assess the relative importance of individual areas within the cluster. We would also like to verify if the areas outside the cluster and adjacent to it could be indeed excluded from the suspected anomaly region in the map. These questions are important from a public health practitioner perspective. How to access quantitatively the risk of those areas, given that the information we have (cases count) is also subject to variation in our statistical modeling? A few papers have tackled these questions recently. For example, [25] produces confidence intervals for the risk in every area, which are compared to the risks inside the most likely cluster.

Geographic variability studies of disease rates are essential tools in etiology [26]. Maximum Likelihood Estimate Bayesian methods have been proposed to obtain unbiased rates, especially for rare diseases occurring in small population areas [27], thus providing more precise results than the usual maximum likelihood estimators (see [28]). This approach includes information from adjacent areas to locally estimate the risk, consequently reducing the quadratic mean error of the estimated rates. [2931] approaches adjust the test significance levels for geographic risk excess. [32] proposed an empirical Bayes method employing Poisson likelihood with gamma prior in disease mapping. They also presented a non-parametric estimation for the prior using a method which is based on a spatial autoregressive procedure to model the prior distribution parameter devised by [33].

In this paper, we propose a different approach to delineate the "intensity bounds" associated to the most likely cluster, by running Monte Carlo simulations. The number of cases for each area is now considered as a random variable with mean equal to the observed rate, or to some smoothing function which takes into account its first order neighborhood. We will introduce a novel approach to assess the relative importance of individual areas in the composition of the clustering structure.

In our methodology we perform m Monte Carlo replications: we consider that the simulated number of cases for each area is the realization of a random variable with average equal to the observed number of cases of the original map. Then the most likely cluster for each replicated map is detected and the corresponding m likelihood values obtained by means of the m replications are ranked. For each area, we determine the maximum likelihood value obtained among the most likely clusters containing that area. Thus, we construct the intensity function associated to each area's ranking of its respective likelihood value among the m obtained values.

The main purpose of our method is to find the error bounds for the delineation of spatial clusters in maps divided into areas, through the definition of a criterion to measure the plausibility of each area being part of the cluster. As a by-product, our method is capable of identifying irregularly shaped clusters and multiple local clustering. This method is computationally fast and relies on basic ideas about the intrinsic variation of the observed number of cases for each area. This procedure allows the quantification of the uncertainty in the delineation of spatial clusters in a very precise and intuitive way, through the definition of the intensity function.

Methods

The Spatial Scan Statistics

The spatial scan statistic [11] considers a study area map A divided into K areas, with total population N and C total cases. A zone is any collection of connected regions. The null hypothesis assumes that there are no clusters and the cases are uniformly distributed in the population, such that the expected number of cases in each area is proportional to its population. And the number of cases in each region is Poisson distributed proportionally to its population. The number of observed cases is c z and the population is n z in the zone z. The expected number of cases under null hypothesis is given by μ z = C(n z /N). The relative risk of z is I(z) = c z /μ z and the relative risk outside z is O(z) = (C - c z )/(C - μ z ). If L(z) is the likelihood function under the alternative hypothesis and L0 is the likelihood function under the null hypothesis, the logarithm of the likelihood ratio for the Poisson model is given by:

L L R ( z ) = log ( L ( z ) L 0 )
L L R ( z ) = { c z log ( I ( z ) ) + ( C c z ) log ( O ( z ) ) if I ( z ) > 1 0 otherwise
(1)

See [11] for details. LLR(z) is maximized over the chosen set Z of potential zones z, identifying the zone that constitutes the most likely cluster. When the set Z contain the zones defined by circular windows of different radii and centers, maxzZLLR(z) is the circular scan statistic. Other possible choices for Z includes elliptic and irregularly shaped clusters. The statistical significance of the most likely cluster of observed cases is calculated employing Monte Carlo simulation [34]. Under null hypothesis, simulated cases are distributed over the study area and the scan statistic is computed for the most likely cluster. This procedure is repeated many times, and the distribution of the obtained values is compared with the LLR of the most likely cluster of observed cases, producing its p-value.

The intensity function

In this section we define a criterion to measure the plausibility of each area being part of a possible localized anomaly in the map. Instead of finding the most likely cluster in the original map with the observed number of cases for each area, we consider maps where the number of cases are replications of a vector of random variables, whose averages are defined based on the observed number of cases of the original map. We formalize this procedure in the following.

The original map has c i observed cases in the area a i , i = 1, ..., K. Now we construct a Monte Carlo replication randomly distributing the C = i = 1 K c i cases among the K areas a1, ..., a K according to a multinomial distribution where the probability associated to the area a i is c i /C. Let V = (s1, ..., s K ) the realization of the multinomial random vector where s i is the number of simulated cases in the area a i , i = 1, ..., K, where i = 1 K s i = C . The cluster finder algorithm (in our setting we use the circular scan) now finds the most likely cluster MLC 1 with likelihood ratio value LLR 1 . The Monte Carlo procedure above is repeated m times, generating a set of m likelihood ratio values {LLR1, ..., LLR m } corresponding to the most likely clusters {MLC1, ..., MLC m }. The likelihood ratio values are sorted in increasing order as {LLR(1) , ..., LLR(m)} for the corresponding most likely clusters found {MLC(1) , ..., MLC(m)}. We now define the intensity function f : {1, ..., m} → by f (j) = LLR(j), j = 1, ..., m.

For each area a i , let:

q ( a i ) = 1 m arg max 1 j m , a i M L C ( j ) f ( j ) , i = 1 , ... , K .

If the area a i does not belong to any of the sets MLC(1) , ..., MLC(m)then we set q(a i ) = 0. The value q(a i ) represents the quantile of the highest likelihood ratio among the ranked values of the likelihood ratios of the most likely clusters found in the m Monte Carlo replications, which take into account the variability of the number of cases in each area. In this sense, the value q(a i ) may be interpreted as the relative importance of the area a i as part of the anomaly of the map, where the value f(j) represents the maximum likelihood ratio found for the most likely clusters which contain the area a i . This concept gives more information about the anomaly than the clear-cut division between cluster and non-cluster areas, as given by the usual process of finding the most likely cluster in the original map.

Rate correction using empirical Bayesian estimator

We shall consider a variation of the procedure described in the previous section. Instead of using the observed number of cases, this variant uses Marshall's smoothed estimates of the number of cases based on the information of first order neighborhood of each area. We then compute the intensity function in those two situations, employing the raw number of cases and Marshall's estimates.

Empirical Bayes methods were employed by [28] and [35]. Studies involving disease rates to show the geographical variability are common in epidemiological approaches. For this kind of approach it is important to assess the problem of obtaining unbiased estimates. Some Bayesian methods have been proposed in the literature for estimation of risks in small areas. These methods are based on information from other areas that comprise the region of study. One consequence of using these methods is to decrease the total mean square error of the estimates [27]. That is, relative risks are estimated more accurately by Bayesian methods than by using maximum likelihood estimation. Authors like [28] and [35] address this issue.

Using Bayesian methods in the estimation of spatial phenomena have the extra advantage of allowing the incorporation of spatial similarities between adjacent areas in risk estimates. Adding this information to the estimation of risk can lead to maps with more stable estimates and more precise differentiation between what is a true high (or very low) risk and what is indeed a random fluctuation caused by small populations. Moreover, it is expected that the estimates reproduce the spatial pattern of the real risks.

In our work we use the estimation procedure proposed by Marshall [28] to obtain estimates of relative risks. We use local empirical Bayesian estimators, because it is often reasonable to consider adjacent areas whose rates are similar because they are likely to be similar in other aspects. We use the first order neighbors of the area for which we want to get the estimated rate. The methodology developed by Marshall proposed an empirical Bayesian estimator for the risk of rare diseases, where one can approximate the distribution of the number of cases by the Poisson distribution, with parameter estimated by the method of moments. Consider a map divided into k areas indexed by i, i = 1, 2, ..., k. Suppose that events are recorded for each area in a period of time. Let θ i be the event rate in the i-th area and assume that y i , the number of events accumulated in the i-th area during this period, is distributed as a Poisson random variable with mean E(y i |θ i ) = n i θ i , where n i is the population at risk in the i-th area. The maximum likelihood estimator of θ i is t i = y i /n i . This estimator has mean and variance conditioned on θ i given by E(t i |θ i ) = θ i and V(t i |θ i ) = θ i /n i , respectively. In the Bayesian approach, θ i has a prior distribution with mean m i = E θ i and variance a i = V θ i . Unconditionally, t i has mean m i = E t i and variance V t i = a i + m i n i . Efron and n i Morris [27] showed that, given m i and a i , the best linear Bayes estimator for θ i is expressed by

θ i ^ = w i t i + ( 1 w i ) m i

where w i = A i ( A i + m i / n i ) is the a ratio between the a prior variance of θ i and the unconditional variance of t i . The global empirical Bayesian estimator proposed by [28] assumes that the distribution of θ i is the same for all areas and then replaces m i and A i by m and A, respectively. Using the method of moments, Marshall showed that the estimates for m and A are given, respectively, by m ˜ = y i n i and A ˜ = s 2 m ˜ n ¯ , where s 2 = n i ( t i m ˜ ) n i , n ¯ = n i N and k is the number of areas of the map. As the overall proposal is spatially invariant, i.e., independent of the performed permutation, the estimates do not change. It is necessary to change the expression of θ i for the estimation of the a prior parameters set to be performed based on information from the neighboring areas of i. In this case, w i , m, s2and n are replaced by W i , M i , s i 2 and n i , respectively, calculated only with data from the neighboring areas of i, and are defined as the local empirical Bayesian estimators.

Marshall's smoothing procedure is advantageous when the number of cases is very small. It will be used for the Chagas' disease map, which has a reduced number of cases, as we shall see in the Results section.

Results and Discussion

Our methodology was testing in numerical simulations and was applied in three case studies.

Numerical Simulations

Three different types of "true" artificial clusters will be tested: a single circular cluster (in two maps with different relative risks), a L-shaped irregular cluster, and a double circular cluster (also in two maps with different relative risks). In all situations, the map consists of a rectangular array of 203 hexagonal cells, each cell with population 1000. The centroids of the hexagonal cells are not placed in a perfectly regular array; we introduced a slight random displacement on both x and y axes, in order to avoid ties when measuring distances between any two centroids. Cases are randomly distributed such that the cells inside the true cluster have higher probability of receiving cases than the areas outside it; the resulting maps with the randomly distributed cases are also displayed. That means that we will find clusters in "noisy" maps, where the number of cases is not homogeneously distributed inside and outside the artificial clusters. The clusters found by the circular scan are also shown. Finally, we display the resulting maps built through the intensity function.

Single Circular Cluster

Figure 1 shows a circularly shaped true artificial cluster with very high relative risk (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c). The intensity function is displayed in Figure 2a. Finally, the intensity bounds map obtained by our method is shown in Figure 2b.

Figure 1
figure 1

A single circularly shaped true artificial cluster with very high relative risk (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c).

Figure 2
figure 2

The intensity function (a) and the intensity bounds map (b) for the very high relative risk single circular cluster.

Figures 3 and 4 show the analogous results for another circularly shaped true cluster, with moderately high relative risk, for comparison.

Figure 3
figure 3

A single circularly shaped true artificial cluster with moderately high relative risk (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c).

Figure 4
figure 4

The intensity function (a) and the intensity bounds map (b) for the moderately high relative risk single circular cluster.

The intensity bounds of the very high relative risk cluster are more sharply defined than those corresponding to the moderately high relative risk cluster, as expected. Observe that in both instances the true clusters were clearly detected, as represented by the darkest shade in Figures 2 and 4.

Irregularly Shaped Cluster

Figure 5 shows a L-shaped true artificial cluster (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c). The intensity function is displayed in Figure 6a. The intensity bounds map obtained by our method is shown in Figure 6b.

Figure 5
figure 5

The L-shaped true artificial cluster (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c).

Figure 6
figure 6

The intensity function (a) and the intensity bounds map for the L-shaped artificial cluster.

The circular scan detected a circular cluster centered in the angle formed by the two braces of the L-shaped cluster. However, the intensity bounds roughly delineated the L-shape, with a more intense region located around the angle of the L-shaped cluster. Sometimes the realizations of the random variable produced maps where circular clusters were found centered in the angle of the L-shaped cluster, but, very interestingly, also produced circular clusters centered along the braces of the L-shaped cluster. As a result, the overall intensity map of Figure 6 indicates the form of the L-shaped cluster.

Double Circular Cluster

Figure 7 shows a double circularly shaped true artificial cluster with very high relative risk (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c). The intensity function is displayed in Figure 8a. Finally, the intensity bounds map obtained by our method is shown in Figure 8b.

Figure 7
figure 7

A double circularly shaped true artificial cluster with very high relative risk (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c).

Figure 8
figure 8

The intensity function (a) and the intensity bounds map (b) for the double circularly shaped cluster with very high relative risk.

Figures 9 and 10 show the analogous results for another double circular true cluster, with moderately high relative risk, for comparison.

Figure 9
figure 9

A double circularly shaped true artificial cluster with moderately high relative risk (a), the random generated cases map of rates (b), and the cluster detected by the circular scan (c).

Figure 10
figure 10

The intensity function (a) and the intensity bounds map (b) for the moderately high relative risk double circular cluster.

As displayed in Figure 7b and also in Figure 9b, the local rates of the two components of the double cluster are not equal, and the circular scan detected only the circular component cluster with the highest rate (Figures 7c and 9c). However, the intensity bounds delineated both circular clusters, with a more intense region located around the highest risk circular component (Figures 8b and 10b). Sometimes the realizations of the random variable produced maps where the highest risk circular component was found, but also produced circular clusters centered in the lower risk component. As a result, the overall intensity map indicates the two components, with different intensities.

Real Data Case Studies

To illustrate our method, we present three real data case studies. In the first study, with homicide cases in Minas Gerais state, Brazil, the most likely cluster is compact and very sharply delineated, being highly geographically focused. The second study is a well-known benchmark of female breast cancer in the Northeast U.S. [11], and the third case study displays Chagas' disease cases in puerperal women, also in Minas Gerais state, Brazil. In those two last studies, the most likely clusters are not sharply delineated, being moderately geographically focused. The breast cancer study has many cases, compared to the reduced number of cases of the Chagas' disease study, allowing us to compare the performance of the map in two very different situations.

In the Chagas' disease study we used both the raw and Marshall's smoothed rates, due to the small number of cases. On the other hand, for the the other two studies we have only presented raw rates results, because there are no advantages in employing smoothed rates when the raw rates are based in a large number of cases. For all maps, each area a i will be colored according to the quantile given by the function value q(a i ), as explained in the previous section. The choice of the quantile level representation by distinct shades of color varies in each map. We have chosen quantile levels in order to improve the visualization of the intensity function in the maps. All blank areas were never part of any cluster in the Monte Carlo simulations, corresponding to those areas a i for which q(a i ) = 0. In the software, the user may choose arbitrary quantiles to represent the data. All the programming was made using Matlab 7.10 and the code is available from the authors.

Homicide Clusters

Minas Gerais state is located in Brazil's Southwest and consists of 853 municipalities, with 20,912 registered homicides from 2003 to 2007, and an estimated population of 19,150,344 in 2005. Data are available from the Brazilian Ministry of Health http://www.datasus.gov.br and the Brazilian Institute of Geography and Statistics http://www.ibge.gov.br.

The raw rates map is presented in Figure 11a and the population at risk map in Figure 11b. The Monte Carlo procedure described in the Methodology section is performed for the raw rates, producing their respective intensity function. The intensity function for the raw rates map is displayed in Figure 12. Figure 13a shows the most likely cluster found by circular scan. Figure 13b show the map corresponding to the intensity function derived from the raw rates map.

Figure 11
figure 11

Homicide rates map (a) and population at risk map (b) in Minas Gerais State, Brazil.

Figure 12
figure 12

The intensity function for the homicides map.

Figure 13
figure 13

The most likely cluster found by the circular scan (a) and intensity function map (b) for the homicides map.

In the intensity function map, the non-blank areas attain almost the same level, meaning that the anomaly is very conspicuous. On the other hand, this anomaly is compact and coincides with the most likely cluster found by the circular scan. Although there are other places in the map where the rates are elevated, the values of the intensity function are not elevated enough to produce non-blank areas outside the anomaly in the center of the map.

The Breast Cancer Clusters in Northeastern United States

The data set of mortality from breast cancer in the Northeastern U.S. consists of age-adjusted 58,943 deaths for the period from 1988 to 1992, with the female population at risk of 29,535,210 in 1990. This map consists of 245 counties in 10 states and the District of Columbia. This dataset has been studied in detail using the circular spatial scan statistic [36] and the elliptic spatial scan statistic [37].

The raw rates map is presented in Figure 14a and the population at risk map in Figure 14b. The Monte Carlo procedure is performed producing its respective intensity function, displayed in Figure 15.

Figure 14
figure 14

The rates map (a) and population at risk map (b) for the Northeast U.S. breast cancer data.

Figure 15
figure 15

The intensity function for the Northeast U.S. breast cancer data.

This case study presents a very different situation from the first example. The map derived from intensity function in Figure 16b shows the presence of various anomalies placed at different parts of the study area, indicating their geographic focus. We clearly observe three distinct groups of shaded areas in Figure 16b, consistently matching with the three strongest clusters found by SaTScan [36], shown in Figure 16a. The darkest shaded group is associated to the New York, NY-Philadelphia, PA primary cluster, with p-value 0.0001. The upper left group of four gray areas coincides exactly with the Buffalo, NY secondary cluster, with p-value 0.122. Finally the gray area at the lower center of the map corresponds to the Washington, DC secondary cluster, with p-value 0.147.

Figure 16
figure 16

The three strongest clusters found by SaTScan [36] (a) and intensity function map (b) for the Northeast U.S. breast cancer data.

This example shows that the intensity function has the ability to delineate even the multiple and irregularly shaped potential clusters. We stress the fact that, for each Monte Carlo replication, only the primary most likely cluster was used to build the map derived from the intensity function of Figure 16b.

Chagas' Disease Clusters

This subsection presents the data set of Chagas' disease cases in puerperal women in Minas Gerais state, Brazil. The population at risk consists of women that gave birth to babies in the period of July to September, 2006. The new-born babies were blood tested to detect the presence of the Chagas disease antigen, with coverage above 96%. A positive test means that the mother is infected. These tests were conducted through the project PETN-MG (Minas Gerais State Program of New-Born Screening) coordinated by the research group NUPAD-MEDICINA/UFMG from Federal University of Minas Gerais Medical School http://www.nupad.medicina.ufmg.br in collaboration with Minas Gerais State Health Secretary. The state is divided into 853 municipalities with a total population at risk of 24,969 women. After a comprehensive screening to eliminate false positives a total number of 113 cases were obtained.

The raw rates map is presented in Figure 17a and the population at risk map in Figure 17b. The Monte Carlo procedure is performed for both the raw rates and Marshall's smoothed rates maps, producing their respective intensity functions. The intensity function for the raw rates map is displayed in Figure 18a. The intensity function for Marshall's smoothed rates is displayed in Figure 18b. Figure 19a shows the most likely cluster found by circular scan. Figures 19b and 19c show the maps corresponding to the intensity function derived from the raw rates map and the smoothed rates map, respectively.

Figure 17
figure 17

Chagas' disease rates map (a) and population at risk map (b) in Minas Gerais State, Brazil.

Figure 18
figure 18

The intensity functions of the raw rates (a) and smoothed rates (b) for the Chagas' disease map.

Figure 19
figure 19

The most likely cluster found by the circular scan for the raw rates map (a), the raw rates intensity function map (b) and Marshall's smoothed rates intensity function map (c) for the Chagas' disease map.

The maps derived from the raw (Figure 19b) and smoothed (Figure 19c) intensity functions show the presence of a strong anomaly. For the map of Figure 19b, the area formed by the highest intensity areas (dark colored) coincides almost perfectly with the primary cluster found by the circular scan. However, the corresponding area of Figure 19c does not match so well the primary cluster, due to the overdispersion created by Marshall's smoothing procedure. In both maps, we observe that the anomaly is less geographically focused, spreading over the northern part of the state. This example shows that the error bounds of the existing cluster were easily visualized by means of the intensity function. The application of Marshall's smoothing procedure does not contribute to improve the delineation of the anomaly, even considering that there are few cases in the study area.

Conclusions

Our methodology takes into account the variability in the observed number of disease cases on area-aggregated maps to nonparametrically infer the uncertainty in the delineation of spatial clusters. A given real data map is regarded as just one possible realization of an unknown random variable vector with expected number of cases. The real data vector of the number of observed cases in each area is used to construct a new vector of expected values of random variables, either as a composition of neighboring areas in the map, employing Marshall's smoothing, or either considering the raw count of cases as the average of the random variables. This vector is now an estimate of the unknown random variable vector with expected number of cases. Our methodology performs m Monte Carlo replications based on this estimated vector of averages. The most likely cluster of each replicated map is detected and the m corresponding likelihood values obtained in the replications are ranked. For each area we determine the maximum likelihood value among the most likely clusters containing that area. Thus, we obtain the intensity function associated to each area's ranking of their respective likelihood value among the m values. The intensity of each area can be interpreted as the importance of that area in the delineation of the possibly existing anomaly on the map, considering only the initially given information of the observed number of cases. This procedure, based on empirical distribution, takes into account the intrinsic variability of the observed number of cases, which generally is not considered directly in the existing algorithms used to detect spatial clusters.

In our case studies we could see different situations with respect to the intrinsic variability of the existing spatial anomaly. When the most likely cluster is quite prominent, as seen in the homicides map example, the intensity function is such that almost all areas associated with the most likely clusters found in the m replications coincides with those areas composing the most likely cluster detected for the original observed cases. In this example the geographic anomaly is highly focused. However, in the other two case studies, the opposite happens. The Chagas' disease map presents an intrinsically wide variability of data. Many areas near or adjacent to the most likely cluster have values of the intensity function close to the values corresponding to areas of the most likely cluster. In the case study of breast cancer, this intrinsic variability produces a map with clearly unrelated areas, but with rather close probability ranking, indicating a situation of multiplicity of clusters, i e., the most likely cluster is clearly poorly delineated. It is noteworthy that the entire procedure was performed using the circular scan, and even then it identifies irregular and multiple clusters.

An analogy with our proposed method can be found in image analysis: suppose we take several short digital exposures of a very low light level scene, e.g. some deep-sky field of galaxies. Each exposure generates an image consisting of a rectangular matrix of pixels, each pixel receiving a small number of photons corresponding to the illumination of its small associated portion of the image. The expected rate of photons is constant during all the exposures, but the number of photons received by the same pixel varies from one exposure to the other due to the stochastic nature of the process. Usually, one simply adds the values for the same pixel through all the exposures, to compose a single final image with higher sharpness (signal-to-noise). Instead, we first submit each exposure image through a filter, which in our case is the algorithm to detect the most likely cluster, and then compose all the corresponding clusters into a single "cluster image" by means of the intensity function. If the "real" cluster is very contrasting with the background noise, all exposures will produce very similar clusters, thus producing a sharply defined final cluster image. Otherwise, when the real cluster is not very conspicuous, we should observe a large variation in individual clusters, producing a poorly delineated cluster in the final image.

We presented two variants of the computation of the intensity function. The first employed the raw number of cases, and the second used Marshall's smoothed estimates of the number of cases based on the information of the first order neighborhood of each area. This was done because we were especially concerned with areas containing zero cases, which could generate biased Monte Carlo distributions of cases over the map. Marshall's smoothed estimates of cases could potentially alleviate this problem providing non-zero averages employed in the multinomial random vector. However, we have noted in all our examples that the application of Marshall's smoothed estimates produces less sharply defined intensity function maps, compared to those obtained by the use of the raw cases data. On the other hand, we could not observe any artifacts due to the use of non-smoothed raw cases data in the delineation of the anomaly. This may be explained by the simple fact that the circular spatial scan works itself as a "filter", when it joins several areas within the circular window, thus naturally diminishing the effect of the zero cases areas in the composition of the cluster candidates. This suggests that the utilization of raw cases data does not seem to interfere with the visualization of the intensity bounds.

This tool uses simple mathematical concepts and the interpretation of the intensity function f is very intuitive in terms of the importance of each area in delineating the possible anomalies of the map of rates.

The Monte Carlo simulation requires an effort similar to the circular scan algorithm, and therefore it is quite fast. Furthermore, the accuracy of the interactive construction of the map from the intensity function f increases gradually with execution time. Thus the user could stop the simulation process at any time when it is realized that the delineation of potential anomalies will converge. We therefore hope that this tool may assist in the decision process of prioritizing the areas of a map associated with potential spatial anomaly.

References

  1. Cressie NAC: Statistics for Spatial Data. 1993, New York: Wiley

    Google Scholar 

  2. Elliott P, Martuzzi M, Shaddick G: Spatial statistical methods in environmental epidemiology: a critique. Statistical Methods in Medical Research. 1995, 4: 137-159. 10.1177/096228029500400204.

    Article  CAS  PubMed  Google Scholar 

  3. Kulldorff M: Spatial scan statistics: Models, calculations, and applications. Recent Advances on Scan Statistics and Applications. Edited by: Balakrishnan, Glaz. 1999, Boston: Birkhauser, 303-322.

    Chapter  Google Scholar 

  4. Moore DA, Carpenter TE: Spatial analytical methods and geographic information systems: use in health research and epidemiology. Epidemiologic Reviews. 1999, 21: 143-161.

    Article  CAS  PubMed  Google Scholar 

  5. Waller LA, Jacquez GM: Disease models implicit in statistical tests of disease clustering. Epidemiology. 2000, 6: 584-590. 10.1097/00001648-199511000-00004.

    Article  Google Scholar 

  6. Lawson A, Biggeri A, Bohning D, Lesare E, Viel JF, Bertollini R: Disease mapping and risk assessment for public health. 1999, Chichester: Wiley

    Google Scholar 

  7. Glaz J, Naus J, Wallenstein S: Scan Statistics. 2001, New York: Springer

    Book  Google Scholar 

  8. Lawson A: Statistical methods in spatial epidemiology. 2001, Chichester: Wiley

    Google Scholar 

  9. Balakrishnan N, Koutras MV: Runs and Scans with Applications. 2002, New York: Wiley

    Google Scholar 

  10. Buckeridge DL, Burkom H, Campbell M, Hogan WR, Moore AW: Algorithms for rapid outbreak detection: a research synthesis. Journal of Biomedical Informatics. 2005, 38: 99-113. 10.1016/j.jbi.2004.11.007.

    Article  PubMed  Google Scholar 

  11. Kulldorff M: A spatial scan statistic. Communications in Statistics: Theory and Methods. 1997, 26 (6): 1481-1496. 10.1080/03610929708831995.

    Article  Google Scholar 

  12. Naus JI: Clustering of random points in two dimensions. Biometrika. 1965, 52: 263-267. 10.2307/2333829.

    Article  Google Scholar 

  13. Kulldorff M, Nagarwalla N: Spatial disease clusters: detection and inference. Statistics in Medicine. 1995, 14: 779-810. 10.1002/sim.4780140809.

    Article  Google Scholar 

  14. Duczmal L, Assunção R: A simulated annealing strategy for the detection of arbitrarily shaped spatial clusters. Computational Statistics and Data Analysis. 2004, 45: 269-286. 10.1016/S0167-9473(02)00302-X.

    Article  Google Scholar 

  15. Patil GP, Taillie C: Upper level set scan statistic for detecting arbitrarily shaped hotspots. Environmental and Ecological Statistics. 2004, 11: 183-197. 10.1023/B:EEST.0000027208.48919.7e.

    Article  Google Scholar 

  16. Tango T, Takahashi K: A flexibly shaped spatial scan statistic for detecting clusters. International Journal of Health Geographics. 2005, 4 (11):

  17. Kulldorff M, Services IM: Inc. SatScanTM v7.0: Software for the spatial and spacetime Scan statistics. Tech rep. 2006,http://www.satscan.org/http://www.satscan.org/

    Google Scholar 

  18. Duczmal L, Kulldorff M, Huang L: Evaluation of spatial scan statistics for irregularly shaped clusters. Journal of Computational and Graphical Statistics. 2006, 15: 428-442. 10.1198/106186006X112396.

    Article  Google Scholar 

  19. Duczmal L, Cançado ALF, Takahashi RHC, Bessegato LF: A Genetic Algorithm for Irregularly Shaped Spatial Scan Statistics. Computational Statistics and Data Analysis. 2007, 52: 43-52. 10.1016/j.csda.2007.01.016.

    Article  Google Scholar 

  20. Yiannakoulias N, Rosychuk RJ, Hodgson J: Adaptations for finding irregularly shaped disease clusters. International Journal of Health Geographics. 2007, 6 (28):

  21. Duczmal LH, Duarte AR, Tavares R: Extensions of the scan statistic for the detection and inference of spatial clusters. Scan Statistics. Edited by: Glaz J, Pozdnyakov V, Wallenstein S. 2009, Birkhauser, 153-177. full_text.

    Chapter  Google Scholar 

  22. Hardisty F, Conley J: Interactive Detection of Spatial Clusters. Advances in Disease Surveillance. 2008, 5: 37-

    Google Scholar 

  23. Boscoe FP, McLaughlin C, Schymura MJ, Kielb CL: Visualization of the spatial scan statistic using nested circles. Health & Place. 2003, 9: 273-277.

    Article  Google Scholar 

  24. Chen J, Roth RE, Naito AT, Lengerich EJ, MacEachren AM: Geovisual analytics to enhance spatial scan statistic interpretation: an analysis of U.S. cervical cancer mortality. International Journal of Health Geographics. 2008, 7 (57):

  25. Rosychuk RJ: Identifying geographic areas with high disease rates: when do confidence intervals for rates and a disease cluster detection method agree?. International Journal of Health Geographics. 2006, 5 (46):

  26. Lawson AB: Bayesian Disease Mapping: Hierarchical Modeling in Spatial Epidemiology. Series: Interdisciplinary Statistics. 2009, New York: Chapman & Hall/CRC

    Google Scholar 

  27. Efron B, Morris C: Stein's estimaton rule and its competitors - an empirical Bayes approach. Journal of the American Statistical Association. 1973, 68: 117-130. 10.2307/2284155.

    Google Scholar 

  28. Marshall RJ: Mapping disease and mortality rates using empirical Bayes estimators. Applied Statistics. 1991, 40: 283-294. 10.2307/2347593.

    Article  CAS  PubMed  Google Scholar 

  29. Manton KG, Woodbury MA, Stallard E: A variance components approach to categorical data models with heterogeneous cell populations: analysis of spatial gradients in lung cancer mortality rates in North Carolina counties. Biometrics. 1981, 37: 259-269. 10.2307/2530416.

    Article  CAS  PubMed  Google Scholar 

  30. Manton KG, Stallard E, Woodbury MA, Riggan WB, Creason JP, Mason TJ: Statistically adjusted estimates of geographic mortality profiles. J Natl Cancer Inst. 1987, 78: 805-815.

    CAS  PubMed  Google Scholar 

  31. Stone RA: Investigations of excess environmental risks around putative sources: statistical problems and a proposed test. Statistics in Medicine. 1988, 7: 649-660. 10.1002/sim.4780070604.

    Article  CAS  PubMed  Google Scholar 

  32. Clayton D, Kaldor J: Empirical Bayes estimates of age-standardized relative risks for use in disease mapping. Biometrics. 1987, 43: 671-681. 10.2307/2532003.

    Article  CAS  PubMed  Google Scholar 

  33. Laird N: Non-parametric maximum likelihood estimation of a mixing distribution. Journal of the American Statistical Association. 1978, 73: 805-811. 10.2307/2286284.

    Article  Google Scholar 

  34. Dwass M: Modified randomization tests for nonparametric hypotheses. Annals of Mathematical Statistics. 1957, 28: 181-187. 10.1214/aoms/1177707045.

    Article  Google Scholar 

  35. Yasui Y, Liu H, Benach J, Winget M: An empirical evaluation of various priors in the empirical Bayes estimation of small area disease risks. Statistics in Medicine. 2000, 19 (17-18): 2409-2420. 10.1002/1097-0258(20000915/30)19:17/18<2409::AID-SIM578>3.0.CO;2-U.

    Article  CAS  PubMed  Google Scholar 

  36. Kulldorff M, Feuer EJ, Miller BA, S FL: Breast Cancer Clusters in the Northeast United States: A Geographic Analysis. American Journal of Epidemiology. 1997, 146: 161-170.

    Article  CAS  PubMed  Google Scholar 

  37. Kulldorff M, Huang L, Pickle L, Duczmal L: An Elliptic Spatial Scan Statistic. Statistics in Medicine. 2006, 25: 3929-3943. 10.1002/sim.2490.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors thank the editor and the three reviewers for their helpful comments. The authors were partially supported by the Brazilian institutions CAPES, CNPq and Fapemig. We thank Eliane Gontijo for providing the Chagas' disease data and Martin Kulldorff for providing the Northeast U.S. age-adjusted breast cancer data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luiz H Duczmal.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

FLPO, LHD and ALFC proposed the methodology, developed the programs, conducted the simulations, analyzed the case studies and drafted the manuscript. RT contributed with the implementation of Marshall's smoothing procedure. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Authors’ original file for figure 4

Authors’ original file for figure 5

Authors’ original file for figure 6

Authors’ original file for figure 7

Authors’ original file for figure 8

Authors’ original file for figure 9

Authors’ original file for figure 10

Authors’ original file for figure 11

Authors’ original file for figure 12

Authors’ original file for figure 13

Authors’ original file for figure 14

Authors’ original file for figure 15

Authors’ original file for figure 16

Authors’ original file for figure 17

Authors’ original file for figure 18

Authors’ original file for figure 19

Authors’ original file for figure 21

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Oliveira, F.L., Duczmal, L.H., Cançado, A.L. et al. Nonparametric intensity bounds for the delineation of spatial clusters. Int J Health Geogr 10, 1 (2011). https://doi.org/10.1186/1476-072X-10-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1476-072X-10-1

Keywords