Sequential Detection of Transient Signals with Exponential Family Distribution

We use the following change of measure technique. For 1\leq t \leq L, define a changed measure P_t(.) that under P_t(.), X_{t-w+1}, ...,X_t follow f_{\theta/\sqrt{w}}(x) and other X_i’s follow f_0(x). The log-likelihood ratio of X_1, ..., X_L under P_t(.) with respect to P_0^*(.) is

Note that E_t(Z_{t;w}) = \sqrt{w}c'(\theta/\sqrt{w}). So the value of \theta will be selected such that the boundary b equals to the mean of E_t(Z_{t;w}), i.e. b= \sqrt{w} c'(\theta /\sqrt{w}). Due to the monotone property of c'(\theta), we can assume the solution exists and is unique. Denote \tilde{l}_t= \theta ( Z_{t;w} -b). The change of measure technique in Siegmund and Yakir (2000) shows that

where M_t =\max_{1\leq s\leq L} e^{l_s -l_t} and S_t =\sum_{1\leq s\leq L} e^{l_s -l_t}.

As w \rightarrow \infty, \tilde{l}_t is asymptotically normal with mean 0 and variance \theta^2 c''(\theta/\sqrt{w}) under P_t(.). By applying the localization technique in Siegmund, et al. (2010) along with the saddle-point approximation, we have

In the following, we study in detail the approximation for E_t[\frac{M_t}{S_t}] in the exponential family case. For s<t and s \geq t-w,

which is a two-sided random walk with drift

and variance

Same result holds for s>t, s\leq t+w. Thus we have the following approximation

where the last factor equals to \lim_{d \rightarrow \infty} E\exp(-(\theta/\sqrt{w})(S_{\tau_d}-d)) with

where X_i follows f_{\theta} (x) and X_i' follows f_0(x) and can be approximated as

Theorem 1 is proved by combining the above approximations,

Note that typically h is quite small, thus \theta/\sqrt{w} is also small. The above approximation can further be simplified as

where \phi(x) is the standard normal density function.

We extend the techniques as in Section 2. Define a changed measure P_t(.) such that X_{t-w+1},..., X_t follow f_{\theta}(x) and others follow f_0(x) such that under P_t(.), the likelihood ratio can be approximated by

The value of \theta will be decided by equating the mean E_t^* R_t^* =b, the boundary. Thus, the log-likelihood ratio is l_t =b R_t^* -b^2/2. Denote \tilde{l}_t = b(R_t^* -b) with mean 0 and variance b^2. By applying the localization technique, for L =O(w), we can immediately get the following approximation

where M_t=\max_{0\leq s \leq L} \exp((b(R_s^* -R_t^*)) and S_t =\sum_{0\leq s\leq t}\exp((b(R_s^* -R_t^*)).

As w\rightarrow \infty, since E_t R_t^* \approx b, by assuming b/\sqrt{w} \rightarrow h, by using the stochastic expansion under P_t(.) below, \theta satisfies

When b^2/w is small, \theta \approx b/\sqrt{c''(0) w}. To study the limit of E_t [\frac{M_t}{S_t}], we use the following stochastic expansion under the changed measure P_t(.) with parameter \theta

When \theta is small,

For s= t \pm O(\sqrt{w}), since E_t \bar{X}_{s;w} = (1-\frac{|t-s|}{w})c'(\theta), we see the same expansion still holds for R_s. On the other hand, at the first order, E_tR_t \approx b =O(\sqrt{w}) and E_t U_t = \theta \sqrt{w c''(\theta)} (1+o(1)). Thus

Thus, just like the MA chart, as w\rightarrow \infty,

It behaves like a two-sided random walk with drift

and variance

The theorem is proved by using the above approximations.

The evaluation of FDP will be carried by directly assuming W_t^* follows chi-square distribution with p degrees of freedom. Define a changed measure P_t^*(.) on X_{t-w+1},..., X_t such that under P_t^*(.) the log-likelihood ratio of X_1,..., X_t under P_t^*(.) with respect to P_0^*(.) is equal to

The value of \theta^* is taken such that

This gives \theta^*= \frac{1}{2} (1-\frac{p}{b^2}). Now let \tilde{l}_t =\theta^* (W_t^* -b^2). So \tilde{l}_t has approximately mean zero and variance 2p \theta^{*2}/(1-2\theta^*)^2.

By assuming w\rightarrow \infty and b\rightarrow \infty, we can have the following approximation for FDP

where the last equation is obtained by using Sterling’s formula when p is relatively large and M_t =\max_{1\leq s\leq L} (l_s-l_t) and S_t =\sum_{1\leq s \leq L} (l_s-l_t). Similar approximation is also obtained in Wu and Siegmund (2022) for the multi-dimensional data stream case.

In the following, we just need to show that l_s-l_t is approximately a local random walk. For simplicity, we only verify it in the exponential family case by assuming that X_{t-w+1}, ...., X_t follow f_{\theta}(x) =\exp(\theta t(x) -c(\theta)). By ignoring the lower order terms, we have

Similar expansion is true for s=t \pm O(\sqrt{w}) under P_t^*(.). Thus, at the first order, \theta should be chosen such that

Now it is easy to see that l_s-l_t = \theta^*(W_s^*-W_t^*) behaves like a two sided random walk with drift -\theta^*|t-s| (\theta -\theta_0)(c'(\theta)-c'(\theta_0)) and variance \theta^{*2} |t-s| (\theta-\theta_0) ( c''(\theta) +c''(\theta_0))(\theta -\theta_0)^T. Therefore

The result is obtained by combining the above results. When b^2/w is small, \theta -\theta_0 is also small. The approximation can be simplified to

where \rho_+ is calculated as \rho_+ =E_{\theta_0}S_{\tau_+}^2/(2E_{\theta_0}S_{\tau_+}) from the ladder time defined by

where X_i follows f_{\theta_0}(.) and X_i' is independent copy of X_i and \gamma =\lim_{\theta \rightarrow \theta_0} (\theta-\theta_0)/((\theta -\theta_0)c''(\theta_0)(\theta -\theta_0)^T)^{1/2} is the direction.