Semiparametric Efficiency of Residual Correlation Testing under Gaussian Additive Noise Models

Yin Tang, Yanyuan Ma and Bing Li

arXiv: 2606.01011v2 · PDF · 19 August 2026
Categories: math.ST, stat.ME, stat.TH
Licence: CC BY 4.0 The site shows the text.

Abstract

This paper studies conditional independence testing under the Gaussian additive noise model (GANM), where two variables are modeled as nonlinear functions of covariates with independent bivariate Gaussian regression errors. Under this framework, conditional independence can be characterized by the correlation coefficient of the regression errors, which motivates a test based on the Pearson correlation coefficient computed from the fitted residuals. Despite its simple form, the asymptotic behavior and statistical efficiency of the resulting test have not been well understood. In this paper, we develop the semiparametric efficiency theory under GANM and show, surprisingly, that the efficient estimator coincides exactly with the ordinary residual Pearson correlation estimator. We further establish the asymptotic properties of the proposed test and develop the corresponding inference procedure. Simulation studies demonstrate that the proposed method achieves near-oracle efficiency and competitive empirical power while maintaining valid Type I error control. We further apply the proposed test to conditional dependence analysis of U.S. stock returns.

Items 10

Proposition

Proposition 1

TM7L

Under model (?) with parameter of interest \rho and nuisance parameters \eta=\{\sigma_x,\sigma_y,m_x(\cdot),m_y(\cdot),f_{\bf Z}(\cdot)\}, let \Lambda_j, j=1,\dots,5, denote the nuisance tangent space associated with the corresponding nuisance parameter component:

\begin{aligned} \Lambda_1:\sigma_x,\qquad \Lambda_2:\sigma_y,\qquad \Lambda_3:m_x,\qquad \Lambda_4:m_y,\qquad \Lambda_5:f_Z. \end{aligned}

Then the nuisance tangent space of model (?) is

\begin{aligned} \Lambda=\Lambda_1+\Lambda_2+\Lambda_3+\Lambda_4+\Lambda_5, \end{aligned}

where

\begin{aligned} \Lambda_1 &= \left\{c_1\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\right\},\\ \Lambda_2 &= \left\{c_2\left(-\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right)\right\},\\ \Lambda_3 &= \left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf z})\right\},\\ \Lambda_4 &= \left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)B_2({\bf z})\right\},\\ \Lambda_5 &= \{a({\bf z}):E(a)=0\}. \end{aligned}

Proof (Proof of Proposition 1) of Proposition 1

Note that

\begin{aligned} S_{\sigma_x}(x,y,{\bf z})=-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}. \end{aligned}

Thus, the nuisance tangent space for \sigma_x is

\begin{aligned} \Lambda_1=\{c_1S_{\sigma_x}(x,y,{\bf z})\}=\left\{c_1\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\right\}. \end{aligned}

Similarly, the nuisance tangent space for \sigma_y is

\begin{aligned} S_{\sigma_y}(x,y,{\bf z})=-\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}. \end{aligned}

And

\begin{aligned} \Lambda_2=\{c_2S_{\sigma_y}(x,y,{\bf z})\}=\left\{c_2\left(-\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right)\right\}. \end{aligned}

Then, let \Lambda_3 be the nuisance tangent space for m_x. Take m_x({\bf z})=m_0({\bf z})+\gamma_xB_1({\bf z}) as a parametric submodel of m_x({\bf z}). Thus,

\begin{aligned} S_{\gamma_x}|_{\gamma_x=0} &=-\frac{1}{2(1-\rho^2)}\left[\frac{2\epsilon_x\{-B_1({\bf z})\}}{\sigma_x^2}-2\rho\frac{\epsilon_y\{-B_1({\bf z})\}}{\sigma_x\sigma_y}\right]\\ &=\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf z}). \end{aligned}

Denote

\begin{aligned} A=\left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf z})\right\}. \end{aligned}

Note that m_x({\bf z})=m_0({\bf z})+\gamma_xB_1({\bf z}) is a parametric submodel of m_x({\bf z}), so A\subset \Lambda_3. On the other hand, for any parametric submodel m_x({\bf z},\gamma) with \gamma=\gamma_0 leading to the truth, we have

\begin{aligned} \frac{\partial \mbox{log} f}{\partial \gamma}\Big|_{\gamma=\gamma_0} &= -\frac{1}{2(1-\rho^2)}\left[\frac{2\epsilon_x}{\sigma_x^2}\left\{-\frac{\partial m_x({\bf z},\gamma)}{\partial\gamma}\Big|_{\gamma=\gamma_0}\right\}-2\rho \frac{\epsilon_y}{\sigma_x\sigma_y}\left\{-\frac{\partial m_x({\bf z},\gamma)}{\partial\gamma}\Big|_{\gamma=\gamma_0}\right\}\right]\\ &= \frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho \frac{\epsilon_y}{\sigma_x\sigma_y}\right)\left\{\frac{\partial m_x({\bf z},\gamma)}{\partial\gamma}\Big|_{\gamma=\gamma_0}\right\} \in A, \end{aligned}

so \Lambda_3\subset A. Since both \Lambda_3 and A are closed, we have \Lambda_3=A, i.e.,

\begin{aligned} \Lambda_3=\left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf z})\right\}. \end{aligned}

Similarly, the nuisance tangent space for m_y is

\begin{aligned} \Lambda_4=\left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)B_2({\bf z})\right\}. \end{aligned}

Obviously, the nuisance tangent space for f_{\bf Z} is

\begin{aligned} \Lambda_5=\{a({\bf z}):E(a)=0\}. \end{aligned}

Summarizing the above results gives

\begin{aligned} \Lambda = \Lambda_1+ \Lambda_2+ \Lambda_3+ \Lambda_4+ \Lambda_5. \end{aligned}

Proposition

Proposition 2

SDB3

Let \Lambda^\perp denote the orthogonal complement of the nuisance tangent space \Lambda in {\cal H}, where \Lambda is given in Proposition 1. Then

\begin{aligned} \Lambda^\perp &= \left\{b(x,y,{\bf z}): E\left\{\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)b(X,Y,{\bf Z})\right\}=0,E\left\{\left(\widetilde\epsilon_y^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)b(X,Y,{\bf Z})\right\}=0,\right.\\ && \left.E\left\{\widetilde\epsilon_x b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0, E\left\{\widetilde\epsilon_y b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0,E\left\{b(X,Y,{\bf Z})|{\bf Z}\right\}=0\right\}, \end{aligned}

where \widetilde\epsilon_x=\epsilon_x/\sigma_x and \widetilde\epsilon_y=\epsilon_y/\sigma_y.

Proof (Proof of Proposition 2) of Proposition 2

We then check the orthogonality of the five spaces above. For any B_1({\bf z}), we have

\begin{aligned} &&E\left\{\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf Z})\right\}\\ &=E\left\{\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\frac{\epsilon_y}{\sigma_x\sigma_y}\right)\right\}E\left\{B_1({\bf Z})\right\}\\ &= 0, \end{aligned}

since this only includes the first and third moments of a multivariate normal distribution. Thus, \Lambda_1\perp\Lambda_3. Similarly, \Lambda_1\perp\Lambda_4, \Lambda_2\perp\Lambda_3, \Lambda_2\perp\Lambda_4.

For a({\bf z})\in\Lambda_5, we have

\begin{aligned} &&E\left\{\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)a({\bf Z})\right\}\\ &=E\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)E\left\{a({\bf Z})\right\}\\ &= 0. \end{aligned}

Thus, \Lambda_1\perp\Lambda_5. Similarly, \Lambda_2\perp\Lambda_5.

For a({\bf z})\in\Lambda_5 and any B_1({\bf z}),

\begin{aligned} E\left[\frac{1}{1-\rho^2}\left\{\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right\}B_1({\bf Z})a({\bf Z})\right] =\frac{1}{1-\rho^2}E\left\{\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right\}E\left[B_1({\bf Z})a({\bf Z})\right] = 0. \end{aligned}

Thus, \Lambda_3\perp\Lambda_5. Similarly, \Lambda_4\perp\Lambda_5.

However,

\begin{aligned} &&E(S_{\sigma_y}S_{\sigma_x})\\ &=E\left\{\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\left(-\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right)\right\}\\ &= \frac{1}{\sigma_x\sigma_y}\left\{1-\frac{1}{1-\rho^2}+\frac{\rho^2}{1-\rho^2}-\frac{1}{1-\rho^2}+\frac{1+2\rho^2}{(1-\rho^2)^2}-\frac{3\rho^2}{(1-\rho^2)^2}+\frac{\rho^2}{1-\rho^2} \right. \\ && \left. \qquad \quad -\frac{3\rho^2}{(1-\rho^2)^2}+\frac{\rho^2(1+2\rho^2)}{(1-\rho^2)^2}\right\}\\ &=-\frac{1}{\sigma_x\sigma_y} \frac{\rho^2}{1-\rho^2} \\ &\neq& 0, \end{aligned}

so \Lambda_1\not\perp\Lambda_2. Also,

\begin{aligned} &&E\left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf Z})\frac{1}{1-\rho^2}\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)B_2({\bf Z})\right\}\\ &=\frac{1}{(1-\rho^2)^2}E\left\{\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)\right\}E\left\{B_1({\bf Z})B_2({\bf Z})\right\}\\ &=\frac{1}{(1-\rho^2)^2}\frac{1}{\sigma_x\sigma_y}\left(\rho-\rho-\rho+\rho^3\right)E\left\{B_1({\bf Z})B_2({\bf Z})\right\}\\ &=-\frac{\rho}{1-\rho^2}\frac{1}{\sigma_x\sigma_y}E\left\{B_1({\bf Z})B_2({\bf Z})\right\}\\ &\neq& 0, \end{aligned}

so \Lambda_3\not\perp\Lambda_4.

We now do orthogonalization on the above two pairs. First, we find c such that

\begin{aligned} E\left\{(S_{\sigma_y}-cS_{\sigma_x})S_{\sigma_x}\right\}=0. \end{aligned}

Notice that

\begin{aligned} E\left(S_{\sigma_x}^2\right) &=E\left\{\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)^2\right\}\\ &=\frac{1}{\sigma_x^2}\left\{1+\frac{3}{(1-\rho^2)^2}+\frac{\rho^2(1+2\rho^2)}{(1-\rho^2)^2}-\frac{2}{1-\rho^2}+\frac{2\rho^2}{1-\rho^2}-\frac{6\rho^2}{(1-\rho^2)^2}\right\}\\ &=\frac{1}{\sigma_x^2}\frac{2-\rho^2}{1-\rho^2}. \end{aligned}

Therefore,

\begin{aligned} c=\frac{E(S_{\sigma_y}S_{\sigma_x})}{E(S_{\sigma_x}^2)}=\frac{-\frac{1}{\sigma_x\sigma_y} \frac{\rho^2}{1-\rho^2}}{\frac{1}{\sigma_x^2}\frac{2-\rho^2}{1-\rho^2}}=-\frac{\sigma_x}{\sigma_y}\frac{\rho^2}{2-\rho^2}. \end{aligned}

We set

\begin{aligned} \widetilde\Lambda_2 &=\left\{c_2\left(-\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right) \right. \\ && \left. \quad +c_2\frac{\sigma_x}{\sigma_y}\frac{\rho^2}{2-\rho^2}\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\right\}\\ &=\left\{c_2\left\{-\frac{2}{2-\rho^2}\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}+\frac{\rho^2}{(1-\rho^2)(2-\rho^2)}\frac{\epsilon_x^2}{\sigma_x^2\sigma_y}-\frac{2\rho}{(1-\rho^2)(2-\rho^2)}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right\}\right\}. \end{aligned}

Then, for an arbitrary B_2({\bf z}), we want to find B({\bf z}) such that

\begin{aligned} E\left[\left\{\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)B_2({\bf Z})-\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B({\bf Z})\right\}\left\{\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf Z})\right\}\right]=0 \end{aligned}

for all B_1({\bf z}). Since

\begin{aligned} &&E\left[\left\{\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)B_2({\bf Z})-\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B({\bf Z})\right\}\left\{\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf Z})\right\}\right]\\ &=E\left[\left\{\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)\right\}B_2({\bf Z})B_1({\bf Z})-\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)^2B({\bf Z})B_1({\bf Z})\right]\\ &= E\left\{\frac{1}{\sigma_x\sigma_y}(\rho-\rho-\rho+\rho^3)B_2({\bf Z})B_1({\bf Z})-\frac{1}{\sigma_x^2}(1+\rho^2-2\rho^2)B({\bf Z})B_1({\bf Z})\right\}\\ &= E\left[\left\{\frac{1}{\sigma_x\sigma_y}(\rho^3-\rho)B_2({\bf Z})-\frac{1}{\sigma_x^2}(1-\rho^2)B({\bf Z})\right\}B_1({\bf Z})\right], \end{aligned}

then we take

\begin{aligned} B({\bf z})=-\frac{\sigma_x}{\sigma_y}\rho B_2({\bf z}). \end{aligned}

We set

\begin{aligned} \widetilde\Lambda_4 &= \left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_y}{\sigma_y^2}-\rho\frac{\epsilon_x}{\sigma_x\sigma_y}\right)B_2({\bf z})+\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)\frac{\sigma_x}{\sigma_y}\rho B_2({\bf z})\right\}\\ &= \left\{\frac{\epsilon_y}{\sigma_y^2} B_2({\bf z})\right\}. \end{aligned}

Therefore,

\begin{aligned} \Lambda=\Lambda_1\oplus\widetilde\Lambda_2\oplus\Lambda_3\oplus\widetilde\Lambda_4\oplus\Lambda_5, \end{aligned}

where

\begin{aligned} \Lambda_1 &= \left\{c_1\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)\right\},\\ \widetilde\Lambda_2 &= \left\{c_2\left\{-\frac{2}{2-\rho^2}\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}+\frac{\rho^2}{(1-\rho^2)(2-\rho^2)}\frac{\epsilon_x^2}{\sigma_x^2\sigma_y}-\frac{2\rho}{(1-\rho^2)(2-\rho^2)}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right\}\right\},\\ \Lambda_3 &= \left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf z})\right\},\\ \widetilde\Lambda_4 &= \left\{\frac{\epsilon_y}{\sigma_y^2} B_2({\bf z})\right\},\\ \Lambda_5 &= \{a({\bf z}):E(a)=0\}. \end{aligned}

By (?), we know that

\begin{aligned} \Lambda^\perp = \Lambda_1^\perp\cap\widetilde\Lambda_2^\perp\cap\Lambda_3^\perp\cap\widetilde\Lambda_4^\perp\cap\Lambda_5^\perp. \end{aligned}

Denote \widetilde\epsilon_x=\epsilon_x/\sigma_x and \widetilde\epsilon_y=\epsilon_y/\sigma_y. Then,

\begin{aligned} \Lambda_1^\perp &= \left\{b(x,y,{\bf z}):E\left\{\left(-\frac{1}{\sigma_x}+\frac{1}{1-\rho^2}\frac{\epsilon_x^2}{\sigma_x^3}-\frac{\rho}{1-\rho^2}\frac{\epsilon_x\epsilon_y}{\sigma_x^2\sigma_y}\right)b(X,Y,{\bf Z})\right\}=0\right\}\\ &= \left\{b(x,y,{\bf z}):E\left[\left\{-(1-\rho^2)+\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right\}b(X,Y,{\bf Z})\right]=0\right\}, \end{aligned}

and

\begin{aligned} \widetilde\Lambda_2^\perp &= \left\{b(x,y,{\bf z}):E\left[\left\{-\frac{2}{2-\rho^2}\frac{1}{\sigma_y}+\frac{1}{1-\rho^2}\frac{\epsilon_y^2}{\sigma_y^3}+\frac{\rho^2}{(1-\rho^2)(2-\rho^2)}\frac{\epsilon_x^2}{\sigma_x^2\sigma_y}\right.\right.\right.\\ &&\qquad\qquad\qquad\qquad\left.\left.\left.-\frac{2\rho}{(1-\rho^2)(2-\rho^2)}\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y^2}\right\}b(X,Y,{\bf Z})\right]=0\right\}\\ &= \left\{b(x,y,{\bf z}):E\left[\left\{-2(1-\rho^2)+(2-\rho^2)\widetilde\epsilon_y^2+\rho^2\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y\right\}b(X,Y,{\bf Z})\right]=0\right\}. \end{aligned}

Also,

\begin{aligned} \Lambda_3^\perp &= \left\{b(x,y,{\bf z}):E\left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)B_1({\bf Z})b(X,Y,{\bf Z})\right\}=0,\ \forall B_1({\bf z})\right\}\\ &= \left\{b(x,y,{\bf z}):E\left\{\frac{1}{1-\rho^2}\left(\frac{\epsilon_x}{\sigma_x^2}-\rho\frac{\epsilon_y}{\sigma_x\sigma_y}\right)b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0\right\}\\ &= \left\{b(x,y,{\bf z}):E\left\{\left(\widetilde\epsilon_x-\rho\widetilde\epsilon_y\right)b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0\right\} \end{aligned}

and

\begin{aligned} \widetilde\Lambda_4^\perp &= \left\{b(x,y,{\bf z}):E\left\{\frac{\epsilon_y}{\sigma_y^2} B_2(Z)b(X,Y,{\bf Z})\right\}=0,\ \forall B_2({\bf z})\right\}\\ &= \left\{b(x,y,{\bf z}):E\left\{\widetilde\epsilon_y b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0\right\}. \end{aligned}

Also obviously,

\begin{aligned} \Lambda_5^\perp=\left\{b(x,y,{\bf z}):E\left\{b(X,Y,{\bf Z})|{\bf Z}\right\}=0\right\}. \end{aligned}

Therefore,

\begin{aligned} \Lambda^\perp &= \left\{b(x,y,{\bf z}): E\left[\left\{-(1-\rho^2)+\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right\}b(X,Y,{\bf Z})\right]=0,\right.\\ && \left.E\left[\left\{-2(1-\rho^2)+(2-\rho^2)\widetilde\epsilon_y^2+\rho^2\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y\right\}b(X,Y,{\bf Z})\right]=0,\right.\\ && \left.E\left\{\left(\widetilde\epsilon_x-\rho\widetilde\epsilon_y\right)b(X,Y,{\bf Z})\Big|Z\right\}=0, E\left\{\widetilde\epsilon_y b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0,E\left\{b(X,Y,{\bf Z})|{\bf Z}\right\}=0\right\}\\ &= \left\{b(x,y,{\bf z}): E\left\{\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)b(X,Y,{\bf Z})\right\}=0,E\left\{\left(\widetilde\epsilon_y^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)b(X,Y,{\bf Z})\right\}=0,\right.\\ && \left.E\left\{\widetilde\epsilon_x b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0, E\left\{\widetilde\epsilon_y b(X,Y,{\bf Z})\Big|{\bf Z}\right\}=0,E\left\{b(X,Y,{\bf Z})|{\bf Z}\right\}=0\right\}. \end{aligned}

Proposition

Proposition 3

CIO2

Under model (?), the efficient score for \rho is

\begin{aligned} S_{\rm eff} = -\frac{1}{2(1-\rho^2)^2}\left(\rho\widetilde\epsilon_x^2-2\widetilde\epsilon_x\widetilde\epsilon_y+\rho\widetilde\epsilon_y^2\right). \end{aligned}

Furthermore, the semiparametric efficiency bound for estimating \rho is

\begin{aligned} E(S_{\rm eff}^2)^{-1} = (1-\rho^2)^2, \end{aligned}

and the efficient influence function for \rho is

\begin{aligned} \phi_{\rm eff}(x,y,{\bf z})=-\frac{1}{2}\left(\rho\widetilde\epsilon_x^2-2\widetilde\epsilon_x\widetilde\epsilon_y+\rho\widetilde\epsilon_y^2\right). \end{aligned}

Used by Theorem 1, Proof

Proof (Proof of Proposition 3) of Proposition 3

Note that

\begin{aligned} S_\rho &= -\frac{1}{2}\frac{-2\rho}{1-\rho^2}+\frac{-2\rho}{2(1-\rho^2)^2}\left(\frac{\epsilon_x^2}{\sigma_x^2}-2\rho\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y}+\frac{\epsilon_y^2}{\sigma_y^2}\right)-\frac{1}{2(1-\rho^2)}\left(-2\frac{\epsilon_x\epsilon_y}{\sigma_x\sigma_y}\right)\\ &= \frac{\rho}{1-\rho^2}-\frac{\rho}{(1-\rho^2)^2}\left(\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x\widetilde\epsilon_y. \end{aligned}

Thus,

\begin{aligned} E\left(S_\rho | {\bf Z}\right) &= E\left\{\frac{\rho}{1-\rho^2}-\frac{\rho}{(1-\rho^2)^2}\left(\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x\widetilde\epsilon_y\right\}\\ &= \frac{\rho}{1-\rho^2}-\frac{\rho}{(1-\rho^2)^2}\left(1-2\rho^2+1\right)+\frac{1}{1-\rho^2}\rho\\ &= \frac{\rho}{1-\rho^2}-\frac{2\rho}{1-\rho^2}+\frac{1}{1-\rho^2}\rho\\ &= 0. \end{aligned}

Also,

\begin{aligned} E\left(\widetilde\epsilon_x S_\rho|{\bf Z}\right) = E\left\{\frac{\rho}{1-\rho^2}\widetilde\epsilon_x -\frac{\rho}{(1-\rho^2)^2}\left(\widetilde\epsilon_x^3-2\rho\widetilde\epsilon_x^2\widetilde\epsilon_y+\widetilde\epsilon_x \widetilde\epsilon_y^2\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x^2\widetilde\epsilon_y\right\} = 0 \end{aligned}

since it only uses the first and third moments of \epsilon_x and \epsilon_y. Similarly,

\begin{aligned} E\left(\widetilde\epsilon_y S_\rho|{\bf Z}\right) = E\left\{\frac{\rho}{1-\rho^2}\widetilde\epsilon_y -\frac{\rho}{(1-\rho^2)^2}\left(\widetilde\epsilon_x^2\widetilde\epsilon_y-2\rho\widetilde\epsilon_x\widetilde\epsilon_y^2+\widetilde\epsilon_y^3\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x\widetilde\epsilon_y^2\right\} = 0. \end{aligned}

Then,

\begin{aligned} &&E\left\{\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)S_\rho\right\}\\ &= E\left[\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right) \left\{\frac{\rho}{1-\rho^2}-\frac{\rho}{(1-\rho^2)^2}\left(\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x\widetilde\epsilon_y\right\}\right]\\ &= \frac{\rho}{1-\rho^2}\left(1-\rho^2\right)-\frac{\rho}{(1-\rho^2)^2}\left\{3-6\rho^2+1+2\rho^2-3\rho^2+2\rho^2(1+2\rho^2)-3\rho^2\right\}\\ &&+\frac{1}{1-\rho^2}\left\{3\rho-\rho(1+2\rho^2)\right\}\\ &= \rho-\frac{\rho}{(1-\rho^2)^2}\left(4-8\rho^2+4\rho^4\right)+2\rho\\ &= -\rho, \end{aligned}

and by symmetry,

\begin{aligned} E\left\{\left(\widetilde\epsilon_y^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)S_\rho\right\}= -\rho. \end{aligned}

Let

\begin{aligned} \widetilde S_\rho = S_\rho + \rho \frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2} \end{aligned}

Note that

\begin{aligned} E\left\{\frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\Big|{\bf Z}\right\} = \frac{1-2\rho^2+1-2(1-\rho^2)}{2(1-\rho^2)^2} = 0, \end{aligned}

and

\begin{aligned} E\left\{\widetilde\epsilon_x\frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\Big|{\bf Z}\right\}=E\left\{\widetilde\epsilon_y\frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\Big|{\bf Z}\right\}=0 \end{aligned}

since they both only use the first and third moments of a multivariate normal distribution. Thus, we have

\begin{aligned} E(\widetilde S_\rho|{\bf Z}) = E(\widetilde\epsilon_x\widetilde S_\rho|{\bf Z}) = E(\widetilde\epsilon_y\widetilde S_\rho|{\bf Z}) =0. \end{aligned}

Furthermore,

\begin{aligned} &&E\left[\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)\left\{\frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\right\}\right]\\ &=E\left[\frac{1}{2(1-\rho^2)^2}\left\{3-6\rho^2+1+2\rho^2-3\rho^2+2\rho^2(1+2\rho^2)-3\rho^2-2(1-\rho^2)^2\right\}\right]\\ &=E\left[\frac{1}{2(1-\rho^2)^2}\left\{4-8\rho^2+4\rho^4-2(1-\rho^2)^2\right\}\right]\\ &=E\left[\frac{1}{2(1-\rho^2)^2}\left\{4(1-\rho^2)^2-2(1-\rho^2)^2\right\}\right]\\ &= 1. \end{aligned}

Thus, we have

\begin{aligned} E\left\{\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)\widetilde S_\rho\right\}= -\rho + \rho =0. \end{aligned}

By symmetry,

\begin{aligned} E\left\{\left(\widetilde\epsilon_x^2-\rho\widetilde\epsilon_x\widetilde\epsilon_y\right)\widetilde S_\rho\right\}= -\rho + \rho =0. \end{aligned}

Therefore, \widetilde S_\rho\in\Lambda^\perp. Also, notice that

\begin{aligned} E\left\{\frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\right\} =\frac{1-2\rho^2+1-2(1-\rho^2)}{2(1-\rho^2)^2} = 0, \end{aligned}

\begin{aligned} \frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\in\Lambda_5\subset\Lambda. \end{aligned}

Therefore, \widetilde S_\rho = \Pi (S_\rho|\Lambda^\perp). Thus,

\begin{aligned} S_{\rm eff} = \widetilde S_\rho &= \frac{\rho}{1-\rho^2}-\frac{\rho}{(1-\rho^2)^2}\left(\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x\widetilde\epsilon_y \\ && + \rho \frac{\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2-2(1-\rho^2)}{2(1-\rho^2)^2}\\ &= -\frac{\rho}{2(1-\rho^2)^2}\left(\widetilde\epsilon_x^2-2\rho\widetilde\epsilon_x\widetilde\epsilon_y+\widetilde\epsilon_y^2\right)+\frac{1}{1-\rho^2}\widetilde\epsilon_x\widetilde\epsilon_y \\ &= -\frac{1}{2(1-\rho^2)^2}\left(\rho\widetilde\epsilon_x^2-2\widetilde\epsilon_x\widetilde\epsilon_y+\rho\widetilde\epsilon_y^2\right). \end{aligned}

Based on the form of S_{\rm eff}, we have

\begin{aligned} E(S_{\rm eff}^2) &= \frac{1}{4(1-\rho^2)^4} E\left\{\left(\rho\widetilde\epsilon_x^2-2\widetilde\epsilon_x\widetilde\epsilon_y+\rho\widetilde\epsilon_y^2\right)^2\right\}\\ &= \frac{1}{4(1-\rho^2)^4} \left\{3\rho^2 + 2\rho^2(1+2\rho^2) +3\rho^2 - 12\rho^2 +2\rho^2(1+2\rho^2) -12\rho^2\right\}\\ &= \frac{1}{4(1-\rho^2)^4} \left\{4-8\rho^2+4\rho^4\right\}\\ &= \frac{1}{4(1-\rho^2)^4} \left\{4(1-\rho^2)^2\right\}\\ &= \frac{1}{(1-\rho^2)^2}. \end{aligned}

Thus, the semiparametric efficiency bound is

\begin{aligned} E(S_{\rm eff}^2)^{-1}=(1-\rho^2)^2. \end{aligned}

The efficient influence function is

\begin{aligned} \phi_{\rm eff}(x,y,{\bf z})=[E(S_{\rm eff}^2)]^{-1}S_{\rm eff} =-\frac{1}{2}\left(\rho\widetilde\epsilon_x^2-2\widetilde\epsilon_x\widetilde\epsilon_y+\rho\widetilde\epsilon_y^2\right). \end{aligned}

Theorem

Theorem 1

ZLRM

Under model (?), suppose that the nonparametric regression estimators \widehat m_{xk} and \widehat m_{yk} satisfy the convergence rate assumption:

\begin{aligned} \|\widehat m_{xk} - m_x\|_2 = o_p(n_1^{-1/4}), \qquad \|\widehat m_{yk} - m_y\|_2 = o_p(n_1^{-1/4}), \qquad k=1,2, \end{aligned}

where \|\cdot\|_2 denotes the L_2(P_{\bf Z})-norm, where P_{\bf Z} denotes the marginal distribution of {\bf Z}. If n_1 = n_2 = n/2, we have

\begin{aligned} n^{1/2}(\widehat\rho - \rho) = n^{-1/2} \sum_{i=1}^n \phi_{\rm eff}(X_i,Y_i,{\bf Z}_i) + O_p(n^{-1/2}), \end{aligned}

where \phi_{\rm eff} is given by (3).

Uses Proposition 3

Proof (Proof of Theorem 1) of Theorem 1

By Taylor’s mean value theorem, we have

\begin{aligned} n_2^{1/2}(\widehat\rho_2 - \rho) &= n_2^{1/2} \frac{1}{\sigma_x\sigma_y}(\widehat\sigma_{xy2}-\sigma_{xy}) - n_2^{1/2} \frac{\sigma_{xy}}{2\sigma_x^3\sigma_y}(\widehat\sigma_{x2}^2-\sigma_x^2)\\ &&- n_2^{1/2} \frac{\sigma_{xy}}{2\sigma_x\sigma_y^3}(\widehat\sigma_{y2}^2-\sigma_y^2) + R, \end{aligned}

where

\begin{aligned} R&= - n_2^{1/2}\frac{1}{2\sigma_{x*}^3\sigma_{y*}}(\widehat\sigma_{xy2}-\sigma_{xy})(\widehat\sigma_{x2}^2-\sigma_x^2) - n_2^{1/2}\frac{1}{2\sigma_{x*}\sigma_{y*}^3}(\widehat\sigma_{xy2}-\sigma_{xy})(\widehat\sigma_{y2}^2-\sigma_y^2) \\ && + n_2^{1/2}\frac{\sigma_{xy*}}{4\sigma_{x*}^3\sigma_{y*}^3}(\widehat\sigma_{x2}^2-\sigma_x^2)(\widehat\sigma_{y2}^2-\sigma_y^2)\\ && - n_2^{1/2}\frac{3\sigma_{xy*}}{8\sigma_{x*}^5\sigma_{y*}}(\widehat\sigma_{x2}^2-\sigma_x^2)^2 - n_2^{1/2}\frac{3\sigma_{xy*}}{8\sigma_{x*}\sigma_{y*}^5}(\widehat\sigma_{y2}^2-\sigma_y^2)^2, \end{aligned}

for some \sigma_{x*}^2 between \sigma_x^2 and \widehat\sigma_{x2}^2, \sigma_{y*}^2 between \sigma_y^2 and \widehat\sigma_{y2}^2, and \sigma_{xy*} between \sigma_{xy} and \widehat\sigma_{xy2}.

We decompose \widehat \sigma_{x2}^2 into three parts as follows:

\begin{aligned} \widehat \sigma_{x2}^2 - \sigma_x^2 &= n_2^{-1} \sum_{i=n_1+1}^n\{X_i- \widehat m_{x1}({\bf Z}_i)\}^2 - \sigma_x^2 \\ &= n_2^{-1} \sum_{i=n_1+1}^n\{X_i- m_x({\bf Z}_i)\}^2 + n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}^2 \\ && + 2 n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\{X_i- m_x({\bf Z}_i)\} - \sigma_x^2\\ &= n_2^{-1} \sum_{i=n_1+1}^n \epsilon_{xi}^2 + n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}^2 \\ && + 2 n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\epsilon_{xi} - \sigma_x^2. \end{aligned}

Under \|\widehat m_{x1} - m_x\|_2 = o_p(n_1^{-1/4}), we have

\begin{aligned} E \left[ n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}^2 | \widehat m_{x1} \right] &= E \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}^2 | \widehat m_{x1} \right] \\ &= \|\widehat m_{x1} - m_x\|_2^2 \\ &= o_p(n_1^{-1/2}), \end{aligned}

and since the sum is nonnegative, by Markov’s inequality, we have

\begin{aligned} n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}^2 = o_p(n_1^{-1/2}). \end{aligned}

Also, note that

\begin{aligned} n_2^{-1} \sum_{i=n_1+1}^n \epsilon_{xi}^2 = \sigma_x^2 + o_p(1). \end{aligned}

Furthermore,

\begin{aligned} E \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}\epsilon_x | \widehat m_{x1} \right] = E \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\} | \widehat m_{x1} \right] E(\epsilon_x) = 0, \end{aligned}

and under \|\widehat m_{x1} - m_x\|_2 = o_p(n_1^{-1/4}),

\begin{aligned} && \mbox{var} \left[ n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\epsilon_{xi} | \widehat m_{x1} \right]\\ &= n_2^{-1} \mbox{var} \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}\epsilon_x | \widehat m_{x1} \right]\\ &= n_2^{-1} E \left[\{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}^2\epsilon_x^2 | \widehat m_{x1} \right]\\ &= n_2^{-1} E \left[\{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}^2 | \widehat m_{x1} \right] E(\epsilon_x^2)\\ &= n_2^{-1} \|\widehat m_{x1} - m_x\|_2^2 \sigma_x^2\\ &= o_p(n_2^{-1}n_1^{-1/2}), \end{aligned}

so by Chebyshev’s inequality, we have

\begin{aligned} n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\epsilon_{xi} = o_p(n_2^{-1/2}n_1^{-1/4}). \end{aligned}

Plugging back to (?), we have

\begin{aligned} \widehat \sigma_{x2}^2 - \sigma_x^2 = n_2^{-1} \sum_{i=n_1+1}^n \epsilon_{xi}^2 - \sigma_x^2 + o_p(n_1^{-1/2} + n_2^{-1/2}n_1^{-1/4}). \end{aligned}

Same arguments lead to, under \|\widehat m_{y1} - m_y\|_2 = o_p(n_1^{-1/4}),

\begin{aligned} \widehat \sigma_{y2}^2 - \sigma_y^2 = n_2^{-1} \sum_{i=n_1+1}^n \epsilon_{yi}^2 - \sigma_y^2 + o_p(n_1^{-1/2} + n_2^{-1/2}n_1^{-1/4}). \end{aligned}

We also decompose \widehat \sigma_{xy} into three parts as follows:

\begin{aligned} \widehat \sigma_{xy2} - \sigma_{xy} &= n_2^{-1} \sum_{i=n_1+1}^n\{X_i- \widehat m_{x1}({\bf Z}_i)\}\{Y_i- \widehat m_{y1}({\bf Z}_i)\} - \sigma_{xy} \\ &= n_2^{-1} \sum_{i=n_1+1}^n\{X_i- m_x({\bf Z}_i)\}\{Y_i- m_y({\bf Z}_i)\} \\ && + n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\} \\ && + n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\{Y_i- m_y({\bf Z}_i)\} \\ && + n_2^{-1} \sum_{i=n_1+1}^n\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\}\{X_i- m_x({\bf Z}_i)\} - \sigma_{xy} \\ &= n_2^{-1} \sum_{i=n_1+1}^n \epsilon_{xi} \epsilon_{yi} + n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\} \\ && + n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\epsilon_{yi} + n_2^{-1} \sum_{i=n_1+1}^n\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\}\epsilon_{xi} \\ && - \sigma_{xy}. \end{aligned}

Under \|\widehat m_{x1} - m_x\|_2 = o_p(n_1^{-1/4}) and \|\widehat m_{y1} - m_y\|_2 = o_p(n_1^{-1/4}), we have

\begin{aligned} && E \left[ \left| n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\} \right| | \widehat m_{x1}, \widehat m_{y1} \right] \\ &\le& E \left[ \left|m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\right| \left|m_y({\bf Z}) - \widehat m_{y1}({\bf Z}) \right|| \widehat m_{x1}, \widehat m_{y1} \right] \\ &= \left\langle \left| \widehat m_{x1} - m_x\right|, \left|\widehat m_{y1} - m_y\right| \right\rangle_2 \\ &\le& \|\widehat m_{x1} - m_x\|_2 \|\widehat m_{y1} - m_y\|_2 \\ &= o_p(n_1^{-1/4}) o_p(n_1^{-1/4}) \\ &= o_p(n_1^{-1/2}). \end{aligned}

By Markov’s inequality, we have

\begin{aligned} n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\} = o_p(n_1^{-1/2}). \end{aligned}

Furthermore,

\begin{aligned} E \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}\epsilon_y | \widehat m_{x1} \right] = E \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\} | \widehat m_{x1} \right] E(\epsilon_y) = 0, \end{aligned}

and under \|\widehat m_{x1} - m_x\|_2 = o_p(n_1^{-1/4}),

\begin{aligned} && \mbox{var} \left[ n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\epsilon_{yi} | \widehat m_{x1} \right]\\ &= n_2^{-1} \mbox{var} \left[ \{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}\epsilon_y | \widehat m_{x1} \right]\\ &= n_2^{-1} E \left[\{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}^2\epsilon_y^2 | \widehat m_{x1} \right]\\ &= n_2^{-1} E \left[\{m_x({\bf Z}) - \widehat m_{x1}({\bf Z})\}^2 | \widehat m_{x1} \right] E(\epsilon_y^2)\\ &= n_2^{-1} \|\widehat m_{x1} - m_x\|_2^2 \sigma_y^2\\ &= o_p(n_2^{-1}n_1^{-1/2}), \end{aligned}

so by Chebyshev’s inequality, we have

\begin{aligned} n_2^{-1} \sum_{i=n_1+1}^n\{m_x({\bf Z}_i) - \widehat m_{x1}({\bf Z}_i)\}\epsilon_{yi} = o_p(n_2^{-1/2}n_1^{-1/4}). \end{aligned}

Same arguments lead to, under \|\widehat m_{y1} - m_y\|_2 = o_p(n_1^{-1/4}),

\begin{aligned} n_2^{-1} \sum_{i=n_1+1}^n\{m_y({\bf Z}_i) - \widehat m_{y1}({\bf Z}_i)\}\epsilon_{xi} = o_p(n_2^{-1/2}n_1^{-1/4}). \end{aligned}

Plugging back to (?), we have

\begin{aligned} \widehat \sigma_{xy2} - \sigma_{xy} = n_2^{-1} \sum_{i=n_1+1}^n \epsilon_{xi}\epsilon_{yi} - \sigma_{xy} + o_p(n_1^{-1/2} + n_2^{-1/2}n_1^{-1/4}). \end{aligned}

Applying central limit theorem and Slutsky’s theorem to (?), (?) and (?), if n_1 \asymp n_2 \asymp n, we have

\begin{aligned} \widehat \sigma_{x2}^2 - \sigma_x^2 = O_p(n^{-1/2}), \quad \widehat \sigma_{y2}^2 - \sigma_y^2 = O_p(n^{-1/2}), \quad \widehat \sigma_{xy2} - \sigma_{xy} = O_p(n^{-1/2}), \end{aligned}

and thus,

\begin{aligned} \widehat \sigma_{x*}^2 - \sigma_x^2 = o_p(1), \quad \widehat \sigma_{y*}^2 - \sigma_y^2 = o_p(1), \quad \widehat \sigma_{xy*} - \sigma_{xy} = o_p(1). \end{aligned}

Plugging back to (Proof), when n_1 \asymp n_2 \asymp n, we have

\begin{aligned} R &= - n_2^{1/2}\left\{\frac{1}{2\sigma_x^3\sigma_y}+o_p(1)\right\}O_p(n^{-1/2})O_p(n^{-1/2})\\ &&- n_2^{1/2}\left\{\frac{1}{2\sigma_x\sigma_y^3}+o_p(1)\right\}O_p(n^{-1/2})O_p(n^{-1/2}) \\ && + n_2^{1/2}\left\{\frac{\sigma_{xy}}{4\sigma_x^3\sigma_y^3}+o_p(1)\right\}O_p(n^{-1/2})O_p(n^{-1/2})\\ && - n_2^{1/2}\left\{\frac{3\sigma_{xy}}{8\sigma_x^5\sigma_y}+o_p(1)\right\}O_p(n^{-1/2})^2 - n_2^{1/2}\left\{\frac{3\sigma_{xy}}{8\sigma_x\sigma_y^5}+o_p(1)\right\}O_p(n^{-1/2})^2\\ &= O_p(n^{-1/2}). \end{aligned}

Also, when n_1 \asymp n_2 \asymp n, the remainder terms in (?), (?) and (?) all become o_p(n^{-1/2}). Therefore, plugging back into (Proof), we have

\begin{aligned} && n_2^{1/2}(\widehat\rho_2 - \rho) \\ &= \frac{1}{\sigma_x\sigma_y}n_2^{-1/2} \sum_{i=n_1+1}^n (\epsilon_{xi}\epsilon_{yi} - \sigma_{xy}) - \frac{\sigma_{xy}}{2\sigma_x^3\sigma_y}n_2^{-1/2} \sum_{i=n_1+1}^n (\epsilon_{xi}^2 - \sigma_x^2)\\ &&- \frac{\sigma_{xy}}{2\sigma_x\sigma_y^3}n_2^{-1/2} \sum_{i=n_1+1}^n (\epsilon_{yi}^2 - \sigma_y^2) + O_p(n^{-1/2})\\ &= n_2^{-1/2} \sum_{i=n_1+1}^n \left(\frac{\epsilon_{xi}\epsilon_{yi}}{\sigma_x\sigma_y} - \frac{\sigma_{xy}}{\sigma_x\sigma_y} - \frac{\sigma_{xy}\epsilon_{xi}^2}{2\sigma_x^3\sigma_y} + \frac{\sigma_{xy}}{2\sigma_x\sigma_y} - \frac{\sigma_{xy}\epsilon_{yi}^2}{2\sigma_x\sigma_y^3} + \frac{\sigma_{xy}}{2\sigma_x\sigma_y}\right) + O_p(n^{-1/2})\\ &= n_2^{-1/2} \sum_{i=n_1+1}^n \left(\widetilde\epsilon_{xi}\widetilde\epsilon_{yi} - \frac{\rho}{2}\widetilde\epsilon_{xi}^2 - \frac{\rho}{2}\widetilde\epsilon_{yi}^2 \right) + O_p(n^{-1/2})\\ &= n_2^{-1/2} \sum_{i=n_1+1}^n -\frac{1}{2}\left(\rho\widetilde\epsilon_{xi}^2-2\widetilde\epsilon_{xi}\widetilde\epsilon_{yi}+\rho\widetilde\epsilon_{yi}^2\right) + O_p(n^{-1/2}). \end{aligned}

Comparing with (3), we have

\begin{aligned} n_2^{1/2}(\widehat\rho_2 - \rho) = n_2^{-1/2} \sum_{i=n_1+1}^n \phi_{\rm eff}(X_i,Y_i,{\bf Z}_i) + O_p(n^{-1/2}). \end{aligned}

Similarly, under \|\widehat m_{x2} - m_x\|_2 = o_p(n_2^{-1/4}) and \|\widehat m_{y2} - m_y\|_2 = o_p(n_2^{-1/4}) with n_1 \asymp n_2 \asymp n, we also have

\begin{aligned} n_1^{1/2}(\widehat\rho_1 - \rho) = n_1^{-1/2} \sum_{i=1}^{n_1} \phi_{\rm eff}(X_i,Y_i,{\bf Z}_i) + O_p(n^{-1/2}). \end{aligned}

Then, a direct application of (?) and (?) gives the asymptotic expansion for \widehat\rho as

\begin{aligned} n^{1/2}(\widehat\rho - \rho) = n^{-1/2} \sum_{i=1}^n \phi_{\rm eff}(X_i,Y_i,{\bf Z}_i) + O_p(n^{-1/2}). \end{aligned}

Uses Proposition 3

Remark

Remark 1 (Effect of regression bias)

TT03

In the case where two nonparametric regression estimators have nonvanishing asymptotic bias, the corresponding estimator of residual correlation coefficient will also have some bias. Take \widehat\rho_2 as an example. Suppose that the regression estimators \widehat m_{x1} and \widehat m_{y1} converge to the functions m_x^* and m_y^*, which may be different from m_x and m_y. Under similar or weaker convergence assumptions like (1) where m_x and m_y are replaced by m_x^* and m_y^*, we can similarly show that

\begin{aligned} \widehat\sigma_{x2}^2\xrightarrow{P}\sigma_x^2+\mbox{var}\{\delta_x({\bf Z})\}, \quad \widehat\sigma_{y2}^2\xrightarrow{P}\sigma_y^2+\mbox{var}\{\delta_y({\bf Z})\}, \quad \widehat\sigma_{xy2}\xrightarrow{P}\sigma_{xy}+\mbox{cov}\{\delta_x({\bf Z}),\delta_y({\bf Z})\}, \end{aligned}

where \delta_x = m_x^* - m_x and \delta_y = m_y^* - m_y are corresponding biases. Thus, by Slutsky’s theorem, we know that

\begin{aligned} \widehat\rho_2 = \frac{\widehat\sigma_{xy2}}{\widehat\sigma_{x2}\widehat\sigma_{y2}} \xrightarrow{P}\frac{\sigma_{xy}+\mbox{cov}\{\delta_x({\bf Z}),\delta_y({\bf Z})\}}{[\sigma_x^2+\mbox{var}\{\delta_x({\bf Z})\}]^{1/2}[\sigma_y^2+\mbox{var}\{\delta_y({\bf Z})\}]^{1/2}}. \end{aligned}

Note that the variance terms in the denominator are always inflated by the regression bias, while the numerator can either increase or decrease according to the sign of the covariance term. Therefore, if the true correlation \rho is nonzero, the regression bias is more likely to shrink the residual correlation estimator toward zero, especially when the covariance between the two regression bias terms is relatively small. On the other hand, if \rho=0, the regression bias may as well induce some bias due to the \mbox{cov}\{\delta_x({\bf Z}),\delta_y({\bf Z})\} term. The same phenomenon also holds for \widehat\rho_1 and \widehat\rho.

Theorem

Theorem 2

3XWW

Under model (?), suppose that the nonparametric regression estimators \widehat m_{xk} and \widehat m_{yk} satisfy (1), for k=1,2. Let \widehat\rho be defined by (?). If n_1 = n_2 = n/2, then we have

\begin{aligned} n^{1/2}(\widehat\rho-\rho)\xrightarrow{d}N\left\{0,(1-\rho^2)^2\right\}. \end{aligned}

Source and licence

The text on this page is from arXiv:2606.01011v2 by Yin Tang, Yanyuan Ma and Bing Li, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.

The record of each item is in analysis/objects/2606/2606.01011.jsonl.