Revision as of 10:12, 17 November 2010

1.11 Joint Characteristic Function

From the ECE600 Pre-requisites notes of Sangchun Han, ECE PhD student.

The joint characteristic function of two joint-distributed RVs $ \mathbf{X} $ and $ \mathbf{Y} $ is

$ \Phi_{\mathbf{XY}}\left(\omega_{1},\omega_{2}\right)\triangleq E\left[e^{i\left(\omega_{1}\mathbf{X}+\omega_{2}\mathbf{Y}\right)}\right]=\iint_{\mathbf{R}^{2}}e^{i\left(\omega_{1}\mathbf{X}+\omega_{2}\mathbf{Y}\right)}f_{\mathbf{XY}}\left(x,y\right)dxdy=\text{2-dim Fourier transform}. $

Note

Inverse Fourier transform relation:

$ f_{\mathbf{XY}}\left(x,y\right)=\frac{1}{\left(2\pi\right)^{2}}\iint_{\mathbf{R}^{2}}e^{-i\left(\omega_{1}x+\omega_{2}y\right)}\Phi_{\mathbf{XY}}\left(\omega_{1},\omega_{2}\right)d\omega_{1}d\omega_{2}. $

Note

1. $ \Phi_{\mathbf{X}}\left(\omega\right)=\Phi_{\mathbf{XY}}\left(\omega,0\right) $ and $ \Phi_{\mathbf{Y}}\left(\omega\right)=\Phi_{\mathbf{XY}}\left(0,\omega\right) $ .

2. If $ \mathbf{Z}=a\mathbf{X}+b\mathbf{Y} $ , then $ \Phi_{\mathbf{Z}}\left(\omega\right)=E\left[e^{i\omega\left(a\mathbf{X}+b\mathbf{Y}\right)}\right]=E\left[e^{i\left(\left(\omega a\right)\mathbf{X}+\left(\omega b\right)\mathbf{Y}\right)}\right]=\Phi_{\mathbf{XY}}\left(\omega a,\omega b\right) $.

• This is used for sum of two Gaussian RVs.

Theorem

If two jointly-distributed RVs $ \mathbf{X} $ and $ \mathbf{Y} $ are statistically independent, then $ \Phi_{\mathbf{XY}}\left(\omega_{1},\omega_{2}\right)=\Phi_{\mathbf{X}}\left(\omega_{1}\right)\mathbf{\Phi}_{\mathbf{Y}}\left(\omega_{2}\right) $ .

Proof

$ \Phi_{\mathbf{XY}}\left(\omega_{1},\omega_{2}\right)=E\left[e^{i\left(\omega_{1}\mathbf{X}+\omega_{2}\mathbf{Y}\right)}\right]=E\left[e^{i\omega_{1}\mathbf{X}}e^{i\omega_{2}\mathbf{Y}}\right]=E\left[e^{i\omega_{1}\mathbf{X}}\right]E\left[e^{i\omega_{2}\mathbf{Y}}\right]=\Phi_{\mathbf{X}}\left(\omega_{1}\right)\mathbf{\Phi}_{\mathbf{Y}}\left(\omega_{2}\right) $.

$ \because \mathbf{X} $ and $ \mathbf{Y} $ are statistically independent

$ \Longrightarrow e^{i\omega_{1}\mathbf{X}} $ and $ e^{i\omega_{2}\mathbf{Y}} $ are statistically independent

$ \Longrightarrow e^{i\omega_{1}\mathbf{X}} $ and $ e^{i\omega_{2}\mathbf{Y}} $ are uncorrelated.

Fact

The joint characteristic function of two jointly-distributed Gaussian RVs is

$ \Phi_{\mathbf{XY}}\left(\omega_{1},\omega_{2}\right)=e^{i\left(\eta_{\mathbf{X}}\omega_{1}+\eta_{\mathbf{Y}}\omega_{2}\right)}\cdot e^{-\frac{1}{2}\left[\sigma_{\mathbf{X}}^{2}\omega_{1}^{2}+2r\sigma_{\mathbf{X}}\sigma_{\mathbf{Y}}\omega_{1}\omega_{2}+\sigma_{\mathbf{Y}}^{2}\omega_{2}^{2}\right]} $.

If $ \mathbf{Z}=\mathbf{X}+\mathbf{Y} $ , then $ \eta_{\mathbf{Z}}=\eta_{\mathbf{X}}+\eta_{\mathbf{Y}} $ and $ \sigma_{\mathbf{Z}}=\sqrt{\sigma_{\mathbf{X}}^{2}+2r\sigma_{\mathbf{X}}\sigma_{\mathbf{Y}}+\sigma_{\mathbf{Y}}^{2}} $ because $ \Phi_{\mathbf{Z}}\left(\omega\right)=\Phi_{\mathbf{XY}}\left(\omega,\omega\right)=e^{i\left(\eta_{\mathbf{X}}+\eta_{\mathbf{Y}}\right)\omega}\cdot e^{-\frac{1}{2}\left[\sigma_{\mathbf{X}}^{2}+2r\sigma_{\mathbf{X}}\sigma_{\mathbf{Y}}+\sigma_{\mathbf{Y}}^{2}\right]\omega^{2}} $.

Joint Moment Generation Function

The joint moment generating function of two jointly-distributed RVs $ \mathbf{X} $ and $ \mathbf{Y} $ is

$ \phi_{\mathbf{XY}}\left(s_{1},s_{2}\right)\triangleq E\left[e^{s_{1}\mathbf{X}+s_{2}\mathbf{Y}}\right]=\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}e^{s_{1}\mathbf{X}+s_{2}\mathbf{Y}}f_{\mathbf{XY}}\left(x,y\right)dxdy $.

Moment Theorem

The joint noncentral moment $ E\left[\mathbf{X}^{j}\mathbf{Y}^{k}\right] $ is given by

$ E\left[\mathbf{X}^{j}\mathbf{Y}^{k}\right]=\frac{\partial^{j}\partial^{k}}{\partial s_{1}^{j}\partial s_{2}^{k}}\left(\phi_{\mathbf{XY}}\left(s_{1},s_{2}\right)\right)|_{s_{1}=0,s_{2}=0} $.