$\begingroup$@Did I was thinking that the situation motivates the definition of covariance as $\mathbb{E}[XY]=\mathbb{E}[X] \mathbb{E}[Y]$ when $cov(X,Y) =0$ Is this incorrect?$\endgroup$
– KarlOct 5 '15 at 7:57

$\begingroup$@Karl More meaningless than incorrect. "the situation" Which situation? "the definition of covariance as 𝔼[XY]=𝔼[X]𝔼[Y]" 𝔼[XY]=𝔼[X]𝔼[Y] is not a definition of covariance.$\endgroup$
– DidOct 5 '15 at 8:01

1 Answer
1

I don't know if there is any technical reason behind this identity. There is a simple intuition behind the identity. We want to know if the variables X and Y are linearly related or not.i.e, can we say something like Y= m X where m is a constant. If m is positive, then Y increases as X increases. If m is negative, the Y decreases as X increases. First we take rescale both the variables around their mean by looking at P=X-E[x] and Q=Y-E[Y]. If P and Q are both positive or negative, then it adds to the covariance. If one of them is positive and the other is negative ,it subtracts from the covariance. Finally, the expectation gives the average behaviour.