Ask your own question, for FREE!
Mathematics 33 Online
OpenStudy (anonymous):

Could someone tell me how to obtain the least square estimates of the parameters of a regression model? - statistics-

OpenStudy (anonymous):

Are you just looking for linear regression?

OpenStudy (anonymous):

yes.only linear regression. generally in term of Y=a+bx+error.

OpenStudy (anonymous):

You just want the computation formulas, or theory?

OpenStudy (anonymous):

just want to know how to answer if i got a question like this.

OpenStudy (anonymous):

\[b=\frac{\sum(x_i-<x>)(y_i-<y>)}{\sum_{}{}(x_i-<x>)^2}=\frac{s_{xy}}{s_{xx}}\]That's what b is BUT, I'm going to give you formulas derived from this that you should use when you want to do any kind of computation:

OpenStudy (anonymous):

PS x_i and y_i are data points, <x>, <y> are the means of each.

OpenStudy (anonymous):

\[s_{xy}=\sum_{}{}x_iy_i-\frac{\left( \sum_{}{}x_i \right)\left( \sum_{}{}y_i \right)}{n}\]

OpenStudy (anonymous):

\[s_{xx}=\sum_{}{}x_i^2-\frac{\left( \sum_{}{}x_i \right)^2}{n}\]

OpenStudy (anonymous):

Your intercept, a, can be calculated from\[<y>-b<x>\] where b is the estimate of the slope you would have found from the above.

OpenStudy (anonymous):

The process of calculating these wipes epsilon.

OpenStudy (anonymous):

You should end up with\[Y=\frac{s_{xy}}{s_{xx}}X+(<y>-b<x>)\]

OpenStudy (anonymous):

at this point, what should i do with the equation to get the least square estimation?

OpenStudy (anonymous):

Are you talking about epsilon, the error term?

OpenStudy (anonymous):

no. i meant for a and b.

OpenStudy (anonymous):

Your b is \[b=\frac{s_{xy}}{s_{xx}}\]and your a is\[a=<y>-b<x>\]You find b first, so you can find a quickly. I didn't put down the sum stuff for a since it would take longer to compute...i.e. you wouldn't use it.

OpenStudy (anonymous):

ok. i understood now.thanks a lot..

OpenStudy (anonymous):

No probs. Become a fan ;)

Can't find your answer? Make a FREE account and ask your own questions, OR help others and earn volunteer hours!

Join our real-time social learning platform and learn together with your friends!
Can't find your answer? Make a FREE account and ask your own questions, OR help others and earn volunteer hours!

Join our real-time social learning platform and learn together with your friends!