Weighted least squares: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Igor Grešovnik
imported>Igor Grešovnik
(→‎Problem statement: comment on variances)
Line 15: Line 15:


with respect to the adjustable parameters of the model '''a'''.
with respect to the adjustable parameters of the model '''a'''.
When ''y<sub>i</sub>'' are some quantities measured in some real physical system, and ''f'' is a model of this system, then we often set the weights ''w<sub>i</sub>'' as inverse of the variances of the corresponding measurements (''y<sub>i</sub>''),
:<math> w_i = 1/\sigma_i^2 .</math>


== See also ==
== See also ==

Revision as of 23:34, 23 November 2007

Weighted least squares is a method of linear regression similar to the ordinary least squares method, except that points are weighted, which causes that some points have greater effect on the approximation than the others. The weighted least squares method is particularly important in function approximation and in estimation of model parameters from measured data.

Problem statement

Consider the problem of adjusting a model function to best fit a given data set. The chosen model function has a set of adjustable parameters a. The data set consist of n points

The model function has the form

where y is the dependent variable, x are the independent variables, and a are the adjustable parameters of the model. We wish to find the values of these parameters such that the model best fits the data according to a defined error criterion. The least squares method minimizes the weighted sum of squares of errors,

with respect to the adjustable parameters of the model a.

When yi are some quantities measured in some real physical system, and f is a model of this system, then we often set the weights wi as inverse of the variances of the corresponding measurements (yi),

See also