You are not currently logged in.
Access JSTOR through your library or other institution:
Least Squares and Entropy: A Penalty Function Perspective
Paul V. Preckel
American Journal of Agricultural Economics
Vol. 83, No. 2 (May, 2001), pp. 366-377
Stable URL: http://www.jstor.org/stable/1244679
Page Count: 12
Preview not available
Mathematical measures of entropy as defined by Shannon and cross entropy as defined by Kullback and Leibler are currently in vogue in the field of econometrics, primarily due to the comprehensive work of Golan, Judge, and Miller. An alternative interpretation of the entropy measure as a penalty function over deviations is presented, and a number of parallels are drawn with least squares estimators. It is demonstrated that both approaches may be applied to the general linear model. The causes of differences in estimated parameter values are described, and some suggestions for the formulation of entropy-based econometric problems are presented.
American Journal of Agricultural Economics © 2001 Agricultural & Applied Economics Association