Model Selection for Discrete Dependent Variables: Better Statistics for Better Steaks
By: Norwood, F. Bailey; Lusk, Jayson L.; Brorsen, B. Wade
Norwood, F. Bailey; Lusk, Jayson L.; Brorsen, B. Wade, Model Selection for Discrete Dependent Variables: Better Statistics for Better Steaks, Journal of Agricultural and Resource Economics, Volume 29, Issue 3, December 2004, Pages 404-419
Little research has been conducted on evaluating out-of sample forecasts of discrete dependent variables. This study describes the large and small sample properties of two forecast evaluation techniques for discrete dependent variables: receiver-operator curves and out-of-sample log-likelihood functions. The methods are shown to provide identical model rankings in large samples and similar rankings in small samples. The likelihood function method is better at detecting forecast accuracy in small samples. By improving forecasts of fed cattle quality grades, the forecast evaluation methods are shown to increase cattle marketing revenues by $2.59/head.