288 pp. per issue
6 x 9, illustrated
2014 Impact factor:

Neural Computation

July 1, 2003, Vol. 15, No. 7, Pages 1477-1480
(doi: 10.1162/089976603321891765)
© 2003 Massachusetts Institute of Technology
Note on “Comparison of Model Selection for Regression” by Vladimir Cherkassky and Yunqian Ma
Article PDF (52.04 KB)

While Cherkassky and Ma (2003) raise some interesting issues in comparing techniques for model selection, their article appears to be written largely in protest of comparisons made in our book, Elements of Statistical Learning (2001). Cherkassky and Ma feel that we falsely represented the structural risk minimization (SRM) method, which they defend strongly here.

In a two-page section of our book (pp. 212–213), we made an honest attempt to compare the SRM method with two related techniques, Aikaike information criterion (AIC) and Bayesian information criterion (BIC). Apparently, we did not apply SRM in the optimal way. We are also accused of using contrived examples, designed to make SRM look bad.

Alas, we did introduce some careless errors in our original simulation—errors that were corrected in the second and subsequent printings. Some of these errors were pointed out to us by Cherkassky and Ma (we supplied them with our source code), and as a result we replaced the assessment “SRM performs poorly overall” with a more moderate “the performance of SRM is mixed” (p. 212). These and other corrections can be seen in the errata section on-line at