Minimization of Akaike's information criterion in linear regression analysis via mixed integer nonlinear program

Keiji Kimura, Hayato Waki

    研究成果: Contribution to journalArticle査読

    13 被引用数 (Scopus)

    抄録

    Akaike's information criterion (AIC) is a measure of evaluating statistical models for a given data set. We can determine the best statistical model for a particular data set by finding the model with the smallest AIC value. Since there are exponentially many candidates of the best model, the computation of the AIC values for all the models is impractical. Instead, stepwise methods, which are local search algorithms, are commonly used to find a better statistical model, though it may not be the best model. We propose a branch-and-bound search algorithm for a mixed integer nonlinear programming formulation of the AIC minimization presented by Miyashiro and Takano [Mixed integer second-order cone programming formulations for variable selection, Eur. J. Oper. Res. 247 (2015), pp. 721–731]. More concretely, we propose procedures to find lower and upper bounds, and branching rules for this minimization. We then combine such procedures and branching rules with SCIP, a mathematical optimization software and the branch-and-bound framework. We show that the proposed method can provide the best AIC-based statistical model for small- or medium-sized benchmark data sets in the UCI Machine Learning Repository. Furthermore, the proposed method finds high-quality solutions for large-sized benchmark data sets.

    本文言語英語
    ページ(範囲)633-649
    ページ数17
    ジャーナルOptimization Methods and Software
    33
    3
    DOI
    出版ステータス出版済み - 5 4 2018

    All Science Journal Classification (ASJC) codes

    • Software
    • Control and Optimization
    • Applied Mathematics

    フィンガープリント 「Minimization of Akaike's information criterion in linear regression analysis via mixed integer nonlinear program」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

    引用スタイル