Minimax fixed-design linear regression

Peter L. Bartlett, Wouter M. Koolen, Alan Malek, Eiji Takimoto, Manfred K. Warmuth

研究成果: Contribution to journalConference article

1 引用 (Scopus)

抜粋

We consider a linear regression game in which the covariates are known in advance: at each round, the learner predicts a real-value, the adversary reveals a label, and the learner incurs a squared error loss. The aim is to minimize the regret with respect to linear predictions. For a variety of constraints on the adversary's labels, we show that the minimax optimal strategy is linear, with a parameter choice that is reminiscent of ordinary least squares (and as easy to compute). The predictions depend on all covariates, past and future, with a particular weighting assigned to future covariates corresponding to the role that they play in the minimax regret. We study two families of label sequences: box constraints (under a covariate compatibility condition), and a weighted 2- norm constraint that emerges naturally from the analysis. The strategy is adaptive in the sense that it requires no knowledge of the constraint set. We obtain an explicit expression for the minimax regret for these games. For the case of uniform box constraints, we show that, with worst case covariate sequences, the regret is O(d log T), with no dependence on the scaling of the covariates.

元の言語英語
ジャーナルJournal of Machine Learning Research
40
発行部数2015
出版物ステータス出版済み - 1 1 2015
イベント28th Conference on Learning Theory, COLT 2015 - Paris, フランス
継続期間: 7 2 20157 6 2015

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Statistics and Probability
  • Artificial Intelligence

フィンガープリント Minimax fixed-design linear regression' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Bartlett, P. L., Koolen, W. M., Malek, A., Takimoto, E., & Warmuth, M. K. (2015). Minimax fixed-design linear regression. Journal of Machine Learning Research, 40(2015).