A study on the importance of selection pressure and low dimensional weak learners to produce robust ensembles

Ensembles of classifiers have been studied for some time. It is widely known that weak learners should be accurate and diverse. However, in the real world there are many constraints and few have been said about the robustness of ensembles and how to develop it. In the context of ran- dom subspace methods, this paper addresses the question of developing ensembles to face problems under time con- straints. Experiments show that selecting weak learners based on their accuracy can be used to create robust en- sembles. Thus, the selection pressure in ensembles is a key technique to create not just effective ensembles but also robust ones. Moreover, the experiments motivate further research on ensembles made of low dimensional classifiers which achieve general accurate results.