Research Repository

An Ensemble of Optimal Trees for Class Membership Probability Estimation

Khan, Zardad and Gul, Asma and Mahmoud, Osama and Miftahuddin, Miftahuddin and Perperoglou, Aris and Adler, Werner and Lausen, Berthold (2016) An Ensemble of Optimal Trees for Class Membership Probability Estimation. In: UNSPECIFIED, ? - ?.

Full text not available from this repository.


Machine learning methods can be used for estimating the class membership probability of an observation. We propose an ensemble of optimal trees in terms of their predictive performance. This ensemble is formed by selecting the best trees from a large initial set of trees grown by random forest. A proportion of trees is selected on the basis of their individual predictive performance on out of-bag observations. The selected trees are further assessed for their collective performance on an independent training data set. This is done by adding the trees one by one starting from the highest predictive tree. A tree is selected for the final ensemble if it increases the predictive performance of the previously combined trees. The proposed method is compared with probability estimation tree, random forest and node harvest on a number of bench mark problems using Brier score as a performance measure. In addition to reducing the number of trees in the ensemble, our method gives better results in most of the cases. The results are supported by a simulation study.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Additional Information: Published proceedings: Studies in Classification, Data Analysis, and Knowledge Organization
Subjects: H Social Sciences > HA Statistics
Q Science > QA Mathematics
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health
Faculty of Science and Health > Mathematical Sciences, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 05 Dec 2016 21:18
Last Modified: 15 Jan 2022 00:46

Actions (login required)

View Item View Item