• Home
  • Search
  • Option predictive clustering trees for multi-target regression
  • Cite Icon6
  • https://doi.org/10.2298/csis190928006sCopy DOI Icon

Option predictive clustering trees for multi-target regression

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Decision trees are one of the most widely used predictive modelling methods primarily because they are readily interpretable and fast to learn. These nice properties come at the price of predictive performance. Moreover, the standard induction of decision trees suffers from myopia: a single split is chosen in each internal node which is selected in a greedy manner; hence, the resulting tree may be sub-optimal. To address these issues, option trees have been proposed which can include several alternative splits in a new type of internal nodes called option nodes. Considering all of this, an option tree can be also regarded as a condensed representation of an ensemble. In this work, we propose to learn option trees for multi-target regression (MTR) based on the predictive clustering framework. The resulting models are thus called option predictive clustering trees (OPCTs). Multi-target regression is concerned with learning predictive models for tasks with multiple numeric target variables.We evaluate the proposed OPCTs on 11 benchmark MTR data sets. The results reveal that OPCTs achieve statistically significantly better predictive performance than a single predictive clustering tree (PCT) and are competitive with bagging and random forests of PCTs. By limiting the number of option nodes, we can achieve a good trade-off between predictive power and efficiency (model size and learning time).We also perform parameter sensitivity analysis and bias-variance decomposition of the mean squared error. Our analysis shows that OPCTs can reduce the variance of PCTs nearly as much as ensemble methods do. In terms of bias, OPCTs occasionally outperform other methods. Finally, we demonstrate the potential of OPCTs for multifaceted interpretability and illustrate the potential for inclusion of domain knowledge in the tree learning process.

Similar Papers
  • Research Article
  • Citations47

Semi-supervised trees for multi-target regression

  • Mar 12, 2018
  • Information Sciences
  • Jurica Levatić +3
  • Book Chapter
  • Citations13

Detection of Visual Concepts and Annotation of Images Using Ensembles of Trees for Hierarchical Multi-Label Classification

  • Jan 01, 2010
  • Ivica Dimitrovski +3
  • Research Article
  • Citations40

Tree-based methods for online multi-target regression

  • Apr 28, 2017
  • Journal of Intelligent Information Systems
  • Aljaž Osojnik +2
  • Book Chapter
  • Citations2

The Use of Hybrid Predictive C&RT-Logit Models in Analytical CRM

  • Jan 01, 2016
  • Mariusz Łapczyński
  • Research Article
  • Citations1

Ensemble of naive Bayes, decision tree, and random forest to predict air quality

  • Sep 01, 2024
  • IAES International Journal of Artificial Intelligence (IJ-AI)
  • Yulia Resti +6
  • Research Article
  • Citations7

Predictive modeling of the hot metal silicon content in blast furnace based on ensemble method

  • Jan 01, 2022
  • Metallurgical Research & Technology
  • Dewen Jiang +4
  • Research Article
  • Citations10

Rotation Forest for multi-target regression

  • Apr 22, 2021
  • International Journal of Machine Learning and Cybernetics
  • Juan J Rodríguez +3
  • Research Article
  • Citations27

Structure-driven induction of decision tree classifiers through neural learning

  • Nov 01, 1997
  • Pattern Recognition
  • Ishwar K Sethi +1
  • Research Article
  • Citations10

Habitat modeling with single- and multi-target trees and ensembles

  • Jun 14, 2013
  • Ecological Informatics
  • Dragi Kocev +1
  • Research Article
  • Citations459

Flood susceptibility analysis and its verification using a novel ensemble support vector machine and frequency ratio method

  • Jan 11, 2015
  • Stochastic Environmental Research and Risk Assessment
  • Mahyat Shafapour Tehrany +2
  • Research Article
  • Citations204

Reviewing ensemble classification methods in breast cancer

  • May 20, 2019
  • Computer methods and programs in biomedicine
  • Mohamed Hosni +4
  • Research Article
  • Citations1

Development of Predictive Models for Rights Issues Using Financial Analysis Indices and Decision Tree Technique

  • Jan 01, 2012
  • Journal of Intelligence and Information Systems
  • Myeong-Kyun Kim +1
  • PDF
  • Research Article
  • Citations16

Predicting Survival of Patients With Rectal Neuroendocrine Tumors Using Machine Learning: A SEER-Based Population Study

  • Nov 03, 2021
  • Frontiers in Surgery
  • Xiaoyun Cheng +4
  • Book Chapter
  • Citations4

Multi-objective Optimization for Incremental Decision Tree Learning

  • Jan 01, 2012
  • Hang Yang +2
  • Research Article
  • Citations510

A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees

  • Feb 12, 2018
  • European Journal of Operational Research
  • Arno De Caigny +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.