Improved version of explainable decision forest: Forest-Based Tree

Khalifa, Faten; Ali, Asmaa H; Abdel-Kader, Hatem

doi:10.21608/ijci.2022.155977.1082

Improved version of explainable decision forest: Forest-Based Tree

Document Type : Original Article

Authors

¹ Information Systems dept., Faculty of Computers and Information, Menoufia University, Shebin Elkom 32511, Menoufia, Egypt

² Information System, faculty of computer and information, Menoufia University, Shebin El Kom, Menofia, Egypt

³ Information SystemsDepartment Faculty of Computers and Information Menoufia University, Egypt

10.21608/ijci.2022.155977.1082

Abstract

A Decision Forest is an ensemble learning method that seeks to enhance the predictivity of a single decision tree via training several trees and combining their decisions. However, it is not easy to explain the rationale behind the predictions of decision forests; as each prediction consists of an integration of many decisions. This defect of decision forest makes it a black box, missing interpretable capability, and it will be difficult for humans to understand its entire logic. In this article, we discuss the transformation of the decision forest into a single decision tree, Forest-Based Tree (FBT), without sacrificing accuracy. The proposed method combines the decision rules of individual trees and organizes them into a tree structure. We focus on how to optimize the algorithm; to build an intelligible and lightweight forest-based tree quickly. The open source software for FBT is also provided. Results on 30 UCI datasets show the objective to approximate the predictive performance of the decision forest through forming an explainable decision tree in less computational time.

Keywords