Gini objective functions for three-way classifications

• Published in: International journal of approximate reasoning Vol. 81; pp. 103 - 114
• Main Authors: Zhang, Yan, Yao, JingTao
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01-02-2017
• Subjects: Acceptance; Classifications; Coefficients; Gini coefficient; Impurities; Impurity; Objective function; Rejection; Rough sets; Three-way classifications; Tradeoffs; Tuning; Universe; Objective function; Impurity; Gini coefficient; Three-way classifications; Rough sets
• ISSN: 0888-613X; 1873-4731
• DOI: 10.1016/j.ijar.2016.11.005

The three-way classifications aim to divide the universe of objects into three disjoint regions, i.e., acceptance, rejection, and non-commitment regions. We can induce different types of classification rules from these regions. There exist different measures to evaluate the quality of regions. The partition of the three regions based on certain measures such as Gini coefficient is one of the challenges in three-way classifications. When using Gini coefficients to evaluate the impurities of three-way regions, there may exist contradiction on changing of various regions towards the preferred measure levels. The impurity of one region decreases at the expense of the increase of other regions' impurities when regions change. It is impossible to decrease one region's impurity without increasing the other regions' impurities. In this paper, we formulate Gini objective functions to balance the contradictions among the impurities of three-way regions. Three Gini objective functions, i.e., minimizing the overall impurity of three regions, minimizing impurities of immediate and non-commitment decision regions simultaneously, and minimizing impurities of acceptance, rejection and non-commitment regions simultaneously, are discussed in detail. These Gini objective functions express different preferred situations of three-way regions. The balanced three-way regions representing the trade-off among impurities can be obtained by finding the solutions to these Gini objective functions. An example shows how and what three-way regions are obtained by tuning impurities of these regions to satisfy certain Gini objective functions. It is suggested that with the proposed Gini objective functions more efficient and applicable three-way regions may be induced.
•Constructs three-way regions with probabilistic rough sets and Gini coefficients.•Measures the impurities of three-way regions with Gini coefficients.•Analyzes the relationship among region impurity and performance changes.•Formulates Gini objective functions to balance the impurities of three-way regions.•Demonstrates the use Gini objective functions compares them with entropy approaches.