FUZZY DISTANCE-BASED FILTER-WRAPPER INCREMENTAL ALGORITHMS FOR ATTRIBUTE REDUCTION WHEN ADDING OR DELETING ATTRIBUTE SET

Authors

  • Ho Thi Phuong Institute of Information Technology, VAST
  • Nguyen Long Giang Tay Nguyen University

DOI:

https://doi.org/10.15625/2525-2518/59/2/15698

Keywords:

Decision system, fuzzy rough set, fuzzy distance, incremental algorithm, attribute reduction, reduct

Abstract

Attribute reduction is a critical problem in the data preprocessing step with the aim of minimizing redundant attributes to improve the efficiency of data mining models. The fuzzy rough set theory is considered an effective tool to solve the attribute reduction problem directly on the original decision system, without data preprocessing. With the current digital transformation trend, decision systems are larger in size and updated. To solve the attribute reduction problem directly on change decision systems, a number of recent studies have proposed incremental algorithms to find reducts according to fuzzy rough set approach to reduce execution time. However, the proposed algorithms follow the traditional filter approach. Therefore, the obtained reduct is not optimal in both criteria: the number of attribute of the reducts and the accuracy of classification model. In this paper, we propose incremental algorithms that find reducts following filter-wrapper approach using fuzzy distance measure in the case of adding and deleting attribute set. The experimental results on the sample datasets show that the proposed algorithms significantly reduce the number of attributes in reduct and improve the classification accuracy compared to other algorithms using filter approach

Downloads

Download data is not yet available.

Author Biography

Ho Thi Phuong, Institute of Information Technology, VAST

Database Management; Knowledge Discovery and Data Mining; Machine Learning; Rough Set Theory and Application

References

D. Dübois, H. Prade, “Rough fuzzy sets and fuzzy rough sets”, International Journal of General Systems 17, pp.191-209, 1990.

Z. Pawlak, Rough sets: Theoretical Aspects of Reasoning about Data, Kluwer Academic Publisher, London, 1991.

Anoop Kumar Tiwari , Shivam Shreevastava, Tanmoy Som, K.K. Shukla, “Tolerance-based intuitionistic fuzzy-rough set approach for attribute reduction”, Expert Systems With Applications 101, pp. 205–212, 2018.

Z. Wang, Y.L. Qi, M.W. Shao, Q.H. Hu, D.G. Chen, Y.H. Qian, Y.J. Lin, “A Fitting Model for Feature Selection with Fuzzy Rough Sets”, IEEE Transactions on Fuzzy Systems, Volume: 25, Issue: 4, pp. 741-753, 2017.

Zhang, C.L. Mei, D.G. Chen, Y.Y. Yang, “A fuzzy rough set-based feature selection method using representative instances”, Knowledge-Based Systems, Vol. 151, pp. 216-229, 2018.

T.K. Sheeja, A. Sunny Kuriakose, “A novel feature selection method using fuzzy rough sets”, Computers in Industry 97, pp. 111- 116, 2018.

Y. Lin, Y. Li, C. Wang, J. Chen, “Attribute reduction for multi-label learning with fuzzy rough set”, Knowl.-Based Syst. 152, pp. 51-61, 2018.

J.H. Dai, Y.J. Yan, Z.W. Li, B.S. Liao, “Dominance-based fuzzy rough set approach for incomplete interval-valued data”, Journal of Intelligent & Fuzzy Systems 34, pp. 423-436, 2018.

Q.H. Hu, D.R. Yu, Z.X. Xie, “Information-preserving hybrid data reduction based on fuzzy-rough techniques”, Pattern Recognit. Lett. 27(5), pp. 414-423, 2016.

X. Zhang, C.L. Mei, D. G. Chen, J. Li, “Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy”, Pattern Recognition 56, pp. 1-15, 2016.

C.Z. Wang, Y.Huang, M.W. Shao, X.D.Fan, “Fuzzy rough setbased attribute reduction using distance measures”, Knowledge-Based Systems, Vol. 164, 2019, pp. 205-212.

C.Z. Wang, Y. Qi, Q. He, “Attribute reduction using distancebased fuzzy rough sets”, International Conference on Machine Learning and Cybernetics, IEEE, 2015.

Cao Chinh Nghia, Demetrovics Janos, Nguyen Long Giang, Vu Duc Thi, “About a fuzzy distance between two fuzzy partitions and attribute reduction problem”, Cybernetics and Information Technologies, Vol 16, No 4, pp. 13-28, 2016

J.H. Dai, H. Hu, W.Z. Wu,Y.H. Qian, D.B. Huang, “Maximal Discernibility Pairs Based Approach to Attribute Reduction in Fuzzy Rough Sets”, IEEE Transactions on Fuzzy Systems, Vol. 26, Issue 4, pp. 2174-2187, 2018.

J.H. Dai, Q.H. Hu, H. Hu, D.B.Huang, “Neighbor inconsistent pair selection for attribute reduction by rough set approach”. IEEE Transactions on Fuzzy Systems, Vol. 26, Issue 2, pp. 937-950, 2017.

L.J.Ping, Z. W. Xia, T.Z. Hui, X.Y. Fang, M. T. Yu, Z.J. Jing, Z. G. Yong, J. P. Niyoyita, “learning with fuzzy rough set-based attribute selection”, Expert Systems with Applications, Vol. 139, pp. 1- 17, 2020.

W.P. Ding, C.T. Lin, Z.H. Cao, “Deep neuro-cognitive coevolution for fuzzy attribute reduction by quantum leaping PSO with nearest-neighbor memeplexes”, IEEE Transactions on Cybernetics, 49(7):2744-2757, 2019

X.M. Liu, C. Shen, W. Wang, X.H. Guan, “CoEvil: A Coevolutionary Model for Crime Inference Based on Fuzzy Rough Feature Selection”, IEEE Transactions on Fuzzy Systems, Early Access, 2019.

Y.J. Lin, Q.H. Hu, J.H. Liu, J.J. Li, X.D. Wu, “Streaming feature selection for multi-label learning based on fuzzy mutual information”, IEEE Transactions on Fuzzy Systems, Vol. 25, Issue 6, pp. 1491-1507, 2017.

Demetrovics, J., Thi, V.D., & Giang, N.L. (2014). Metric Based Attribute Reduction in Dynamic Decision systems. Annales Univ. Sci. Budapest., Sect. Comp, Vol. 42, 157-172.

Huong, N. T. L., &Giang, N. L. (2016). Incremental algorithms based on metric for finding reduct in dynamic decision systems. Journal on Research and Development on Information & Communications Technology, Vol.E-3, No.9, 26-39.

Y.G. Jing, T.R. Li, J.F. Huang, H.M. Chen, S.J. Horng, “A Group Incremental Reduction Algorithm with Varying Data Values”, International Journal of Intelligent Systems 32(9), pp. 900-925, 2017.

Y.G. Jing, T.R. Li, H. Fujita, Z. Yu, B. Wang, “An incremental attribute reduction approach based on knowledge granularity with a multi-granulation view”, Information Sciences 411, pp. 23-38, 2017.

Zhang, C., Dai, J. & Chen, J. (2020). Knowledge granularity based incremental attribute reduction for incomplete decision systems. International Journal of Machine Learning and Cybernetics. https://doi.org/10.1007/s13042-020-01089-4.

Cai, M.J., Lang, G.M., Hamido, F., Li, Z.Y., &Yang, T. (2019). Incremental approaches to updating reducts under dynamic covering granularity. Knowledge-Based Systems 172, 130-140.

Zhang, C., &Dai, J. (2019). An incremental attribute reduction approach based on knowledge granularity for incomplete decision systems. Granular Computing, 1-15.

Zhang, C., Dai, J. &Chen, J. (2020). Knowledge granularity based incremental attribute reduction for incomplete decision systems. International Journal of Machine Learning and Cybernetics. https://doi.org/10.1007/s13042-020-01089-4.

W. Wei, X.Y. Wu, J.Y. Liang, J.B. Cui, Y.J. Sun, “Discernibility matrix based incremental attribute reduction for dynamic data”, Knowledge-Based Systems, Vol. 140, pp. 142-157, 2018.

G. Lang, Q. Li, M. Cai, T. Yang, Q. Xiao, “Incremental approaches to knowledg reduction based on characteristic matrices”, Int. J. Mach. Learn. Cybern. 8 (1) pp. 203-222, 2017.

Ma, F.M., Ding, M.W., Zhang, T.F., &Cao, J. (2019). Compressed binary discernibility matrix based incremental attribute reduction algorithm for group dynamic data. Neurocomputing, Vol. 344, No. 7, 20-27.

Yang, C.J., Ge, H., Li, L.S., &Ding, J. (2019). A unified incremental reduction with the variations of the object for decision tables. Soft Computing 23, 6407-6427.

Liu, Y., Zheng, L.D., Xiu, Y.L., Yin, H., Zhao, S.Y., Wang, X.H., Chen, H., &Li, C.P. (2020). Discernibility matrix based incremental feature selection on fused decision tables. International Journal of Approximate Reasoning 118, 1-26.

Das, A. K., Sengupta, S., & Bhattacharyya, S. (2018). A group incremental feature selection for classification using rough set theory based genetic algorithm. Applied Soft Computing, 65, 400-411.

Lang, G., Cai, M., Fujita, H., &Xiao, Q. (2018). Related families-based attribute reduction of dynamic covering decision information systems. Knowledge-Based Systems, 162, 161-173.

Hao, G., Longshu, L., Chuanjian, Y., &Jian, D. (2019).

Incremental reduction algorithm with acceleration strategy based on conflict region. Artificial Intelligence Review, 51(4), 507-536.

Shua, W.H., Qian, W.B., &Xie, Y.H. (2019). Incremental approaches for feature selection from dynamic data with the variation of multiple objects. Knowledge-Based Systems, Vol. 163, 320-331.

Nandhini, N., &Thangadurai, K. (2019). An incremental rough set approach for faster attribute reduction, International Journal of Information Technology. https://doi.org/10.1007/s41870-019-00326-6.

Shu, W.H., Qian, W., &Xie, Y. (2020). Incremental feature selection for dynamic hybrid data using neighborhood rough set. Knowledge-Based Systems 194, 105516.

Xie, X., &Qin, X. (2018). A novel incremental attribute reduction approach for dynamic incomplete decision systems. International Journal of Approximate Reasoning, 93, 443-462.

Y.Y. Yang, D.G. Chen, H. Wang, “Active Sample Selection Based Incremental Algorithm for Attribute Reduction With Rough Sets”, IEEE Transactions on Fuzzy Systems, Vol. 25, Issue 4, pp. 825- 838, 2017.

W.H. Shu, H. Shen, “Updating attribute reduction in incomplete decision systems with the variation of attribute set”, International Journal of Approximate Reasoning, vol. 55, no.3, pp. 867-884, 2014.

F. Wang, J.Y. Liang, Y.H. Qian, “Attribute reduction: A dimension incremental strategy”, Knowledge-Based Systems, Volume 39, pp. 95-108, 2013.

M.J. Cai, Q.G. Li, J.M. Ma, “Knowledge reduction of dynamic covering decision information systems caused by variations of attribute values”, International Journal of Machine Learning and Cybernetics 8(4), pp. 1131-1144, 2017.

Ma, F.M., Ding, M.W., Zhang, T.F., &Cao, J. (2019). Compressed binary discernibility matrix based incremental attribute reduction algorithm for group dynamic data. Neurocomputing, Vol. 344, No. 7, 20-27.

Wei, W., Song, P., Liang, J.Y., &Wu, X.Y. (2019). Accelerating incremental attribute reduction algorithm by compacting a decision system. International Journal of Machine Learning and Cybernetics 10, 2355-2373.

Nandhini, N., &Thangadurai, K. (2019). An incremental rough set approach for faster attribute reduction, International Journal of Information Technology. https://doi.org/10.1007/s41870-019-00326-6.

Chen, D.G., Dong, L.J., &Mi, J.H. (2020). Incremental mechanism of attribute reduction based on discernible relations for dynamically increasing attribute. Soft Computing 24, 321-332.

Demetrovics Janos, Nguyen Thi Lan Huong, Vu Duc Thi, Nguyen Long Giang, “Metric Based Attribute Reduction Method in Dynamic Decision Tables”, Cybernetics and Information Technologies, Vol.16, No.2, pp. 3-15, 2016.

M.S. Raza,U. Qamar, “An incremental dependency calculation technique for feature selection using rough sets”, Information Sciences 343–344, pp. 41–65, 2016.

Y. Jing, T. Li, J. Huang, et al., “An incremental attribute reduction approach based on knowledge granularity under the attribute generalization”, Int. J. Approx. Reason. 76, pp.80-95, 2016.

Y.G. Jing, T.R. Li, H. Fujita, B.L. Wang, N. Cheng, “An incremental attribute reduction method for dynamic data mining”, Information Sciences 465, pp. 202-218, 2018.

Y.M. Liu, S.Y. Zhao, H. Chen, C.P. Li, Y.M. Lu, “Fuzzy Rough Incremental Attribute Reduction Applying Dependency Measures”, APWeb-WAIM 2017: Web and Big Data, pp 484-492, 2017.

Y.Y. Yang, D.G. Chen, H. Wang, Eric C.C.Tsang, D.L. Zhang, “Fuzzy rough set based incremental attribute reduction from dynamic data with sample arriving”, Fuzzy Sets and Systems, Volume 312, pp. 66-86, 2017

Y.Y. Yang, D.G. Chen, H. Wang, X.H. Wang, “Incremental perspective for feature selection based on fuzzy rough sets”, IEEE Transactions on Fuzzy Systems, Vol. 26, Issue 3, pp. 1257-1273, 2017.

Giang, N. L., Ngan, T. T., Tuan, T. M., Phuong, H. T., Abdel-Basset, M., de Macêdo, A. R. L., &Albuquerque, V. (2020). Novel Incremental Algorithms for Attribute Reduction from Dynamic Decision systems using Hybrid Filter-Wrapper with Fuzzy Partition Distance. IEEE Transactions on Fuzzy Systems, 28 (5), 858-873.

Zhang, X., Mei, C.L., Chen, D.G., Yang, Y.Y., &Li, J.H. (2020). Active Incremental Feature Selection Using a Fuzzy-Rough-Set-Based Information Entropy. IEEE Transactions on Fuzzy Systems, Volume 28, Issue 5, 901-915.

Ni, P., Zhao, S.Y., Wang, X.H., Chen, H., Li, C.P., Tsang, E.C.C (2020). Incremental Feature Selection Based on Fuzzy Rough Sets. Information Sciences.

A.P. Zeng, T.R. Li, D. Liu, J.B. Zhang, H.M. Chen, “A fuzzy rough set approach for incremental feature selection on hybrid information systems”, Fuzzy Sets and Systems, Vol. 258, pp. 39-60, 2015.

Q.H. Hu, Z.X. Xie, D.R. Yu, “Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation”, Pattern Recognition 40, pp. 3509-3521, 2007.

Y.H. Qian., J.Y. Liang, W.Z. Wu, C.Y. Dang, “Information Granularity in Fuzzy Binary GrC Model”, IEEE Trans. Fuzzy Syst. 19, No 2, pp. 253-264, 2011.

The UCI machine learning repository, http://archive.ics.uci.edu/ml/datasets.html. https://sourceforge.net/projects/weka/.

Downloads

Published

2021-03-16

Issue

Section

Electronics - Telecommunication