An Optimal Approach for Pruning Annular Regularized Extreme Learning Machines

Lavneet Singh, Girija CHETTY

Research output: A Conference proceeding or a Chapter in BookConference contribution

Abstract

Larger datasets, with many samples are problematic for solving problems in data mining and machine learning, due to increase in computational times, increased complexity, and bad generalization due to outliers. Further, the accuracy and performance of machine learning and statistical models are still based on tuning of some parameters and optimizing them for generating better predictive models of learning. In this paper, we propose a novel formulation of Extreme Learning Machines - the Annular ELM, with RANSAC multi model response regularization for pruning large number of hidden nodes to acquire better optimality, generalization and classification accuracy. Experimental evaluation of the proposed ELM formulation on different benchmark datasets showed that the algorithm optimally prunes the hidden nodes, with better generalization and higher classification accuracy as compared to other algorithms, including the well-known SVM, OP-ELM for binary and multi-class classification and regression problems. Also, we extended the proposed algorithm to a more complex application context involving MRI Brain Image classification. For this study, we examine the performance of the proposed algorithm on magnetic resonance images (MRI) of various states of brain by extracting the most significant features, and to classify them into normal and abnormal brain images.
Original languageEnglish
Title of host publication2014 IEEE International Conference on Data Mining Workshop (ICDMW)
EditorsZhi-Hua Zhou, Wei Wang, Ravi Kumar, Hannu Toivonen, Jian Pei, Joshua Zhexue Huang, Xindong Wu
Place of PublicationShenzhen, China
PublisherIEEE
Pages80-87
Number of pages8
ISBN (Electronic)9781479942749
ISBN (Print)9781479942756
DOIs
Publication statusPublished - 2014
Event2014 IEEE International Conference on Data Mining - Shenzen, Shenzen, China
Duration: 14 Dec 2014 → …

Publication series

NameIEEE International Conference on Data Mining Workshops, ICDMW
NumberJanuary
Volume2015-January
ISSN (Print)2375-9232
ISSN (Electronic)2375-9259

Conference

Conference2014 IEEE International Conference on Data Mining
CountryChina
CityShenzen
Period14/12/14 → …

    Fingerprint

Cite this

Singh, L., & CHETTY, G. (2014). An Optimal Approach for Pruning Annular Regularized Extreme Learning Machines. In Z-H. Zhou, W. Wang, R. Kumar, H. Toivonen, J. Pei, J. Zhexue Huang, & X. Wu (Eds.), 2014 IEEE International Conference on Data Mining Workshop (ICDMW) (pp. 80-87). [7022582] (IEEE International Conference on Data Mining Workshops, ICDMW; Vol. 2015-January, No. January). Shenzhen, China: IEEE. https://doi.org/10.1109/ICDMW.2014.69