Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data

Salman Khan, Munawar HAYAT, Mohammed Bennamoun, Ferdous Sohel, Roberto Togneri

Research output: Contribution to journalArticle

85 Citations (Scopus)

Abstract

Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes are abundant, making them an overrepresented majority, and data of other classes are scarce, making them an underrepresented minority. This imbalance makes it challenging for a classifier to appropriately learn the discriminating boundaries of the majority and minority classes. In this paper, we propose a cost-sensitive (CoSen) deep neural network, which can automatically learn robust feature representations for both the majority and minority classes. During training, our learning procedure jointly optimizes the class-dependent costs and the neural network parameters. The proposed approach is applicable to both binary and multiclass problems without any modification. Moreover, as opposed to data-level approaches, we do not alter the original data distribution, which results in a lower computational cost during the training process. We report the results of our experiments on six major image classification data sets and show that the proposed approach significantly outperforms the baseline algorithms. Comparisons with popular data sampling techniques and CoSen classifiers demonstrate the superior performance of our proposed method.
Original languageEnglish
Pages (from-to)3573-3587
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume29
Issue number8
Early online date17 Aug 2017
DOIs
Publication statusPublished - Aug 2018

    Fingerprint

Cite this