Fused variable screening for massive imbalanced data
Publication in refereed journal


Times Cited
Altmetrics Information
.

Other information
AbstractImbalanced data, in which the data exhibit an unequal or highly-skewed distribution between its classes/categories, are pervasive in many scientific fields, with application range from bioinformatics, text classification, face recognition, fraud detection, etc. Imbalanced data in modern science are often of massive size and high dimensionality, for example, gene expression data for diagnosing rare diseases. To address this issue, a fused screening procedure is proposed for dimension reduction with large-scale high dimensional imbalanced data under repeated case-control samplings. There are several advantages of the proposed method: it is model-free without any model specification for the underlying distribution; it is relatively inexpensive in computational cost by using the subsampling technique; it is robust to outliers in the predictors. The theoretical properties are established under regularity conditions. Numerical studies including extensive simulations and a real data example confirm that the proposed method performs well in practical settings.
Acceptance Date30/06/2019
All Author(s) ListJinhan Xie, Meiling Hao, Wenxin Liu, Yuanyuan Lin
Journal nameComputational Statistics and Data Analysis
Year2020
Month1
Volume Number141
PublisherElsevier
Pages94 - 108
ISSN0167-9473
eISSN1872-7352
LanguagesEnglish-United States
KeywordsCase-control sampling, High dimension, Imbalanced data, Model-free screening, Rank correlation

Last updated on 2020-15-10 at 03:12