Pattern Recognition Letters
We study the problem of how to assess the reliability of a statistical measurement on data set containing unknown quantity of noises, inconsistencies, and outliers. A practical approach that analyzes the dynamical patterns (trends) of the statistical measurements through a sequential extreme-boundary-points (EBP) weed-out process is explored. We categorize the weed-out trend patterns (WOTP) and examine their relation to the reliability of the measurement. The approach is applied to the processes of extracting genes that are predictive to BCL2 translocations and to clinical survival outcomes of diﬀuse large B-cell lymphoma (DLBCL) from DNA Microarray gene expression proﬁling data sets. Fisher’s Discriminate Criterion (FDC) is used as a statistical measurement in the processes. It is found that the weed-out trend analysis (WOTA) approach is eﬀective for qualitatively assessing the statistics-based measurements in the experimentations conducted.
Cao, Kahai; Zhu, Qiuming; Iqbal, Javeed; and Chan, John W.C., "A trend pattern assessment approach to microarray gene expression proﬁling data analysis" (2007). Computer Science Faculty Publications. 32.