Comparisons of estimators of the number of true null hypotheses and adaptive FDR procedures in multiplicity testing

Abstract

Many exploratory studies such as microarray experiments require the simultaneous comparison of hundreds or thousands of genes. It is common to see that most genes in many microarray experiments are not expected to be differentially expressed. Under such a setting, a procedure that is designed to control the false discovery rate (FDR) is aimed at identifying as many potential differentially expressed genes as possible. The usual FDR controlling procedure is constructed based on the number of hypotheses. However, it can become very conservative when some of the alternative hypotheses are expected to be true. The power of a controlling procedure can be improved if the number of true null hypotheses (m ₀) instead of the number of hypotheses is incorporated in the procedure [Y. Benjamini and Y. Hochberg, On the adaptive control of the false discovery rate in multiple testing with independent statistics, J. Edu. Behav. Statist. 25(2000), pp. 60–83]. Nevertheless, m ₀ is unknown, and has to be estimated. The objective of this article is to evaluate some existing estimators of m ₀ and discuss the feasibility of these estimators in incorporating into FDR controlling procedures under various experimental settings. The results of simulations can help the investigator to choose an appropriate procedure to meet the requirement of the study.

Keywords:

• false discovery rate
• multiple hypothesis testing
• number of true null hypotheses
• sensitivity

Acknowledgements

The author was grateful to the Editor and referee for helpful comments that have led to an improved paper. The author thanks Mr. Ming-Che Tsai for programming assistants. This research is partially supported by National Science Council Grant # NSC 95-2118-M-305-003.