An analysis of robust cost functions for CNN in computer-aided diagnosis

Abstract

Deep convolutional neural networks (CNNs) have proven to be powerful and flexible tools that advance the state-of-the-art in many fields, e.g. speech recognition, computer vision and medical imaging. Usually deep CNN models employ the logistic (soft-max) loss function in the training process of classification tasks. Recent evidence on a computer vision benchmark data-set indicates that the hinge (SVM) loss might give smaller misclassification errors on the test set compared to the logistic loss (i.e. offer better generality). In this paper, we study and compare four different loss functions for deep CNNs in the context of computer-aided abdominal and mediastinal lymph node detection and diagnosis (CAD) using CT images. Besides the logistic loss, we compare three other CNN losses that have not been previously studied for CAD problems. The experiments confirm that the logistic loss performs the worst among the four losses, and an additional 3% increase in detection rate at 3 false positives/volume can be obtained by just replacing it with Lorenz loss. The free-receiver operating characteristic curves of two of the three loss functions consistently outperform the logistic loss in testing.

Keywords:

• Lymph node detection
• convolutional neural networks
• computer aided diagnosis

Acknowledgements

We thank NVIDIA Corporation for their generous donation of a Tesla K40 GPU in support of this work.

Notes

No potential conflict of interest was reported by the authors.

Additional information

Funding

This research was supported in part by the National Institutes of Health, Clinical Center.