Chest X-ray image classification using transfer learning and hyperparameter customization for lung disease diagnosis

Figures & data

Figure 1. Overview of CNN architecture.

Figure 2. CNN based classification.

Figure 3. Transformer encoder.

Figure 4. Vision transformer architecture.

Figure 5. Fine-tuning approach for new dataset.

Figure 6. Overview of the proposed method – CovEnViT model.

Figure 7. The description of implementation the model processing.

Figure 8. Local filter – CovEn block module.

Figure 9. Transfer learning for X-ray.

Table 1. Train and validation dataset.

	Train	Validation	Total
COVID-19	1025	256	1281
Normal	2617	654	3271
Pneumonia-bacterial	2401	600	3001
Pneumonia-viral	1325	331	1656
Total	7368	1841	9209

Table 2. Performance metrics of the different models.

Model	Accuracy (%)	Precision (%)	Recall (%)	Specificity (%)	F1-Score (%)
ViT_B/16	96.38	93.07	93.10	97.12	93.00
Densnet201	95.49	91.15	91.20	96.73	91.17
VGG19	96.14	92.48	92.50	96.82	92.31
Resnet50	95.40	90.90	90.90	96.49	90.92
CovEnViT	96.54	93.28	93.37	97.27	93.27

Figure 10. Evaluation metrics on the validation set using different models.

Figure 11. Confusion matrices were computed using (a) ViT, (b) DenseNet201, (c) VGG19, (d) Resnet50, (e) CovEnViT.

Table 3. Details of classified results of the different models.

Model	Class	Accuracy (%)	Precision (%)	Recall (%)	Specificity (%)	F1_Score (%)
ViT_B/16	COVID-19	99.78	100.0	98.44	100.0	99.21
	Normal	98.59	97.43	98.62	98.57	98.02
	Pneumonia Bacterial	93.86	88.35	93.50	94.04	90.85
	Pneumonia Viral	93.97	87.67	77.34	97.62	82.18
Densnet201	COVID-19	99.73	100.0	98.05	100.0	99.01
	Normal	98.86	97.88	98.93	98.82	98.40
	Pneumonia Bacterial	92.07	87.46	88.33	93.88	87.89
	Pneumonia Viral	91.74	77.71	75.83	95.23	76.76
VGG19	COVID-19	99.78	100.0	98.44	100.0	99.21
	Normal	98.80	97.45	99.24	98.57	98.33
	Pneumonia Bacterial	93.37	86.77	94.00	93.07	90.24
	Pneumonia Viral	93.05	87.18	71.90	97.68	78.81
Resnet50	COVID-19	99.67	100.0	97.66	100.0	98.81
	Normal	98.70	97.30	99.08	98.48	98.18
	Pneumonia Bacterial	92.02	86.36	89.67	93.15	87.98
	Pneumonia Viral	91.69	79.47	72.51	95.89	75.83
CovEnViT	COVID-19	99.78	99.61	98.83	99.94	99.22
	Normal	98.53	96.86	99.08	98.23	97.96
	Pneumonia Bacterial	94.30	89.86	93.00	94.92	91.40
	Pneumonia Viral	94.13	87.54	78.55	97.55	82.80