FPN-D-Based Driver Smoking Behavior Detection Method

Figures & data

Figure 1: The FPN structure

Figure 2: An example showing the comparison between ordinary convolution and dilated convolution

Figure 3: Structure diagram of FPN-D

Figure 4: Schematic for the details of the addition process

Figure 5: Driver image before (left) and after (right) cropping

Table 1: Detailed structure of the network

Layer	Input size	Output size	Hyper parameter
Conv1	400 × 400,3	400 × 400,32	32,3 × 3,1
MaxPooling1	400 × 400,32	200 × 200,32	2 × 2,2
Conv2	200 × 200,32	200 × 200,32	32,3 × 3,1
MaxPooling2	200 × 200,32	100 × 100,32	2 × 2,2
Conv3	100 × 100,32	100 × 100,64	64,3 × 3,1
MaxPooling3	100 × 100,64	50 × 50,64	2 × 2,2
Conv4	50 × 50,64	50 × 50,64	64,3 × 3,1
MaxPooling4	50 × 50,64	25 × 25,64	2 × 2,2
Conv5	25 × 25,64	25 × 25,64	64,3 × 3,1
UpSampling1	25 × 25,64	50 × 50,64	2 × 2
Conv6	50 × 50,64	50 × 50,64	64,1 × 1,1
Add1	50 × 50,64 50 × 50,64	50 × 50,64	–
UpSampling2	50 × 50,64	100 × 100,64	2 × 2
Conv7	100 × 100,32	100 × 100,64	64,1 × 1,1
Add2	100 × 100,64 100 × 100,64	100 × 100,64	–
Conv8	100 × 100,64	98 × 98,64	64,3 × 3,1
MaxPooling5	98 × 98,64	49 × 49,64	2 × 2,2
D-conv Operation	49 × 49,64	49 × 49,64	64,3 × 3,1,rate = 1,2,3
Conv9	49 × 49,64	47 × 47,32	32,3 × 3,1
MaxPooling6	47 × 47,32	23 × 23,32	2 × 2,2
FC1	–	–	64
FC2	–	–	64
output	–	–	1

Table 2: Confusion matrix

	Predictive 1	Predictive 0	Total
Actual 1 (P)	TP	FN	TP + FN
Actual 0 (N)	FP	TN	FP + TN
Total	TP + FP	FN + TN	TP + FN + FP + TN

Figure 6: Plot showing the accuracy rate obtained by applying different network structure training to the dataset

Figure 7: Plot showing the loss value for the validation set for the different network structure training

Figure 8: ROC curves for different methods

Table 3: Values of the performance of different methods

Method	Accuracy	Recall	Specificity	Precision
VGG	81	68.50	93.50	91.33
ResNet50	82.5	67.50	96	94.41
FPN	87.50	79.50	95.50	94.64
FPN-D	94.75	96	95	95.05

Table 4: AUC and CI values for the different methods

Method	AUC	CI
VGG	80.90 (0.023)	[76.5, 85.4]
ResNet50	82.70 (0.022)	[78.4, 87]
FPN	87.40 (0.019)	[83.7, 91.2]
FPN-D	95.50 (0.012)	[93.1, 97.8]

Figure 9: Test images of drivers smoking