Kinect4FOG: monitoring and improving mobility in people with Parkinson’s using a novel system incorporating the Microsoft Kinect v2

Figures & data

Figure 1. Vertical angle determination.

Figure 2. Horizontal angle determination (note that Kinect sees a mirrored image thus shoulders are reversed).

Figure 3. A view of the prototype system. The two servo motors controlling vertical and horizontal movement are on the left of the image (between the Kinect and lasers).

Figure 4. Graphical user interface for the developed software.

Figure 5. System’s companion smartphone application in action.

Figure 6. Network connection diagram including outgoing and incoming data packets over the internet.

Table 1. Patients participants.

Patient	Gender	Age	Years since diagnosis	FOG daily occurrence
S1	Male	60	9	3
S2^a	Female	54	7	5
S3	Male	77	7.5	5
S4^a	Male	72	18	15
S5	Male	74	8	20
S6^a	Male	73	14	10
S7	Male	70	10	10
S8	Male	72	2	5
S9^a	Female	72	17	10
S10	Male	76	12	5
S11^a	Male	70	10	10
S12	Female	78	0.5	10
S13^a	Male	71	5	5
S14^a	Male	92	2	10
S15	Male	70	8	10
Mean	N/A	72.06	8.66	8.86

^a Indicates those who volunteered to try them system.

Figure 7. A PD patient volunteering to try out the system’s capabilities in detecting FOG. Visual cues are projected on the floor based on his whereabouts.

Table 2. Test subjects’ characteristics (n = 15; 12 males, 3 females).

Question	Strongly agree (%)	Agree (%)	Neither agree nor disagree (%)	Disagree (%)	Strongly disagree (%)
The system would be easy to use.	33.3	46.6	13.3	6.6	0
The system FOG detection was accurate.	20	66.6	13.3	0	0
Auditory cue would also be beneficial to be implemented.	20	46.6	20	13.3	0
The system fall detection was accurate.	53.5	47	0	0	0
I am concerned about my privacy when I use the system at home.	0	0	20	40	40
The overall system was helpful in improving my mobility, especially during a FOG.	26.6	53.3	20	0	0
The visual aid was helpful in increasing my mobility and walking performance.	13.3	86.6	0	0	0
I would use the system in my house.	40	40	20	0	0