Development and evaluation of a hand tracker using depth images captured from an overhead perspective

References

• American Psychiatric Association. Diagnostic and statistical manual of mental disorders, DSM-5. 5th ed. Arlington, VA: American Psychiatric Association; 2013
   Google Scholar
• Alzheimer Society of Canada. Rising tide: the impact of dementia on canadian society. Toronto, Ontario: Alzheimer Society of Canada; 2010
   Google Scholar
• Alzheimer's Disease International. World Alzheimer Report 2009. London: UK; 2009
   Google Scholar
• Mihailidis A, Boger J, Craig T, Hoey J. The COACH prompting system to assist older adults with dementia through handwashing: an efficacy study. BMC Geriatr 2008;8:1–18
   Google Scholar
• Czarnuch S, Cohen S, Parameswaran V, Mihailidis A. A real-world deployment of the COACH prompting system. J Ambient Intell Smart Environ 2013;5:463–78
   Google Scholar
• Pollack ME. Autominder: a case study of assistive technology for elders with cognitive impairments. Generations: J Am Soc Aging 2006;30:67–9
   Web of Science ®Google Scholar
• Pollack ME. Intelligent technology for an aging population: the use of AI to assist elders with cognitive impairment. AI Mag 2005;26:9–24
   Web of Science ®Google Scholar
• Liu AL, Hile H, Borriello G, et al. Informing the design of an automated wayfinding system for individuals with cognitive impairments. Proceedings of Pervasive Health'09. London UK; 2009:1–8
   Google Scholar
• Philipose M, Fishkin KP, Perkowitz M, et al. Inferring activities from interactions with objects. IEEE Pervasive Comput 2004;3:50–7
   Web of Science ®Google Scholar
• Bharucha AJ, Anand V, Forlizzi J, et al. Intelligent assistive technology applications to dementia care: current capabilities, limitations, and future challenges. Am J Geriatr Psychiatry 2009;17:88–104
   PubMed Web of Science ®Google Scholar
• Krishnan N, Cook D. Activity recognition on streaming sensor data. Pervasive Mob Comput 2014;20:138–54
   Web of Science ®Google Scholar
• Hoey J, Poupart P, Von Bertoldi A, et al. Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process. Comput Vis Image Und 2010;114:503–19
   Google Scholar
• Shotton J, Fitzgibbon A, Cook M, et al. Real-time human pose recognition in parts from single depth images. Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition, CVPR; 2011. 8 pages
   Google Scholar
• Hoey J, Poupart P, Boutilier C, Mihailidis A. POMDP models for assistive technology. AAAI 2008 Fall Symposium on AI in Eldercare; 2005 Nov 5–7; Arlington
   Google Scholar
• Mihailidis A, Barbenel JC, Fernie G. The efficacy of an intelligent cognitive orthosis to facilitate handwashing by persons with moderate to severe dementia. Neuropsychol Rehab 2004;14:135–71
   Google Scholar
• Mihailidis A. The development of an intelligent cognitive orthosis to facilitate handwashing for persons with moderate-to-severe dementia. Glasgow, Scottland: University of Strathclyde; 2001
   Google Scholar
• Boger J, Poupart P, Hoey J, et al. A decision-theoretic approach to task assistance for persons with dementia. Proc. IEEE International Joint Conference on Artificial Intelligence; Edinburgh; 2005:1293–9
   Google Scholar
• Boger J, Hoey J, Poupart P, et al. A planning system based on Markov decision processes to guide people with dementia through activities of daily living. IEEE Transac Info Tech Biomed 2006;10:323–33
   Google Scholar
• Mihailidis A, Boger J, Canido M, Hoey J. The use of an intelligent prompting system for people with dementia. Interactions 2007;14:34–7
   Google Scholar
• Mihailidis A, Carmichael B, Boger J. The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home. IEEE Transac Inform Technol Biomed 2004;8:238–47
   Google Scholar
• Wilson R, Rochon E, Mihailidis A, et al. Examining effective communication strategies used by formal caregivers when interacting with Alzheimer's disease residents during an activity of daily living (ADL). Brain Lang 2007;103:199–200
   Google Scholar
• Hoey J, von Bertoldi A, Poupart P, Mihailidis A. Assisting persons with dementia during handwashing using a partially observable markov decision process. Proceedings of the 5th International Conference on Computer Vision Systems; Germany; 2007:10
   Google Scholar
• Hoey J. Tracking using flocks of features, with application to assisted hand washing. Proceedings of British Machine Vision Conference; Edinburgh, Scotland; 2006:10
   Google Scholar
• Labelle K, Mihailidis A. Facilitating handwashing in persons with moderate-to-severe dementia: comparing the efficacy of verbal and visual automated prompting. Am J Occup Therap 2006;60:442–50
   Google Scholar
• Czarnuch S, Mihailidis A. The design of intelligent in-home assistive technologies: assessing the needs of older adults with dementia and their caregivers. Gerontechnology 2011;10:165–78
   Google Scholar
• Chan LK, Wu ML. Quality function deployment: a comprehensive review of its concepts and methods. Qual Eng 2002;15:23–35
   Google Scholar
• Hauser JR, Clausing D. The house of quality. Harvard Bus Rev 1988;66:63–73
   Web of Science ®Google Scholar
• Keskin C, Kirac F, Kara YE, Akarun L. Real time hand pose estimation using depth sensors. IEEE International Conference on Computer Vision Workshops (ICCV Workshops); 2011:1228–34
   Google Scholar
• Holt B, Bowden R. Static pose estimation from depth images using random regression forests and Hough voting. 7th International Conference on Computer Vision Theory and Applications (VISAPP'12); 2012
   Google Scholar
• Hernández-Vela A, Zlateva N, Marinov A, et al. Graph cuts optimization for multi-limb human segmentation in depth maps. IEEE Computer Vision and Pattern Recognition (CVPR); Providence, RI; 2012:726–32
   Google Scholar
• Kohli P, Shotton J. Key developments in human pose estimation for kinect. In: Fossati A, Gall J, Grabner H, et al., eds. Consumer depth cameras for computer vision: research topics and applications. London: Springer-Verlag; 2013:63–70
   Google Scholar
• Kolb A, Barth E, Koch R, Larsen R. Time-of-flight cameras in computer graphics. Comput Graph Forum 2010;29:141–59
   Web of Science ®Google Scholar
• Megavannan V, Agarwal B, Venkatesh Babu R. Human action recognition using depth maps. International Conference on Signal Processing and Communications (SPCOM); 2012:1–5
   Google Scholar
• Kanaujia A, Kittens N, Ramanathan N. Part segmentation of visual hull for 3D human pose estimation. IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2013; Portland, OR; 2013:542–9
   Google Scholar
• Oikonomidis I, Kyriazis N, Argyros AA. Efficient model-based 3D tracking of hand articulations using Kinect. British Machine Vision Conference, BMVC 2011; University of Dundee, UK; 2011:101.1–101.11
   Google Scholar
• Cheng L, Kitani KM. Pixel-level hand detection for ego-centric videos. Conference on Computer Vision and Pattern Recognition (CVPR); 2013:3570–7
   Google Scholar
• Suau X, Ruiz-Hidalgo J, Casas JR. Real-time head and hand tracking based on 2.5D data. IEEE Trans Multimedia 2012;14:575–85
   Web of Science ®Google Scholar
• Southwell BJ, Fang G. Human object recognition using colour and depth information from an RGB-D Kinect sensor. Int J Adv Robot Syst 2013;10:171
   Google Scholar
• OpenNI. 2012 December 11. OpenNI Modules. Available from: http://openni.org/Downloads/OpenNIModules.aspx [last accessed 11 Dec 2012]
   Google Scholar
• Lei J, Ren X, Fox D. Fine-Grained kitchen activity recognition using RGB-D. 2012 ACM Conference on Ubiquitous Computing (Ubicomp 2012); New York, NY; 2012:208–11
   Google Scholar
• Sheasby G, Warrell J, Zhang Y, et al. Simultaneous human segmentation, depth and pose estimation via dual decomposition. British Machine Vision Conference, Student Workshop, BMVW; Guildford, UK; 2012:12
   Google Scholar
• University Health Network TRI. UHN Toronto Rehabilitation Institute; 2014. Available from: http://www.uhn.ca/TorontoRehab [last accessed 21 Jan 2014]
   Google Scholar
• Labatut V, Cherifi H. Evaluation of performance measures for classifiers comparions. Ubiquit Comput Commun J 2011;6:21–31
   Google Scholar
• Schuller B, Steidl S, Batliner A. The INTERSPEECH 2009 emotion challenge. 10th Annual Conference of the International Speech Communication Association; Brighton, UK; 2009
   Google Scholar
• Rosenberg A. Classifying skewed data: importance weighting to optimize average recall. INTERSPEECH, International Speech Communication Association; Portland, OR; 2012
   Google Scholar
• Fukunaga K, Hostetler L. The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans Inform Theory 1975;21:32–40
   Web of Science ®Google Scholar
• Girshick R, Shotton J, Kohli P, et al. Efficient regression of general-activity human poses from depth images. IEEE International Conference on Computer Vision (ICCV); Barcelona, Spain; 2011
   Google Scholar
• Kirac F, Kara YE, Akarun L. Hierarchically constrained 3D hand pose estimation using regression forests from single frame depth data. Pattern Recogn Lett 2014;50:91–100
   Google Scholar