A framework for hand gesture analysis and tracking: the case for hands with unusual shapes and movements

Abstract

This document presents a PhD project in computer vision for the student Luciano Walenty Xavier Cejnog, advised by professor Roberto Marcondes Cesar Junior, Computer Science department, Instituto de Matemática e Estatística (IME), Universidade de São Paulo. The main proposal of this PhD is the development of a framework for hand tracking and gesture analysis, using a 3D model able to express non-usual patterns of hand pose. Methods for data acquisiton, learning model parameters, hand tracking/detection in a video and movement analysis will be developed in this context.This PhD is part of the project Hand Tracking for Occupational Therapy, a collaboration between Universidade de São Paulo and University of Surrey, which aims to investigate computer vision methods capable of providing support to occupational therapy exercises in patients with conditions that affect the movement of hands and fingers, e.g. patients recovering from flexor therapy surgery.