single hand comunication for stroke patients

Hello I am working on my fyp for single hand comunication for stroke patients, who will comunicate to people through hand gesture when a patient performs a gesture in front of camera. camera capture the gesture, If a gesture matches the database, alert message is shown on an android app . Thats what patient want what they need? I send message from MATLAB on Android app ? if gesture match the database a alert message will send the patient family member that why I am making a android app to send notification what they want like they want eat something etc ...same as like iot based app when a lights of the room on. a notification send on Android app. but I will work on MATLAB to train the gestures .and use android app to send the notification .how doi connect these two softwares .I hope u will understand my project. what kinfd of tecniques I use to detect the gestures. How do I start the project ? What are the key steps? I feel ambiguous. Can you explain?