parkinsons-disease

We bring gaze-guided task suggestion for assistive robots into longitudinal clinical deployments with people living with ALS, spinal cord injuries or Parkinson’s disease. By tracking how motor degeneration affects egocentric gaze and head coordination over time, we adapt our filtering and visual-language algorithms to tolerate pathological gaze noise such as jitter, saccadic intrusions and fixational drift.

DrGait turns a vision-language model into a clinical planner for video-based gait analysis: instead of judging raw video, it verifies each diagnostic hypothesis with biomechanical measurements from 3D body meshes and 2D poses, and produces an interpretable, evidence-backed report. On the GAVD benchmark it recognizes Parkinsonian gait with 94.1% accuracy, close to human experts (96.1%).

We developed an LLM-based framework that personalizes assistive robots using natural language feedback, significantly reducing the physical and cognitive fatigue associated with traditional methods. Grounded in clinical reasoning, the system translates unstructured user input into safe, deterministic control policies for individuals with profound motor impairments.

This work presents AWARE, a new sensing and AI system that supports accurate and reliable pulmonary function tests (PFT) using commodity smartphones. AWARE uses a smartphone to transmit acoustic signals and reconstructs the profile of human airway based on the analysis of reflected acoustic waves captured from the smartphone’s microphone. The subject’s pulmonary condition is then evaluated by a multi-task learning model to detect airway obstruction and inflammation and identify pulmonary diseases like asthma or COPD.

We present a new technique to mimic an active sonar system with the smartphone’s built-in microphone and speaker, and use this sonar system to evaluate muscle fatigue from the muscle’s surface characteristics that can be measured from the transmitted acoustic signal.

The first work that allows commodity smartphones to be used as a portable spirometer and provide accurate lung function test results on par with clinical-grade spirometers. This is a collaborative work with the Children’s Hospital of Pittsburgh, and could also potentially contribute to in-home evaluation of COVID-19 risks by allowing convenient out-of-clinic lung function evaluation.