Projects

An approach that augments LLM-based robot programming with expert-informed motion-level critics that analyze execution traces for safety violations, surface transparent feedback, and offer one-click fixes.

System that generates hierarchical robot task plans from natural language and lets users iteratively refine them through re-prompting and explicit correction, validating in simulation before execution.

Block-based scaffolding system that helps non-expert users express task intent for robot programming.

iPad AR budgeting probe using a CreateML model trained to detect bills from a camera capture. Detected bills populate an editable panel, and instructions are read aloud with Google Text-to-Speech on tap. One of three probes studying how adults with Down syndrome manage money.

Robot Programming Interface in AR for Novice Programmers

Custom VR headset designed to accommodate people with visual impairments.