Callie Y. Kim

Publications

You can also find my articles on my Google Scholar profile.

2026

SHRIMP: Iterative Refinement of Robot Task Plans

Mya Schroder, Yuna Hwang, Callie Y. Kim, Leqian Cheng, Jeffrey Li-cheng Liu, Chenchen Zheng, Xinning He, Bilge Mutlu

UIST 2026, ACM Symposium on User Interface Software and Technology

SHRIMP lets users generate hierarchical robot task plans from natural language and iteratively refine them through re-prompting and explicit correction. Users can validate plans in simulation before executing them on a physical robot. A user study with 35 participants showed improved perceived control and robot transparency.

Robo-Blocks: Generative Scaffolding in End-User Design and Programming of Social Robots

Arissa J. Sato*, Callie Y. Kim*, Nathan Thomas White, Abhinav Maneesh, Yuqing Wang, Hui-Ru Ho, Bilge Mutlu (* equal contribution)

DIS 2026, ACM Designing Interactive Systems Conference

Robo-Blocks is a block-based programming environment that leverages LLMs to give novice robot programmers generative scaffolding, connecting high-level ideas to executable robot behaviors through structured narratives. Through a Research through Design process and deployment with novices, we uncovered user personas and usage patterns for generative scaffolding. We present design insights for integrating generative scaffolding into social-robot programming.

Supporting Money Management among Adults with Down Syndrome: A Multi-Technology Probe Study

Hailey L. Johnson, Heidi Spalitta, Callie Y. Kim, Bilge Mutlu

CHI 2026, ACM Conference on Human Factors in Computing Systems

To understand how adults with Down syndrome manage money and what support they prefer, we designed three cash-based budgeting technology probes: a gamified tablet app, an augmented reality app, and a custom tangible device. Seven adults with Down syndrome used all three probes, revealing modality tradeoffs in engagement, verification, and error recovery. We offer design implications for budgeting technologies that support autonomy without collapsing interdependence.

RoboCritics: Enabling Reliable End-to-End LLM Robot Programming through Expert-Informed Critics

Callie Y. Kim, Nathan Thomas White, Evan He, Frederic Sala, Bilge Mutlu

HRI 2026, ACM/IEEE International Conference on Human-Robot Interaction Honorable Mention Award

RoboCritics augments LLM-based robot programming with expert-informed motion-level critics that analyze execution traces for issues such as collisions and joint speed violations. The critics surface transparent feedback and one-click fixes that keep users in the loop. In a user study with a UR3e robot, RoboCritics reduced safety violations and improved execution quality compared to a baseline LLM interface.

Elements of Robot Morphology: Supporting Designers in Robot Form Exploration

Amy Koike, Serena Ge Guo, Xinning He, Callie Y. Kim, Dakota Sullivan, Bilge Mutlu

HRI 2026, ACM/IEEE International Conference on Human-Robot Interaction

We introduce Elements of Robot Morphology, a framework identifying five fundamental elements of robot form: perception, articulation, end effectors, locomotion, and structure. We operationalize the framework with Morphology Exploration Blocks, a set of tangible blocks for hands-on, collaborative experimentation with robot morphologies. A case study and design workshops show how they support analysis, ideation, reflection, and collaborative robot design.

2025

Bridging Generations using AI-Supported Co-Creative Activities

Callie Y. Kim, Arissa J. Sato, Nathan Thomas White, Hui-Ru Ho, Christine P. Lee, Yuna Hwang, Bilge Mutlu

CHI 2025, ACM Conference on Human Factors in Computing Systems Honorable Mention Award

We studied how AI-supported story creation can foster intergenerational connection through a user study with 29 grandparent-grandchild groups. Grandchildren managed the technical aspects while grandparents contributed creative ideas, with AI structuring the activity and balancing contributions across generations. We offer design implications for integrating AI into intergenerational co-creative activities.

2024

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

Callie Y. Kim*, Christine P. Lee*, Bilge Mutlu (* equal contribution)

HRI 2024, ACM/IEEE International Conference on Human-Robot Interaction

We compared an LLM-powered social robot against text- and voice-based agents in a user study with 32 participants across conversational tasks including choosing, generating, executing, and negotiating. LLM-powered robots elevated expectations for sophisticated non-verbal cues and excelled in connection-building and deliberation, but fell short in logical communication. We provide design implications for robots integrating LLMs and for fine-tuning LLMs for use with robots.