Design protocol analysis is a technique to understand designers’ cognitive processes by analyzing sequences of observations on their behavior. These observations typically use audio, video, and transcript data in order to gain insights into the designer’s behavior and the design process. The recent availability of sophisticated sensing technology has made such data highly multimodal, requiring more ﬂexible protocol analysis tools. To address this need, we present VizScribe, a visual analytics framework that employs multiple coordinated multiple views that enable the viewing of such data from diﬀerent perspectives. VizScribe allows designers to create, customize, and extend interactive visualizations for design protocol data such as video, transcripts, sketches, sensor data, and user logs. User studies where design researchers used VizScribe for protocol analysis indicated that the linked views and interactive navigation oﬀered by VizScribe aﬀorded the researchers multiple, useful ways to approach and interpret such multimodal data.
Chandrasegaran, S., Badam, S. K., Kisselburgh, L., Peppler, K., Elmqvist, N., and Ramani, K.
VizScribe: A visual analytics approach to understand designer behavior
International Journal of Human-Computer Studies, 100, April 2017, pp. 66 -- 80.