Automatic Processing in Real-Life Image and Video Applications

We investigate methods for texture synthesis and texture re-rendering of indoor room scene images. The goal is to create a photorealistic redesign of interior spaces by replacing surface finishes with a new product based on a single room scene image. Specifically, we focus on automating this process to reduce manual input while enabling high-quality and easy-to-use experience. Publication:

1. [Best Student Paper] J. He, K. Ziga, J. Bagchi, F. Zhu, “CNN Based Parameter Optimization for Texture Synthesis,” Electronic Imaging, Burlingame, CA, USA, Jan 2019.

2. C.-J. Tai, T. Liu, J. Bagchi, F. Zhu, and J. P. Allebach, “Interactive Segmentation For Indoor Scenes,” Electronic Imaging, vol. 2017, no. 10, pp. 51-59, Burlingame, California, USA, Jan 2017.

3. T. Liu, C.-J. Tai, F. Zhu, J. Bagchi, and J. P. Allebach, “Texture re-rendering tool for re-mixing indoor scene images,” Electronic Imaging, vol. 2017, no. 10, pp. 86-92, Burlingame, CA, USA, Jan 2017.

4. K. Ziga, J. Bagchi, J. P. Allebach, and F. Zhu, “Non-parametric texture synthesis using texture classification,” Electronic Imaging, vol. 2017, no. 17, pp. 136-141, Burlingame, CA, USA, Jan 2017.

We investigate the detectin of interaction in videos between two people, namely, a caregiver and an infant. A particular type of action in human interaction known as touch is described, as touch is a key social and emotional signal used by caregivers when interacting with their children. We propose an automatic touch event recognition method to determine the potential time interval when the caregiver touches the infant. and label the touch events based on location of the interaction. Publication:

1. Q. Chen, R. Abu-Zhaya, A. Seidl, F. Zhu, “CNN Based Touch Interaction Detection For Infant Speech Development,” Proceedings of IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR), San Jose, California, USA, Mar 2019. (invited paper)

2. Q. Chen, F. Zhu, “https:doi.org10.1109ICMEW.2018.8551542 Long Term Hand Tracking with Proposal Selection],” Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA, Jul 2018.

3. Q. Chen, H. Li, and R. Abu-Zhaya, A. Seidl, F. Zhu, E. J. Delp, “Touch Event Recognition for Human Interaction,” Electronic Imaging, Vol. 2016, no. 11, pp. 1-6, San Francisco, USA, Jan 2016.