Skip navigation

Marked Point Processes for Object Detection and Tracking in High Resolution Images: Applications To Remote Sensing and Biology

Event Date: September 21, 2018
Speaker: Professor Josiane Zerubia
Speaker Affiliation: INRIA, France
Time: 3:00 pm
Location: EE 317
Priority: No
School or Program: Electrical and Computer Engineering
College Calendar: Show

Professor Josiane Zerubia
INRIA, France

In this talk, we combine the methods from probability theory and stochastic geometry to put forward new solutions to the multiple object detection and tracking problem in high resolution remotely sensed image sequences.  First, we present a spatial marked point process model to detect a pre-defined class of objects based on their visual and geometric characteristics.  Then, we extend this model to the temporal domain and create a frame work based on spatiotemporal marked point process models to jointly detect and track multiple objects in image sequences.  We propose the use of simple parametric shapes to describe the appearance of these objects.  We build new, dedicated energy based models consisting of several terms that take into account both the image evidence and physical constraints such as object dynamics, track persistence and mutual exclusion.  We construct a suitable optimization scheme that allows us to find strong local minima of the proposed highly non-convex energy.  As the simulation of such models comes with a high computational cost, we turn our attention to the recent filter implementations for multiple objects tracking, which are known to be less computationally expensive.  We propose a hybrid sampler by combining the Kalman filter with the standard Reversible Jump MCMC.  High performance computing techniques are also used to increase the computational efficiency of our method.  We provide an analysis of the proposed framework.  This analysis yields a very good detection and tracking performance at the price of an increased complexity of the models.  Tests have been conducted both on high resolution satellite and microscopy image sequences.

Josiane Zerubia has been a permanent research scientist at INRIA since 1989 and director of research since July 1995 (DR 1st class since 2002).  She was head of the PASTIS remote sensing laboratory (INRIA Sophia-Antipolis) from mid-1995 to 1997 and of the Ariana research group (INRIA/CNRS/University of Nice), which worked on inverse problems in remote sensing and biological imaging, from 1998 to 2011.  From 2012 to 2016, she was head of Ayin research group (INRIA-SAM) dedicated to models of spatio-temporal structure for high resolution image processing with a focus on remote sensing and skincare imaging.  She has been professor (PR1) at SUPAERO (ISAE) in Toulouse since 1999.  Before that, she was with the Signal and Image Processing Institute of the University of Southern California (USC) in Los-Angeles as a postdoc.  She also worked as a researcher for the LASSY (University of Nice/CNRS) from 1984 to 1988 and in the Research Laboratory of Hewlett Packard in France and in Polo-Alto (CA) from 1982 to 1984.  She received the MSc degree from the Department of Electrical Engineering at ENSIEG, Grenoble, France in 1981, the Doctor of Engineering degree, her PhD and her ‘Habilitation’, in 1986, 1988, and 1994 respectively, all from the University of Nice Sophia-Antipolis, France.

She is a Fellow of the IEEE (2003- ) and IEEE SP Society Distinguished Lecturer (2016-2017).  She was a member of the IEEE IMDSP TC (SP Society) from 1997 till 2003, of the IEEE BISP TC (SP Society) from 2004 till 2012 and of the IVMSP TC (SP Society) from 2008 till 2013.  She was associate editor of IEEE Trans. on IP from 1998 to 2002, area editor of IEEE Trans. on IP from 2003 to 2006, guest co-editor of a special issue of IEEE Trans. on PAMI in 2003; member of the editorial board of IJCV from 2004 till March 2013 and member-at-large of the Board of Governors of the IEEE SP Society from 2002 to 2004.  She will be a member of the senior editorial board of the IEEE Signal Processing Magazine from September 2018 to August 2021.

Her main research interest is in image processing using probabilistic models.  She also works on parameter estimation, statistical learning and optimization techniques.

Associate Professor Mary Comer,, 49-43486 
Assistant Professor Aly El Gamal,, 49-62726