AYIN – Models of spatio-temporal structure for high-resolution image processing

Research directions

    The Ayin team is devoted to the modeling of spatio-temporal structures, for use in the analysis of high-resolution image data, with particular application to images arising in remote sensing, broadly interpreted, and skin care.

    The latest and upcoming generations of imaging sensors, for example, in remote sensing (Pleiades, EnMAP, Sentinel) and medicine (Philips, Christie Medical), result in large volumes of heterogeneous data with high spatial, spectral, and temporal resolution. High resolution imagery (this may refer to spatial, spectral, or temporal resolutions) is a rich source of information about the imaged scene, information that is unavailable in lower resolution data. In particular, spatial and spatio-temporal structures abound, and frequently constitute the information of greatest interest in practice. As a result, such imagery is vital to advances in a range of applications (urban monitoring, precision agriculture, skin disease diagnosis, etc.). The high resolution and high volume of the imagery presents new challenges, however, that must be overcome if the potential of the data is to be realized. Extracting the available information requires the development of new modeling techniques adapted to the nature and profusion of structures, and the design of corresponding algorithms, which must in turn be implemented in a time- and space-efficient way if the techniques are to be made operational.

    The overall scientific objective of the Ayin team is precisely to advance the state of theory and practice in this area by the development of such modeling techniques and the design of such algorithms. We make use of a variety of methodologies in order to achieve this goal, taking a broadly Bayesian point of view. This point of view suggests dividing the modeling task into two parts: modeling of the scene, ie describing the scenes to be expected in any given application; and modeling of the image, ie describing the images to be expected from any given scene. Ayin focuses on spatio-, spatio-temporal, and spectral structure, leading to the modeling of geometrical properties on the one hand, and large, coherent structures in images and image sequences on the other. The new models also require new algorithms, for dealing with the nuisance parameters they contain, and for extracting the desired information. This forms a third major component of Ayin’s research. The models and algorithms are developed in parallel with their application to information extraction from very high resolution images, in particular data arising in remote sensing and skin care.


  • Remote sensing image analysis
  • Skincare imaging