5PMSMMM3 : Multimedia, Multimodality, Multisensoriality Indexation Multimédia - WPMTMMM3

Goal(s)

The aim is to build a panorama of the contemporary sciences and technologies that focus/target human sensori-motricity, including research aspects.

Multimedia indexing and information retrieval:
Understand the fundamentals of multimedia information retrieval: the economic challenges, the current state of technology (computer vision, speech processing, data fusion, statistical learning) and the scientific challenges for the future.

Multisensory and multimodal interaction :
Approach the state of the arts of multi sensory interaction systems (gesture, including force feedback, audio, visuals, virtual realities).

Content(s)

Multimedia indexing and information retrieval :

• introductory session
• a few sessions with a "conference" format, by specialists of information retrieval

Multisensory and multimodal interaction:

• introductory session
• practical sessions on various technological platforms, equipped with multisensory workstations.

Basic knowledge of signal and image processing and data analysis.
Basic knowledge in transduction, real time signal processing, OS, concurrent programming.