The EyesWeb system (www.eyesweb.org) is an open platform for real-time multimodal processing. It has now reached a mature stage, and is being used both for research in multimodal interfaces and for applications such as naturally interacting systems for museum exhibits, performing arts, therapy and rehabilitation. This paper presents the latest development concerning audio processing in EyesWeb with a special focus on multimodal processing. The integrated audio processing support includes modules for the analysis and synthesis of audio streams, for musical processing through the MIDI protocol, and for interoperability with other audio processing platforms, technologies and standards. Advanced real-time audio support for the mapping of multimodal input into multimedia output is described in the paper.

Audio processing in a multimodal framework

DRIOLI, Carlo;
2005-01-01

Abstract

The EyesWeb system (www.eyesweb.org) is an open platform for real-time multimodal processing. It has now reached a mature stage, and is being used both for research in multimodal interfaces and for applications such as naturally interacting systems for museum exhibits, performing arts, therapy and rehabilitation. This paper presents the latest development concerning audio processing in EyesWeb with a special focus on multimodal processing. The integrated audio processing support includes modules for the analysis and synthesis of audio streams, for musical processing through the MIDI protocol, and for interoperability with other audio processing platforms, technologies and standards. Advanced real-time audio support for the mapping of multimodal input into multimedia output is described in the paper.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11390/696197
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? ND
social impact