Computational Semiotics: an analogy with Computational Linguistics?

===================================================================

Andrew Salway, University of Surrey

-----------------------------------

This paper considers whether the disciplines of semiotics and computing

science can enjoy a symbiotic relationship analogous to that shared by

linguistics and computing science under the rubric of computational

linguistics. If there is potential in 'computational semiotics' then

perhaps it will provide a framework for processing multimedia data in

machines, like that provided by theories and descriptions of language for

processing textual information.

If semiotics is the 'science of signs' then can it provide theories,

classifications and descriptions formal enough for the automated processing

of multimedia data, particularly for composite signals and for the

management of user interactions? (Linguistics provides lexical,

morphological, syntactic and semantic rules that can all be automatically

processed by a machine).

A brief overview of semiotics highlights the place of linguistics within

its parent discipline and attempts to summarise what semiotics promises and

what it currently offers for multimedia computing. We go on to review

recent papers from prominent computing science journals and conferences

that have suggested various ways in which semiotics can contribute to

multimedia computing. Finally we discuss some of the issues raised with

respect to research at Surrey that has focussed on the development of

multimedia systems for dance, for fine art and for crime scene images.