Multimodal Sequence

A multimodal sequence can refer to several things in VR.

1. It may refer to a communication system that seamlessly switches from one mode of communication to another as they become available – Wi-Fi to Wi-Max to 3G, to ADSL – seamlessly in the background without disturbing the user's experience, choosing whichever technologies offer the best bandwidth at the time.

2. It may refer to a type of Natural User Interface or NUI in which multiple interface types are combined – gestures, touch, eye movement, voice, etcetera – to create a single interface.

In this type of interface, a command is given to the system as a series of separate actions by the user. Perhaps a touch command to start, followed by a voice command to modify, or a vocal command to start followed by a gesture to modify.

The first command opens up an invisible interface within the system, of which the user is not consciously aware. This interface recognises the first action as a possible command action, and awaits one of a list of other actions which will tell it how to perform the command.

An example might be tapping a surface in a virtual environment, saying the word 'colour' out loud, then using a gesture to select the colour desired from a colour wheel. The result is the simu8lation painting that surface in that colour.

The advantage of a multimodal sequence, is that if the first of the commands was not really a command – say the user was just tapping a virtual wall with no wish to change it – then if a valid secondary command is not forthcoming immediately, the system recognises the first action was not a command and quietly drops it.

Such sequences as commands rather than individual natural gestures, speech or touch as commands offer a layer of security against user frustration, as they cannot accidentally trigger a change in the system with their natural expression. Changes follow naturally and intuitively, but are very hard to complete by accident.

See Also: Multimodal Sequence Navigation, Gesture Sequence, Touch Sequence, Biometric, Natural User Interface, Voice Control

Below, we offer a selection of links from our resource databases which may match this term.

Gesture Sequence Gesture Sequence Navigation

Multimodal Sequence Multimodal Sequence Navigation

Touch Sequence Touch Sequence Navigation

Results by page [1]   [2]   

Animation: Gait and movement differs according to wealth
A look at using a pool of sequence files and the socio-economic status of an NPC, to create a set of sequence files for their avatar that makes their behaviour both unique and believable.

Swift MoCap Sequence Retrieval
A better way has been developed for premade MoCap summoning. A method that uses general limb movements to call up the closest matching MoCap file.

Lawnmower Man
Created in 1992 during the height of the first great public VR hype, Lawnmower Man is a little on the hammy side, but is that rarest of rare things: A sci-fi film that has done its homework. Every VR sequence, all the VR hardware is directly based on actual capabilities of the time, and nothing is done that could not be done from a VR and interfacing standpoint.

Large Image Display: Animatrix: The Second Renaissance: Zooming into the Machine
This single still is from the widescreen version of ?The Second Renaissance?, one of the Animatrix animated shorts. The full sequence encapsulates the id's version of the capabilities of VR, rather well.

Results by page