View article

Multimodal context-aware computing offers system support that incorporates the environmental, cognitive and computational state of an individual while allowing them to compose inputs and receive outputs across a range of available modalities. Here we present two support planes from our ubiquitous system architecture, entitled Nightingale. These include a multi-modal application framework and context-management and inference approach based on ontologies. In Nightingale the devices in use form a personal area network (PAN) with access to local (PLAN) or remote (PWAN) devices or services as they become available. Our proposed architectural elements aim to simplify multimodal and multi-device interaction, as the proliferation of small personal and inter-connected computing devices increases.