Natural User Interface

From NUI Group Community Wiki

Jump to: navigation, search

Contents

Overview

Wikipedia Article: http://en.wikipedia.org/wiki/Natural_User_Interface

Natural user interface, or NUI, is an emerging paradigm shift in man machine interaction of computer interfaces to refer to a user interface that is effectively invisible, or becomes invisible with successive learned interactions, to its users. The word natural is used because most computer interfaces use artificial control devices whose operation has to be learned. A NUI relies on a user being able to carry out relatively natural motions, movements or gestures that they quickly discover control the computer application or manipulate the on-screen content.

Focuses on traditional human abilities such as touch, vision, speech, handwriting, motion and more importantly higher level processes such as cognition, creativity and exploration. Through its study to replicate real world environments and thus situations utilizing emerging technological abilities and sensing solutions which will allow for more accurate and optimized interaction between physical and digital objects.

Quotes

"As technology becomes invisible at all such levels, from a perceptual and cognitive point of view, interaction becomes completely natural and spontaneous. It is a kind of magic. One of the characteristics of a successful natural interface is thus the reduction of cognitive load on people interacting with it. "

15, 16: NUI Chart
15, 16: NUI Chart
   * unthinking; prompted by (or as if by) instinct;
   * to vast a problem not to be solved by a single company, group or persons but through social revolution.
   * direct manipulation, object oriented


Related Keywords and Fields

  • Open Source
  • Cognitive Science
  • Human Computer Interaction
  • Computer Vision
  • Linguistics
  • Multi-Touch
  • Design (...)
  • Artificial Intelligence
  • Brain Hacks
  • Human Factors
  • Interaction Design
  • Usability
  • Information Visualization
  • DIY (Do it yourself)
  • DIT (Do it together)
  • Psychology
  • Philosophy
  • Physics
  • Natural Computation (http://en.wikipedia.org/wiki/Natural_computation)


Notes

Natural User Interface (NUI) is the next metaphysical paradigm shift in man machine interaction (MMI) also known as human computer interaction (HCI). Beginning with the Command Line Interface (CLI) and followed by the Graphical User Interface (GUI), we are now in the midst of discovering the next phase of a more organic interfaes which are based on more traditional human interaction paradigms such as touch, vision, speech and most importantly creativity.

As a science; NUI aims to research and investigate models and computational techniques inspired by nature and, dually, attempts to understand the world around us in terms of information processing and interaction modeling. Through its study we aim to replicate real world environments and thus situations utilizing emerging technological abilities and sensing technologies which will allow for more accurate and optimized interaction between physical and digital objects.

"Natural interaction is defined in terms of experience: People naturally communicate through gestures, expressions, movements, and discover the world by looking around and manipulating physical objects; the key assumption here is that they should be allowed to interact with technology as they are used to interact with the real world in everyday life, as evolution and education taught them to do. In addition to the traditional features of interactive digital media, like updatability, freedom of users’ to follow their curiosity and interests, natural user interfaces feature a new architectural aesthetics about how to move computation to the real world, creating immersive experiences that involve people senses in the physical space."

As technology becomes invisible at all such levels, from a perceptual and cognitive point of view, interaction becomes completely natural and spontaneous. It is a kind of magic. One of the characteristics of a successful natural interface is thus the reduction of cognitive load on people interacting with it. (natural interaction)

See Moore's law and apply same concept to sensors instead of transistors on a circuit.

With the advance of speech, image and video technology, human-computer interaction (HCI) will reach a new phase. In recent years, HCI has been extended to human-machine communication (HMC). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication.

Natural user interfaces can include sound, touch, gesture, tactile inputs and outputs and are really about making the most efficient use of the human senses when interacting with machines.

The goal is to make computing and technology simple to use, everywhere around us, accessible to people with minimal technical expertise, reliable and more intuitive. Computing has shifted from one computer, many users (e.g. mainframe computing) to one person, one computer (e.g. PCs) to the future of ubiquitous computing, where it will be one person, many computers.

These techniques are based upon underlying theories of vision, cognition, and perception

The ability to enable a user with control over the tool/interface is an essential component of the HCI interaction. Rather than leaving users with a feeling that they are slaves to a technology, users should have feelings of control and mastery over an interface. Shneiderman (1983) explained the central ideas of user control, which include:

   * Visibility of Object and Actions
   * Rapid, reversible, incremental actions
   * Replacement of complex command-language syntax with direct, visual manipulation of the object of interest.
  • Voice recognition
  • Finger identification
  • Gaze vector
  • Facial expression
  • Handheld device movement
  • Biometrics (body temp, heart rate, skin impedance, pupil size)

As Bill Gates said: Touch, Voice, Vision...

Community

Natural User Interface Group was founded in July 2006 by Christian Moore (nuigroup.com/nuiinc.com) and is the largest online (~8000) open source community related to the open study and Natural User Interfaces. The community was an initiative from Christian Moore with initial online members consisting of: David Wallin (touchlib.com), Johan Bakken (styleboost.com), Pawel Solyga, Tom Juby and others. Working under the philosophy that NUI technologies will be a tremendous problem facing mankind Christian focused the Group on an "open source interface" initiative which has quickly gathered momentum due to surface computing solutions driven by Perceptive Pixel, Apple iPhone, Microsoft Surface and related products.

Initially starting as a title of collection of research papers and quickly realizing the need for open discussion due to the complexity of the topics Christian Moore arrange a online community that allowed for quick development and sharing of software/hardware. A main goal is to provide and foster open source projects that allow for the exploration of emerging human sensing technologies. (nuigroup.com/forums)

The ~ logo was designed by openartist and nuiman in June 2007 and applied to the website that same month. Touchlib was first flagship project developed by NUI Group community and founded by David Wallin (whitenoise) and Christian Moore (nuiman)

Community Members

Who's who page

Applications

Languages

AS3, C/C++/C#, Java, VVVV, Max

Web

Inspiration

Publications

Community Book - Multitouch Technologies

Related

Natural User Interface, Inc. was founded in 2005 as a small software development firm which shifted focus to the growth of NUI Group since it was went online in Nov 2006. In 2009 the Natural User Interface Group Foundation was established.

Related Products

  • Apple Iphone
  • Microsoft Surface
  • Microsoft Natal
  • Microsoft Roundtable
  • Microsoft Windows 7
  • Amazon Kindle
  • Reactable
  • Pulse Pen
  • Nintendo Wii

Companies

http://wiki.nuigroup.com/Multitouch_Business_Directory

External Links

(Articles containing the term "natural user interface")

Research

Misc.

Patents

Presentations/Speeches


Press