Microsoft PixelSense

Microsoft PixelSense
Official logo for PixelSense
Developer(s) Microsoft, Samsung
Initial release Microsoft Surface 1.0 (April 17[1] 2008)
Stable release

Hardware: Samsung SUR40 with Microsoft PixelSense (2012)

Software: Microsoft Surface 2.0 (2011)
Development status Commercial applications
Operating system

Microsoft Surface 1.0: Windows Vista (32-bit)

Samsung SUR40 with Microsoft PixelSense: Windows 7 Professional for Embedded Systems (64-bit)
Platform

Microsoft Surface 1.0: Microsoft Surface 1.0

Samsung SUR40 with Microsoft PixelSense: Microsoft Surface 2.0
Available in English, Danish, German, Spanish, French, Italian, Korean, Norwegian, Dutch, Swedish
Website www.pixelsense.com

Microsoft PixelSense (formerly called Microsoft Surface) is an interactive surface computing platform that allows one or more people to use and touch real-world objects, and share digital content at the same time. The PixelSense platform consists of software and hardware products that combine vision based multitouch PC hardware, 360-degree multiuser application design, and Windows software to create a natural user interface (NUI).

Overview

Microsoft Surface 1.0, the first version of PixelSense, was announced on May 29, 2007 at the D5 Conference.[2] It shipped to customers in 2008 as an end-to-end solution with Microsoft producing and selling the combined hardware/software platform. It is a 30-inch (76 cm) 4:3 rear projection display (1024×768) with integrated PC and five near-infrared (IR) cameras that can see fingers and objects placed on the display. The display is placed in a horizontal orientation, giving it a table-like appearance. The product and its applications are designed so that several people can approach the display from all sides to simultaneously share and interact with digital content. The cameras’ vision capabilities enable the product to see a near-IR image of what’s placed on the screen, captured at approximately 60 times per second. The Surface platform processing identifies three types of objects touching the screen: fingers, tags, and blobs. Raw vision data is also available and can be used in applications. The device is optimized to recognize 52 simultaneous multitouch points of contact. Microsoft Corporation produced the hardware and software for the Microsoft Surface 1.0 product. Sales of Microsoft Surface 1.0 were discontinued in 2011 in anticipation of the release of the Samsung SUR40 for Microsoft Surface and the Microsoft Surface 2.0 software platform.

Microsoft and Samsung partnered to announce the current version of PixelSense, the Samsung SUR40 for Microsoft Surface (“SUR40”), at the Consumer Electronics Show (CES) in 2011.[3] Samsung began shipping the new SUR40 hardware with the Microsoft Surface 2.0 software platform to customers in early 2012.

The Samsung SUR40 is a 40-inch (102 cm) 16:9 LED backlit LCD display (1920×1080) with integrated PC and PixelSense technology, which replaces the cameras in the previous product. PixelSense technology enables Samsung and Microsoft to reduce the thickness of the product from 22 in (56 cm) to 4 in (10 cm). The size reduction enables the product to be placed horizontally, and adds the capability to be mounted vertically while retaining the ability to recognize fingers, tags, blobs and utilize raw vision data. Samsung produces the hardware and Microsoft produces the software platform for the SUR40.

The product was renamed from "Microsoft Surface" to "Microsoft PixelSense" on June 18, 2012, when Microsoft announced a new unrelated consumer tablet named Microsoft Surface.

Target market

PixelSense is designed primarily for use by commercial customers to use in public settings. People interact with the product using direct touch interactions and by placing objects on the screen. Objects of a specific size and shape, or with tag patterns, can be uniquely identified to initiate a preprogrammed response by the computer. The device does not require the use of a traditional PC mouse or keyboard, and generally does not require training or foreknowledge to operate. Additionally, the system is designed to interact with several people at the same time so that content can be shared without the limitations of a single-user device. These combined characteristics place the Microsoft Surface platform in the category of so-called natural user interface (NUI), the apparent successor to the graphical user interface (GUI) systems popularized in the 1980s and 1990s.

Microsoft states that sales of PixelSense are targeted toward the following industry verticals: retail, media and entertainment, healthcare, financial services, education, and government. PixelSense is available for sale in over 40 countries including: United States, Canada, Austria, Belgium, Denmark, France, Germany, Ireland, Italy, Norway, Netherlands, Qatar, Saudi Arabia, Spain, Sweden, Switzerland, United Arab Emirates (UAE), United Kingdom (UK), Australia, Korea, India, Singapore, Hong Kong.

History

Demonstration using original Microsoft Surface (View in high quality)

The idea for the product was initially conceptualized in 2001 by Steven Bathiche of Microsoft Hardware and Andy Wilson of Microsoft Research.[4]

In October 2001, DJ Kurlander, Michael Kim, Joel Dehlin, Bathiche and Wilson formed a virtual team to bring the idea to the next stage of development.

In 2003, the team presented the idea to the Microsoft Chairman Bill Gates, in a group review. Later, the virtual team was expanded and a prototype nicknamed T1 was produced within a month. The prototype was based on an IKEA table with a hole cut in the top and a sheet of architect vellum used as a diffuser. The team also developed some applications, including pinball, a photo browser, and a video puzzle. Over the next year, Microsoft built more than 85 prototypes. The final hardware design was completed in 2005.

A similar concept was used in the 2002 science fiction movie Minority Report. As noted in the DVD commentary, the director Steven Spielberg stated the concept of the device came from consultation with Microsoft during the making of the movie. One of the film's technology consultant's associates from MIT later joined Microsoft to work on the project.[5]

The technology was unveiled as "Surface" by Microsoft CEO Steve Ballmer on May 30, 2007 at The Wall Street Journal's 'D: All Things Digital' conference in Carlsbad, California.[6] Surface Computing is part of Microsoft's Productivity and Extended Consumer Experiences Group, which is within the Entertainment & Devices division. The first few companies slated to deploy it were Harrah's Entertainment, Starwood Hotels & Resorts Worldwide, T-Mobile and a distributor, International Game Technology.[7]

On April 17, 2008, AT&T became the first retailer to sell the product.[8] In June 2008 Harrah’s Entertainment launched Microsoft Surface at Rio iBar[9] and Disneyland launched it in Tomorrowland, Innoventions Dream Home.[10] On August 13, 2008 Sheraton Hotels introduced it in their hotel lobbies at 5 locations.[11] On September 8, 2008 MSNBC began using it to work with election maps for the 2008 U.S. Presidential Election on air.

On June 18, 2012, a Microsoft tablet of the same name was unveiled, and Surface was rebranded as PixelSense as a result.[12]

Features

Object recognition.

Microsoft notes four main components being important in the PixelSense interface: direct interaction, multi-touch contact, a multi-user experience, and object recognition.

Direct interaction refers to the user's ability to simply reach out and touch the interface of an application in order to interact with it, without the need for a mouse or keyboard. Multi-touch contact refers to the ability to have multiple contact points with an interface, unlike with a mouse, where there is only one cursor. Multi-user experience is a benefit of multi-touch: several people can orient themselves on different sides of the surface to interact with an application simultaneously. Object recognition refers to the device's ability to recognize the presence and orientation of tagged objects placed on top of it.

The technology allows non-digital objects to be used as input devices. In one example, a normal paint brush was used to create a digital painting in the software.[13] This is made possible by the fact that, in using cameras for input, the system does not rely on restrictive properties required of conventional touchscreen or touchpad devices such as the capacitance, electrical resistance, or temperature of the tool used (see Touchscreen).

In the old technology, the computer's "vision" was created by a near-infrared, 850-nanometer-wavelength LED light source aimed at the surface. When an object touched the tabletop, the light was reflected to multiple infrared cameras with a net resolution of 1024×768, allowing it to sense, and react to items touching the tabletop.

The system ships with basic applications, including photos, music, virtual concierge, and games, that can be customized for the customers.[14]

A feature that comes preinstalled is the "Attract" application, an image of water with leaves and rocks within it. By touching the screen, users can create ripples in the water, much like a real stream. Additionally, the pressure of touch alters the size of the ripple created, and objects placed into the water create a barrier that ripples bounce off, just as they would in a real pond.

The technology used in newer devices allows recognition of fingers, tag, blob, raw data, and objects that are placed on the screen, allowing vision-based interaction without the use of cameras. Sensors in the individual pixels in the display register what is touching the screen.

Hardware specifications

Microsoft Surface 1.0

Samsung SUR40 with Microsoft PixelSense

Applications development

Microsoft provides the free Microsoft Surface 2.0 Software Development Kit (SDK) for developers to create NUI touch applications for devices with PixelSense and Windows 7 touch PCs.

Applications for PixelSense can be written in Windows Presentation Foundation or XNA. The development process is much like normal Windows 7 development, but custom WPF controls had to be created due to the unique interface of the system. Developers already proficient in WPF can utilize the SDK to write applications for PixelSense for deployments for the large hotels, casinos, and restaurants.[15]

Related Microsoft research projects

Microsoft Research has published information about a related technology dubbed SecondLight.[16] Still in the research phase,[17] this project augments secondary images onto physical objects on or above the main display.

See also

References

  1. ↑ AT&T First to Introduce Microsoft Surface in Retail Stores to Enhance Mobile Shopping Experience: First commercial Microsoft Surface launch to begin April 17 in select AT&T stores with expanded deployment planned throughout 2008
  2. ↑ "cnet01". "Bumps on the road to Microsoft's Surface". C-Net. Retrieved 2007-11-08.
  3. ↑ Microsoft and Samsung unveil SUR40, the 'Surface 2.0 Experience' you still can't buy (video) – Engadget
  4. ↑ "Microsoft Surface Fact History". Microsoft. Retrieved 2007-05-30.
  5. ↑ Correction: “The Island” did NOT feature a Surface – istartedsomething
  6. ↑ "Look What's Surfacing at Microsoft" (Press release). Microsoft. 2007-05-29. Retrieved 2007-05-30.
  7. ↑ "Microsoft Launches New Product Category: Surface Computing Comes to Life in Restaurants, Hotels, Retail Locations and Casino Resorts" (Press release). Microsoft. 2007-05-29. Retrieved 2007-05-30.
  8. ↑ Microsoft Surface Now in AT&T Stores
  9. ↑ Harrah’s Entertainment Launches Microsoft Surface at Rio iBar, Providing Guests With Innovative and Immersive New Entertainment Experiences
  10. ↑ Disney's Innoventions Dream Home is a Big Ad For Microsoft and HP...But I Still Want It
  11. ↑ http://www.microsoft.com/Presspass/press/2008/aug08/08-13SheratonMSSurfacePR.mspx Sheraton Hotels & Resorts Transforms the Hotel Lobby Experience With Microsoft Surface
  12. ↑ Microsoft rebrands original Surface table-based touchscreen as PixelSense, theverge.com
  13. ↑ Bishop, Todd (2007-05-29). "Microsoft Surface brings computing to the table". Seattle Post-Intelligencer. Retrieved 2007-05-30.
  14. ↑ "Microsoft Surface Fact Sheet". Microsoft. Retrieved 2007-05-30.
  15. ↑ What lurks below Microsoft's Surface? A brief Q&A with Microsoft
  16. ↑ Hands-On Computing – Microsoft Research
  17. ↑ Clearing up the confusion on future Microsoft Surface

External links

Wikimedia Commons has media related to Microsoft PixelSense.
This article is issued from Wikipedia - version of the Wednesday, March 30, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.