Introducing MS PixelSense Technology


Surface..Surface..Surface. Every where you can see this. The biggest game changer from MS with Windows 8, Metro and all other great stuff.

But wait, we heard of surface computing from MS. A huge table which can do amazing stuff. I wrote an article about how to develop Surface computing applications as well. Here’s the link.

So what happened to that Samsung SUR 40 and other Surface computing devices ? because now every body talks about the surface of this.

The answer is available in the same link. Just scroll down and look at the bottom left corner of the above link. There you get PixelSense  and the link to visit the PixelSense web page.

They did it very silently because very few were aware of the surface computing which is now the PixelSense. I don’t know why they chose the name ‘surface’ for the metro devices, but they finalized it and changed the old surface into PixelSense.

I don’t know whether there was a public announcement about this change in the name, but they did it. So now I can say myself as PixelSense developer. 😀 cool…


Programming Microsoft Surface

This post contains some high resolution images, please wait till all the images are loaded and click on them to enlarge.

Microsoft Surface computing is awesome and for me the business strategy behind the scenes are very very awesome. Microsoft released surface computer and very limited set people are using it right now. Because it is expensive and needs rich infrastructure as well. But in the business point of view MS released surface because surface computing needs lot of innovation from the hardware vendors. The first release was a big bulk desk, and the second release of Samsung SUR 40 it is slim; just 4 inches. So in the future it will be like a paper and the real surface. So when the world is really ready for the surface, the real surface will also be ready.



The world is not yet ready for the surface, so as the surface computing. So MS took the above strategy to make the surface mature and available when really the majority of the world is matured to have the surface.

Surface computing provides a software platform as like other devices of the IT industry. The surface software platform is built on top of WPF. It also includes the Power Shell administration.

To develop surface applications we do not need to have a surface computer. 🙂 You can develop and test the applications in your PC like you develop the WPF applications. To do this you have to install Surface SDK and the Surface runtime in your machine.You can download the Surface SDK (still in beta) from here

Once you installed them you will have surface application template in Visual Studio.


It offers surface type controls and you can do the programming with that. Some built in controls are really cool. UI is defined using XAML.

A sample application to view pictures and to arrange them in two stacks with a floating interface would be like this.

Note :

Surface computer is a very powerful hardware device. It has infrared sensors in built which can detect the objects placed on it and capable of connecting with them.

It is capable to take 52 touch inputs with pressure at a time. (In the future this may increase). If you consider a person dealing with the surface computer with all his fingers, it can still handle 5.2 people at a time. Mostly we use 2 points. So in a best scenario 26 people can interact with it. And all the touches are measured with the pressure.

When we develop our applications in the machine, we don’t need a touch enabled screen. But if you have a 2 point touch enabled screen it will be nice. (You can resize images, videos and more …) And another major limitation is, most of the PC monitors or laptops which are touch enabled detect the point of a touch. They cannot detect the pressure. SDK provides events and methods we can use with the pressure.

So when we do development in a PC we can neither check those hardware specific methods nor object detection.

But still we can have fun.

This is a sample code shows how you can create movable items in the surface. These are free moving and 2 point resizable objects.

ScatterView is the XMAL snippet for creating this free floating objects.

(Click the image to view the enlarged code)


As you can see the code is simple XAML , and we can place any number of and any type of controls inside the scatter view. I have used media element controls to put videos and Image tags to put images inside the ScatterView.

The transforms and the other settings are optional.

This single line create a multi touch enabled drawing panel. (Margins are optional)


I created a drawing board embedded with n image where we can color the image. (See how it works in action)


In the above image you can see the disadvantage of the point touch. I can draw thin lines (point lines)  since my laptop touch screen is not pressure sensitive. In the real surface you can draw with the thickness of your own finger which gives a real drawing experience. You can also adjust the thickness programmatically.

I tried something more with surface SDK with mixing the scatter view with traditional WPF features and created a stunning floatable windows in the desktop. Where you see only objects no any windows and cross overlaps on each other. It is bit advance and I didn’t explain the code here, but some images are given below.  Enjoy 🙂

Sorry for the white marks on the image and taskbar as I have to hide some files and programs.

Floating objects in desktop. (As you see three of them are media players and two image viewers)


They are completely independent and the coolest feature is they are not windows. They act as objects in separate frames. The below images show that, see how I’m interacting with the desktop while they are floating on the desktop.

This picture shows that I’m interacting with the desktop. I’m hovering on a file which is partially covered by one of the floating object, but still I can get the description of the file.


Here I’m interacting with the task bar and the start button.


Other than this surface SDK offers plenty of nice tools like StackLibrary and Containers. Flexible surface is another feature which creates a water like surface. When touch or click on the screen you can experience ripples.

I’ll try to put a video, I still do not have a YouTube account. 😛