There is something to be done here by combining this with a Kinect or by by finding a way to point a camera at where the user is looking and going the Augmented Reality way.

I have to admit I'm a little turned off by the way those big players are only symbolically endorsing it but might very well get myself a dev kit anyways.