Sorry to bring this back from, wow has it been that long?
Anyway, I saw a neat thing years ago regarding a game (can't even remember what it was) where the phones were used as the controls and it had a first person view in 3D, a center screen (monitor/TV) with a sky camera 2D view, and a bunch of players around it. Games would need to be local but it was interesting to say the least.
That might not have been exactly how it was but how I wanted it to work. I also can't seem to search for it because I get hit with the sea of blogspam and other things about using your phone as a controller in general.
Obviously extremely unlikely as it would require an
android port, and a 3D mode. But I always thought it was a neat idea.