Nah I think it's gonna be a success; we're just the wrong type of gamers.
M$ wants to steal customers from Apple TV and the tablet market, and they might have success with better integration with the TV. TV. TV. TV. TV... TV.
Also Xbox'es have a great record of actually being quite nice little machines once they get hacked or jailbroken, maybe something nice can come out of that.