Just owning a horse like in Oblivion would be nice. Though I think you should be able to attack sitting on it.

I am in blood
Stepp'd in so far, that, should I wade no more,
Returning were as tedious as go o'er.