Restrictions are what defines a game. Having a sets of limit and rules that defines your borders and give you a range of action.
Chess is fun because you have to stick to rules and move your pieces accordingly.
Otherwise what you have is not a game but a toy, something somewhat funny to toss around for a bit, but without any defined purpose and any meaningful winning condition.
"Don't do if you don't want to" makes for a damn lousy ruleset.
That's what I was alluding to with the "complete anarchy" thing; it depends where one draws the line. My concern is the tendency of some people to police other people's playing habits, often in a way that is not beneficial. I'm not saying anybody is doing that here, just that I am familiar with that general attitude, hence my caution about applying additional restrictions.
