If you do smething against the rules of a guild you get expelled of this guild. The first time you can speak to certain persons to restore your reputation within this guild, the secon time you commit a crime against this special guild you will be expelled forever.
However even if you´re expelled forever you still see the guild within your stats menu. there is no way, except for cheating to really leave a guild once joined.
