Do you actually have to steal the hammer ? I didn't tryh it, but would guess that if you steal anything from Raphaël's house (like the giant strength gloves) and try to leave, you'll have to fight him.