Raze suggests borrowing money when you're ready to the Divine Ritual - Patrick can't bother you then.
No XP for borrowing/repaying was my xp <img src="/ubbthreads/images/graemlins/winkwink.gif" alt="" />
Not sure about broken quest: You need him later on for an armour... I'd experiment this after you've got that armour - just to be on the safe side.
Kiya
I borrowed for fun, but repaid in time.