There is no repercussion besides not being able to use them for a certain quest. If you need to replenish source points, look around some more and you'll find a source fountain which you can use for unlimited replenishment.