Thank you for trying all of this. I agree with your post and I think it would be a nice way to flesh out custom character personality through his memories. For example, we could have "You remember X" and choose how the character reacted.
Which would be even more interesting is if these choices had a passive effect on behavior/dialogs depending on how much a kind of answer was chosen but maybe that would be too much to work on.