Because I've seen people come and go, and most of the time, they don't remember a thing if they come back.

[Terra, Aqua, Minako...

Ven brings a hand over his heart, wincing.]

And even the people who do remember say they only got their memories back once they came back.