I have to agree with Gary, that most come back. At least I have, many times over the last 30 yrs.
There are times when other priorities are just more important, as mentioned a few times in this thread. I have also found that many aquarists, {including myself}, find out that larger is not always better and downsize. Going large also frustrates some to the point of leaving the hobby.