Perhaps think of it as lost opportunity, instead. More money often provides for more opportunity.

I think it is very natural to preemptively feel sorrow for some of the opportunities you will give up when you die.