According to conventional wisdom, your daily latte is the reason your retirement savings aren’t on track. Apparently, if you cut the pricey caffeine, money will flow effortlessly into your retirement accounts.

Spending $5 per day may add up to a lot of money per year—but your coffee-buying habits don’t determine your retirement prospects.

Here’s why you should enjoy your lattes without fearing for your financial future:

Math and Psychology Don’t Always Mix

It’s easy to see why lattes are cited as a financial problem. A daily $5 purchase adds up to $1,825 per year. Anti-latte advice starts with the assumption that you can keep track of the money you are no longer spending.

But it is next to impossible to keep small amounts of money around until they add up to something big. In theory, skipping your daily latte could potentially net you over $1,800 in a year—but for most people, it would just mean you spend the 5-spot on something else, rather than save it.

Related: 6 Things Worth Saving for on Your Path to Retirement

That’s because of a cognitive bias known as the denomination effect, which means you’re more likely to spend a smaller bill and keep a larger one. $5 bills feel like they are worth very little, even though they add up over time.

Savvy Indulgence Works Better Than Austerity

Focusing on the cost of small indulgences can perpetuate the all-or-nothing view of money management. But you don’t have to adopt austerity measures to reach your financial goals. In fact, committing to a financial plan that forces you to cut every indulgence is likely to backfire.

That’s because any small slip-up in your austerity plan can trigger the “what the hell” effect, where you feel like you might as well throw your entire savings plan out the window: “I bought a latte after promising myself no indulgences. What the hell! I may as well get that new tablet I’ve been eyeing.”

Including small indulgences in your financial plan will make it easier for you to stay the course. Your daily cup of joe can help keep retirement savings from feeling like a miserable slog that you might as well rebel against.

Embrace Automation

Latte logic asks you to be proactive every step of the way:

  1. Cut out your coffee habit.
  2. Keep track of your $5 daily savings.
  3. Invest the money you save.

Skip any of these steps, and your retirement account is out of luck. That’s where automation comes in. An automatic transfer to your retirement or investment account every payday does not require any tough decisions.

Related: Let Your Wealth Go… Upstream

In addition, automation not only grows your nest egg, but also naturally prompts you to re-examine your spending habits. You’ll have a little less money to spend each month, which means you decide on a case-by-case basis if you really want a coffee. That’s a lot more doable than an across-the-board ban of your favorite indulgences.

You don’t need to sacrifice small pleasures to prepare for your future. Making savvy decisions doesn’t have anything to do with lattes.