And when asked about how they became wealthy, "frugality" ranked among the top five factors, below hard work, education, smart investing and taking risk.
Read MoreBillionaires are hoarding mountains of cash
Yet their spending numbers show that they still enjoy the finer things in life—or at least, the finer experiences in life.
Fully 60 percent spend more than $10,000 a year on vacation or leisure travel, the highest of any category. More than a quarter of spend more than $25,000 on trips, and 14 percent spend more than $50,000.
Read MoreTop millionaire growth? Hint: J.R. would be proud
"They work hard, so they like nice vacations," said George Walper, president of Spectrem Group. "And they take nice vacations because they can."
By contrast, jewelry, cars and boats weren't as popular. More than three-quarters of the rich surveyed didn't spend any money on boats. Only 30 percent spend more than $10,000 on jewelry a year, and fewer than one in five of them spent more than $50,000 on a car. (Granted, the few rich who do like cars spend a lot: 10 percent said they spend $100,000 or more).