Lurking behind the consumer confidence numbers is a less savory reality | Fortune