The market appears to have become more cautious of Denny's business operation. While investors await improvements in the company's fundamental metrics, last year's performance might be indicative of existing challenges, given it was worse than the annualized 5-year loss.