Off-price fashion retailer Stein Mart Inc has blamed falling sales and charges for its wider fourth quarter loss, and says it expects the year ahead to be "highly challenging."