Apparel retailer Giordano International said it had a "challenging" 2013 as it booked a decline in earnings for the full year.