Apparel business Joe's Jeans has moved to a net loss in the fourth quarter on the back of one-off charges.