Apparel business Hampshire Group recorded a net loss and a 44% slump in sales in the second quarter, but the company's CEO insists a recovery is just around the corner.