Clothing and sportswear company Hartmarx Corporation slipped to a second quarter loss after recording a double-digit revenue decline.