Diversified apparel company Hampshire Group has sacked CEO Ludwig Kuttner in connection with an audit committee probe.