Apparel company Hampshire Group is axing nearly one-quarter of its workforce as part of restructuring plans aimed at reducing the company's costs.