US apparel retailer Men's Wearhouse is to buy the parent company of the Joseph Abboud clothing brand for US$97.5m.