An investor group led by billionaire George Soros has more than halved its stake in men's clothing chain Jos A Bank Clothiers Inc.