Arnold Brant Silverstone will leave the label he founded ten years ago, Arnold Brant, and the company he sold it to two years ago, Oxford Industries, later this month.