CEO of clothing manufacturer Oxford Industries Hicks Lanier will retire at the end of the year leaving president Tom Chubb to take the helm.