A search is underway for a new chief executive officer at Ben Sherman after Pan Philippou left the Oxford Industries-owned fashion brand earlier this week.