Millard Drexler is to step down as chairman of US fashion retailer J Crew after 15 years with the company, following hot on the heels of the former CEO who departed two months ago.