US apparel business Perry Ellis International has confirmed the departure of its chief merchandising officer Douglas Jakubowski, after four years in the post.