Apparel business Perry Ellis is "disappointed" after swinging to a loss of US$28.2m during the fourth-quarter due to significant write-downs on some of the group's non-core brands and businesses.