Apparel group Perry Ellis International posted an increased loss in the second quarter, with revenues up only slightly and margins down.