Apparel company Perry Ellis International has swung into profit for the full fiscal year, buoyed by improved margins that offset lower FY sales.