Costs associated with its recent acquisition of Rafaella Apparel Group have dented fourth quarter profit at fashion giant Perry Ellis International Inc.