Perry Ellis International's fourth-quarter results met analysts' expectations and pulled full-year results close to year-ago levels.