Perry Ellis International Inc has described its third quarter as "challenging," after higher levels of markdowns offset rising sales to push the apparel maker's profit down by 9.7%.