Apparel maker Perry Ellis International is to take over the manufacturing of its namesake men's dress shirt lines after ending a two-year license agreement with Smart Apparel.