Department store retailer JC Penney Company Inc is opening its first-ever store in Manhattan at the end of this month.