US fashion firm Polo Ralph Lauren has confirmed it will shift the operations of a leased distribution facility in the US, affecting around 100 workers there.