Up to 140 workers at a sleep wear maker are to lose their jobs after bosses announced plans to move some operations.