More than 40 textile workers are set to lose their jobs with the closure of a North Carolina hosiery plant.