Sock firm International Legwear Group (ILG) is planning to lay off 186 workers at its plants in Hildebran and Hickory, according to a report by the Associated Press.