Up to half of all remaining jobs in the Nottinghamshire textile industry could be lost over the next five years, a regional industry body has warned.