Textile job losses in the UK are set to slow despite the country's stunted economic recovery, according to a survey by Clifton Asset Management.