Sri Lanka's garment export industry is expected to get smaller, with factory numbers falling to 200 by the end of next year.