Africa's garment exports are plummeting as US buyers look elsewhere, says the industry.