Interest in East Africa as a potential apparel sourcing destination has been on the rise, yet the results of a new survey suggest the road ahead won't be an easy one.