Interest in sourcing apparel from sub-Saharan Africa might be on the rise, yet the results of new survey suggest few players currently have concrete plans to tap into its potential.