A UK body that campaigns for fairness in trade is urging retailers not to cancel orders or require factories to delay payment terms, decisions it says, will have "devastating consequences for textile workers".