Confidence in the global apparel industry remains at a low level following the UK's decision to leave the European Union (EU), the latest survey from just-style shows.