One of the groups working to improve building and worker safety in the Bangladesh ready-made garment industry has said it is "concerned" with delays in remediation at many of the factories that it has inspected.