US apparel retailer Abercrombie & Fitch has been criticised for not being "aggressive enough" in its efforts to turn itself around amid falling sales at most of its brands.