Australian fashion operator Pacific Brands has defended its cutbacks in Australia amid criticism from unions calling for a boycott on its goods.