Mall-based clothing retailer Pacific Sunwear of California said first-quarter profit dropped 33% on increased costs.