Women's wear maker Bernard Chaus Inc has swung to a second quarter loss on lower sales in what it describes as a "challenging" environment.