Continuing weakness in the women's specialty apparel segment has pushed first quarter profit down 9.6% at value-priced women's fashion retailer The Cato Corporation.