Apparel maker Hartmarx said store opening expenses and investments into its brands took 39% off its first-quarter profit.