Hartmarx Corp swung to a loss in its first quarter, but the company refused to deviate from its forecast of improvement later in the year, including second-quarter profitability.