Speciality retailer Men's Wearhouse has blamed the strengthening Canadian dollar and rising imports for its decision to close its Montreal manufacturing facility with the loss of 540 jobs.