Clothing retailer Cortefiel on Monday said it has started talks with labour unions to shut its Madrid factory with the loss of 150 jobs.