Clothing company Arthur Ellis on Wednesday decided to change the name of its Fairydown brand after a survey found British and Australian men believed the "fairy" label could see them branded gay.