Apparel brand Tommy Hilfiger is in talks with its biggest customer, department store chain Dillards Inc, to reduce the number of its stores carrying Hilfiger merchandise.