Clothing giant Kellwood Company was on Monday reported to be in exclusive talks with music mogul Russell Simmons over plans to buy his Phat Fashions urban apparel company.