Footwear and accessories retailer Genesco Inc has signed a definitive agreement to acquire headwear group Hat World Corporation for $165 million.