Wall Street investment group Patriarch Partners has bought textile maker Galey & Lord, the khaki, denim and corduroy supplier, for an undisclosed sum.