UK fashion retailer French Connection has announced the departure of its finance chief, Adam Castleton, just months after issuing a profit warning.