Struggling UK department store retailer House of Fraser has declined to comment on reports it is in talks with Sports Direct owner Mike Ashley over a GBP50m (US$65.8m) rescue deal.