A UK government minister is looking to drive better working conditions for garment workers in Asia and Africa.