Trade minister says Britain must stop re-fighting the Brexit referendum