You might receive the following dialog when you launch the Windows Feedback app
However, there is no setting provided by the GUI that you can change
There is a registry mod workaround over on the MS community forums
I've included a reg file in this zip that does the job for you. Download the zip file, extract the .reg file, then double click he .reg file to merge it into you registry - answer yes to any warnings you might get.
Windows Registry Editor Version 5.00