A workaround from @htdvisser on Slack, if you really need to clear the nonces that TTN has stored:
The backend clears the DevNonces when you change the AppKey, so if this is a problem, you can just change the AppKey to something else and then change it back