Thanks for joining us here, nick.
Currently, We don't have a direct option for removing VAT registration once it is set up in QuickBooks Online. However, you can update your settings to set the default VAT to Out of Scope of Tax to prevent VAT from appearing on future transactions.
Here's how to set your Default tax rate selection to Out of Scope of Tax:
1. Go to gear icon
2. Under Your Company, select Account and settings.
3. Choose Advanced, then go to Accounting.
4. Click Default tax rate selection, and select Out of Scope of Tax.
5. Hit on Save, then Done.

Please click on the article for more information regarding this matter and for future reference: Turn off VAT in QuickBooks
If you have any additional questions, please don’t hesitate to reach out. We're always here to assist you.