You can make the sale tax item inactive. By doing so, it will not affect your sales tax calculation nor it will be included in your reports. Since as of this time, the ability to permanently delete a sales tax item is not available.
Go to the Taxes menu.
Choose the Sales Tax Settings link.
From the list of Sales Tax Agencies, locate the incorrect one.
Click the Edit drop-down arrow from the Action column.