You've partially done the right steps, Sid0203.
The information displayed on the Sales Tax Liability report is based on the items you've set up in QuickBooks whether they are active or not. To ensure that the items with zero amount is not displayed, let's change your filter from Active to Non-zero.
After adding these filters, refresh the report to see the results.
Let me know if you need a different report. I'll be around to help you generate it.