Yes, it should decrease the estimated tax due after making a payment.
Below are the steps to follow to mark the taxes paid.
Let's make sure you're using the right category. Then, the payment should show in the Amount Paid column in the Taxes tab.
Here's a reference on how to pay taxes in QuickBooks Self-Employed: Pay Federal Estimated Quarterly Taxes.
Let us know if you have other questions.