I have set up vendors to appropriate accounts in account settings, but when I pay an invoice it appears in the register as "Accounts Payable" as opposed to "utilities" for instance.
How can I change this to reflect the account that each vendor is setup for?
Every time you create a bill invoiced by your vendor, the affecting account is Accounts Payable. It will only reflect in the account you've setup to that vendor if the bill is already paid. However, if you want the transaction to directly affect the vendor's account, you can write a check.
You record a bill if you plan to pay the items at a future date. On the other hand, checks are used if you paid the items on-the-spot.
Reach out to me if you have other concerns. I'm here to help.