Hello there, @noah_townsend.
Thank you for joining the QuickBooks Community. I'd be happy help you get to the right support.
To check what's causing this issue, I recommend calling our Merchant Support Team. They have the tools to check your account and verify why the credit card payment option is turned on for every open invoice.
That should point you in the right direction today. If you have any other questions I can help you with, feel free to add a comment below. I'll be happy to help you out.