Welcome to the Community, dwhalen51.
You've come to the right place for assistance. I want to make sure you're able to change the address on the invoice in your QuickBooks Desktop account.
While researching this, I saw that there is a message box that appears stating, "This change will reflect in your current transaction. Do you want to make it permanent i.e. to reflect in all your past and future transactions?" If you select "No" the address change should only apply to the one invoice you're working on.
Please give this a try and let me know how things look afterward. I'll be here to lend a hand if you need me.