Hello liz24,
Great question. I can absolutely see how having a physical list of this information would be handy. Luckily, QuickBooks Online has an easy solution for you.
To generate a list of customers and their addresses, I recommend running the Customer Contact List report through the Reports tab. This report shows you information including the customer name, phone number, email, physical address, and more depending on the customization options you choose. Once it's customized just the way you'd like, you can print it out. I've got a couple of links that can help you with this.
I'm here if you need anything else! Just give me a shout. :)