What is included in my quickbooks balance in my banking section?...example, does it include bills that have not been paid
It's great that you're proactively looking into what the different balances mean. QuickBooks Online's banking feeds keep track of two separate balances, making it easy to know where you stand as you go. This results in significant time savings when reconciling, and even helps us ensure tax filings are accurate. The key to taking full advantage of this is to have a solid understanding of what they mean. I can help with this.
The Bank Balance just displays what the system saw on the bank's end last time the feed was updated. The In QuickBooks amount displays the account's balance based on all transactions affecting the register in QuickBooks. This should be the same as what your balance sheet displays. Bills generally don't affect your bank account until they are paid, as they affect your accounts payable. The only time an unpaid bill will affect the In QuickBooks balance is if you've selected the bank account as an expense category.
Hope this clears things up! I'm here for you if you have any more questions.