It's really a question for your accountant when you're doing your taxes.
Pending the total amount of the expenses and what state you're in, you may be able to deduct it all. But if you're just starting out, you may actually be operating at a loss. So you may want to hold off on those deductions until you have some income to deduct it against.
But again, REALLY a question for your accountant that knows your finances.