Are we suppose to delete employees that have left company

No, just make them inactive. In fact if you ever paid them even just once you cannot delete them nor should you since if you could (which you can't) you would not be able to include their wages on forms