I’ve got good news for you.
You don’t have to manually enter all of the tax rates, nor do you need a plug-in. Magento allows you to import the tax rates via CSV file, all in one go. It is a core feature in the Magento admin panel (Sales -> Tax -> Import / Export Tax Rates).
Magento – Knowledge Base – Tip: Importing Tax Rates – eCommerce Software for Growth