Hi,
The shipping fee is not linked to products unless you have the "shipping price per product" activated in your shipping methods and you configure the shipping fees on the product edition screen.
I'm not sure if you're talking about that ?
Otherwise, the shipping fees are global to the cart so you shouldn't need to set them for each product.
We would need more information on your setup to be able to say precisely what are your options.
Supposing that you're configured your shipping methods with the shipping price per product activated, then the shipping fees of the products are stored in the hikashop_shipping_price table in your database.
If you want to set them all at once, you could use the CSV export/import feature of your PHPMyAdmin on that table to get a CSV file of the shipping fees you already created for a few products, import it in excel, add the entries for the other products with Excel's advanced functions and import it back.