Hi,
No.
First, you need to make sure that the taxes are applied if the address of the current user is correct (in Sweden) and that it is not applied if the address is outside that zone.
That way, you already know that the taxes are setup properly.
Then, the geolocation plugin needs to be setup properly too.
The "set currency" and "customers geolocation" settings of the plugin needs to be activated and your API key of ipinfodb needs to be filled.
And finally, when you test, you need to test with a new user session.
So for example, you open your website with another browser, or with a web proxy of the country that you want to test.