Yes — each shipping rate can be assigned to the country or countries you actually deliver to. A single delivery option can cover multiple countries when the same service and charge applies to all of them.

There is no need to create a broad “everywhere else” rule. Explicit destinations make it clearer to buyers where an item can be delivered and prevent checkout from offering delivery where you have not configured a valid route.