Without this: you get a browser popup immediately on page load.

With this: you get a popup within the website, which will then trigger the browser popup if you miss the tiny (x).

As someone pointed out already, the only possible fix is for websites to somehow not know whether you've enabled them or not.

To solve abuse, the browser could pretend to comply by not returning error codes but doing nothing for the user.

However this would mean that websites with a legitimate use for the feature (say, an email client or whatever) would have degraded usability, kind of how Mac apps have to tell you to go to the system settings and allow them certain permissions.