Any configuration changes need to be propagated to the running instances of wpa_supplicant. That can be done by regenerating the configuration file and then reloading the daemon.