Not sure why your certificate got re-generated. LXD only generates certificates if the file is missing…
In any case, the LXD client doesn’t care about the IPs in the cert, that’s just Go being a bit confused, instead the entire certificate is checked against the expected value.
Removing and re-adding the remote is the correct process in case of a certificate change.