LXD doesn’t support downgrading, so this will go very badly.
You’re going to have to setup a new empty LXD and then move your data from the newer LXD, either by using lxc copy/move over the network or by using export/import for each instance.
(Also, LXD is no longer part of Linux Containers, support for LXD is on the Canonical forum these days).