4.21 can't start containers mapping /tmp/.X11-unix/X0

No. Only the LTS (4.0.x) releases can always be downgraded and have the commitment of no schema changes, the 4.x series are feature releases and are only supported until the next feature release (approximately monthly), and may have schema changes that prevent downgrades.

See Managing the LXD snap