Yeah, you can run x11 in container in a barebones host, however you will not be able use keyboard.
https://discuss.linuxcontainers.org/t/its-possible-to-run-containerlized-x11-without-nesting-or-vnc-or-rdp-but-i-need-help-with-input/
Can you share how you modified /etc/inittab?