Chances are the problem is that the filesystem is already mounted
With the container stopped, run grep default/containers/NAME /proc/*/mountinfo
, that should show you where it’s already mounted and for what processes.
You can then use nsenter -t PID -m umount /path/to/the/mount