Not able to limit cpu in lxc container

GEtting the below error when trying to limit cpu to an unprivilaged lxc container:
lxc_cgfsng - cgroups/cgfsng.c:cg_legacy_set_data:2199 - Failed to setup limits for the “cpuset” controller. The controller seems to be unused by “cgfsng” cgroup driver or not enabled on the cgroup hierarchy
lxc-start app 20210720190228.365 WARN lxc_cgfsng - cgroups/cgfsng.c:__cg_legacy_setup_limits:2236 - Failed to set “cpuset.cpus” to “0,1”

My configuration file has
lxc.mount.auto = proc:mixed sys:mixed cgroup:mixed
lxc.mount.cpuset.cpus = 0

Any suggestions on this?