Error every other day. LXD times out etc

Got this.
dmesg: read kernel buffer failed: Operation not permitted

jornalctl with grep lxd. I get nothing on qemu.
May 03 21:45:36 server1 lxd.daemon[10576]: time=“2023-05-03T21:45:36+02:00” level=warning msg=“Transaction timed out. Retrying once” err=“Failed to begin transaction: context deadline exceeded” member=1
May 03 21:47:40 server1 lxd.daemon[10576]: time=“2023-05-03T21:47:37+02:00” level=warning msg=“Dqlite: attempt 1: server 1: write handshake: write unix @->@0000d: i/o timeout”
May 03 21:47:41 server1 lxd.daemon[10576]: time=“2023-05-03T21:47:33+02:00” level=error msg=“Unable to retrieve the list of expired custom volume snapshots” err=“Failed to begin transaction: context deadline exceeded”
May 03 21:47:44 server1 lxd.daemon[10576]: time=“2023-05-03T21:47:44+02:00” level=error msg=“Failed to schedule local auto custom volume snapshot,” err=“Failed to begin transaction: context deadline exceeded”
May 03 21:47:44 server1 lxd.daemon[10576]: time=“2023-05-03T21:47:44+02:00” level=error msg=“Failed getting expired instance snapshots” err=“Failed to begin transaction: context deadline exceeded”
May 03 21:47:56 server1 lxd.daemon[10576]: time=“2023-05-03T21:47:56+02:00” level=warning msg=“Failed to rollback transaction after error (Failed loading instance profiles: Failed to fetch from “profile_devices” table: Failed to fetch from “profile_devices” table: sql: transaction has already been committed or rolled back): sql: transaction has already been committed or rolled back”
May 03 21:52:35 server1 lxd.daemon[10576]: time=“2023-05-03T21:52:35+02:00” level=warning msg=“Transaction timed out. Retrying once” err=“Failed to begin transaction: context deadline exceeded” member=1
May 03 21:52:36 server1 lxd.daemon[10576]: time=“2023-05-03T21:52:35+02:00” level=warning msg=“Transaction timed out. Retrying once” err=“Failed to begin transaction: context deadline exceeded” member=1
May 03 21:52:36 server1 lxd.daemon[10576]: time=“2023-05-03T21:52:36+02:00” level=warning msg=“Transaction timed out. Retrying once” err=“Failed to begin transaction: context deadline exceeded” member=1
May 03 21:52:37 server1 lxd.daemon[10576]: time=“2023-05-03T21:52:37+02:00” level=warning msg=“Failed to rollback transaction after error (Failed loading projects: Failed to fetch from “projects” table: Failed to fetch from “projects” table: sql: Rows are closed): sql: transaction has already been committed or rolled back”
May 03 21:55:00 server1 lxd.daemon[10576]: time=“2023-05-03T21:55:00+02:00” level=warning msg=“Failed to rollback transaction after error (Failed loading projects: Failed to fetch from “projects” table: Failed to fetch from “projects” table: sql: transaction has already been committed or rolled back): sql: transaction has already been committed or rolled back”
May 03 21:55:00 server1 lxd.daemon[10576]: time=“2023-05-03T21:55:00+02:00” level=error msg=“Failed to schedule local auto custom volume snapshot,” err=“Failed loading projects: Failed to fetch from “projects” table: Failed to fetch from “projects” table: sql: transaction has already been committed or rolled back”
May 03 21:57:05 server1 lxd.daemon[10576]: time=“2023-05-03T21:57:05+02:00” level=warning msg=“Transaction timed out. Retrying once” err=“Failed to begin transaction: context deadline exceeded” member=1
May 03 21:57:07 server1 lxd.daemon[10576]: time=“2023-05-03T21:57:07+02:00” level=warning msg=“Transaction timed out. Retrying once” err=“Failed to begin transaction: context deadline exceeded” member=1

@tomp i all so killed the win11 process. But lxc etc still doesnt work.

Can I get access to the system?

You are thinking tmate? Stuff like this scare me :P. But if i can supervise it should be fine.

Should i reboot first or you want the non working version…

OK try doing this when lxd is stuck:

lxc config set core.debug_address 127.0.0.1:8444
curl http://127.0.0.1:8444/debug/pprof/goroutine?debug=2

Heres the output.
goroutine 832565 [running]:
runtime/pprof.writeGoroutineStacks({0x1dd0ee0, 0xc0002e49a0})
/snap/go/10030/src/runtime/pprof/pprof.go:692 +0x70
runtime/pprof.writeGoroutine({0x1dd0ee0?, 0xc0002e49a0?}, 0x0?)
/snap/go/10030/src/runtime/pprof/pprof.go:681 +0x2b
runtime/pprof.(*Profile).WriteTo(0x195c960?, {0x1dd0ee0?, 0xc0002e49a0?}, 0xc?)
/snap/go/10030/src/runtime/pprof/pprof.go:330 +0x14b
net/http/pprof.handler.ServeHTTP({0xc000ed60d1, 0x9}, {0x1dd9ec0, 0xc0002e49a0}, 0x2e302e302e373231?)
/snap/go/10030/src/net/http/pprof/pprof.go:253 +0x4a5
net/http/pprof.Index({0x1dd9ec0?, 0xc0002e49a0}, 0xc000054100)
/snap/go/10030/src/net/http/pprof/pprof.go:371 +0x13e
net/http.HandlerFunc.ServeHTTP(0xc000c70af0?, {0x1dd9ec0?, 0xc0002e49a0?}, 0x0?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
net/http.(*ServeMux).ServeHTTP(0xc000ed60db?, {0x1dd9ec0, 0xc0002e49a0}, 0xc000054100)
/snap/go/10030/src/net/http/server.go:2487 +0x149
net/http.serverHandler.ServeHTTP({0xc0012090b0?}, {0x1dd9ec0, 0xc0002e49a0}, 0xc000054100)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000d74460, {0x1ddae80, 0xc000b28840})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 1 [select, 985 minutes]:
main.(*cmdDaemon).Run(0xc000120ff0, 0x0?, {0xc000581340, 0x0, 0x0?})
/build/lxd/parts/lxd/src/lxd/main_daemon.go:83 +0x63f
github.com/spf13/cobra.(*Command).execute(0xc0005a8000, {0xc0000400b0, 0x4, 0x4})
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/spf13/cobra@v1.6.1/command.go:916 +0x862
github.com/spf13/cobra.(*Command).ExecuteC(0xc0005a8000)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/spf13/cobra@v1.6.1/command.go:1044 +0x3bd
github.com/spf13/cobra.(*Command).Execute(…)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/spf13/cobra@v1.6.1/command.go:968
main.main()
/build/lxd/parts/lxd/src/lxd/main.go:220 +0x1b05

goroutine 28 [select, 10974 minutes]:
database/sql.(*DB).connectionOpener(0xc0000f0d00, {0x1ddadd8, 0xc00038a200})
/snap/go/10030/src/database/sql/sql.go:1224 +0x8d
created by database/sql.OpenDB
/snap/go/10030/src/database/sql/sql.go:792 +0x18d

goroutine 26 [syscall, 985 minutes]:
os/signal.signal_recv()
/snap/go/10030/src/runtime/sigqueue.go:152 +0x2f
os/signal.loop()
/snap/go/10030/src/os/signal/signal_unix.go:23 +0x19
created by os/signal.Notify.func1.1
/snap/go/10030/src/os/signal/signal.go:151 +0x2a

goroutine 912 [syscall, 10974 minutes]:
syscall.Syscall6(0x473a7d?, 0xc000000000?, 0x142ea0?, 0x0?, 0xc000142e80?, 0x4f6694?, 0x7fc82e606d50?)
/snap/go/10030/src/syscall/syscall_linux.go:90 +0x36
os.(*Process).blockUntilWaitable(0xc001313bf0)
/snap/go/10030/src/os/wait_waitid.go:32 +0x87
os.(*Process).wait(0xc001313bf0)
/snap/go/10030/src/os/exec_unix.go:22 +0x28
os.(*Process).Wait(…)
/snap/go/10030/src/os/exec.go:132
github.com/lxc/lxd/shared/subprocess.(*Process).start.func3()
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:172 +0x6c
created by github.com/lxc/lxd/shared/subprocess.(*Process).start
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:169 +0x79d

goroutine 134 [IO wait, 10973 minutes]:
internal/poll.runtime_pollWait(0x7fc82e606e40, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc00068ec60?, 0x1a84756?, 0x1)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).RawRead(0xc00068ec60, 0xc000a66040)
/snap/go/10030/src/internal/poll/fd_unix.go:766 +0x145
os.(*rawConn).Read(0xc0003891c8, 0x419207?)
/snap/go/10030/src/os/rawconn.go:31 +0x56
github.com/mdlayher/socket.(*Conn).read(0xc000246980, {0x1ddae10?, 0xc00004a0b0}, {0x1a77a02?, 0x0?}, 0xc000d160c0)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/mdlayher/socket@v0.4.0/conn.go:688 +0x129
github.com/mdlayher/socket.(*Conn).Accept(0xc000246980, 0x0)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/mdlayher/socket@v0.4.0/conn.go:400 +0xfd
github.com/mdlayher/vsock.(*listener).Accept(0xc000a24d50)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/mdlayher/vsock@v1.2.0/listener_linux.go:32 +0x2a
github.com/mdlayher/vsock.(*Listener).Accept(0xc0003891d0)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/mdlayher/vsock@v1.2.0/vsock.go:133 +0x25
crypto/tls.(*listener).Accept(0xc00021de90)
/snap/go/10030/src/crypto/tls/tls.go:66 +0x2d
net/http.(*Server).Serve(0xc00022c3c0, {0x1dd7be0, 0xc00021de90})
/snap/go/10030/src/net/http/server.go:3070 +0x385
github.com/lxc/lxd/lxd/endpoints.(*Endpoints).serve.func1()
/build/lxd/parts/lxd/src/lxd/endpoints/endpoints.go:415 +0x25
gopkg.in/tomb%2ev2.(*Tomb).run(0xc000a2cd70, 0xc0000c4140?)
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:163 +0x36
created by gopkg.in/tomb%2ev2.(*Tomb).Go
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:159 +0xee

goroutine 135 [IO wait, 8961 minutes]:
internal/poll.runtime_pollWait(0x7fc82e607200, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc000a3cc80?, 0x4f6482?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000a3cc80)
/snap/go/10030/src/internal/poll/fd_unix.go:614 +0x234
net.(*netFD).accept(0xc000a3cc80)
/snap/go/10030/src/net/fd_unix.go:172 +0x35
net.(*UnixListener).accept(0x47586e?)
/snap/go/10030/src/net/unixsock_posix.go:166 +0x1c
net.(*UnixListener).Accept(0xc000a4e210)
/snap/go/10030/src/net/unixsock.go:260 +0x3d
net/http.(*Server).Serve(0xc00022c1e0, {0x1dd9ce0, 0xc000a4e210})
/snap/go/10030/src/net/http/server.go:3070 +0x385
github.com/lxc/lxd/lxd/endpoints.(*Endpoints).serve.func1()
/build/lxd/parts/lxd/src/lxd/endpoints/endpoints.go:415 +0x25
gopkg.in/tomb%2ev2.(*Tomb).run(0xc000a2cd70, 0x0?)
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:163 +0x36
created by gopkg.in/tomb%2ev2.(*Tomb).Go
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:159 +0xee

goroutine 136 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc82e607110, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc000a3cb80?, 0xc000021b60?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000a3cb80)
/snap/go/10030/src/internal/poll/fd_unix.go:614 +0x234
net.(*netFD).accept(0xc000a3cb80)
/snap/go/10030/src/net/fd_unix.go:172 +0x35
net.(*UnixListener).accept(0xc000bcb830?)
/snap/go/10030/src/net/unixsock_posix.go:166 +0x1c
net.(*UnixListener).Accept(0xc000a2bf50)
/snap/go/10030/src/net/unixsock.go:260 +0x3d
github.com/lxc/lxd/lxd/endpoints/listeners.(*StarttlsListener).Accept(0xc000a2bfb0)
/build/lxd/parts/lxd/src/lxd/endpoints/listeners/starttls.go:36 +0x64
net/http.(*Server).Serve(0xc00022c0f0, {0x1dd8990, 0xc000a2bfb0})
/snap/go/10030/src/net/http/server.go:3070 +0x385
github.com/lxc/lxd/lxd/endpoints.(*Endpoints).serve.func1()
/build/lxd/parts/lxd/src/lxd/endpoints/endpoints.go:415 +0x25
gopkg.in/tomb%2ev2.(*Tomb).run(0xc000a2cd70, 0x0?)
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:163 +0x36
created by gopkg.in/tomb%2ev2.(*Tomb).Go
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:159 +0xee

goroutine 137 [IO wait, 10974 minutes]:
internal/poll.runtime_pollWait(0x7fc82e606f30, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc000a3ce80?, 0x0?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000a3ce80)
/snap/go/10030/src/internal/poll/fd_unix.go:614 +0x234
net.(*netFD).accept(0xc000a3ce80)
/snap/go/10030/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc00021ded8)
/snap/go/10030/src/net/tcpsock_posix.go:142 +0x28
net.(*TCPListener).Accept(0xc00021ded8)
/snap/go/10030/src/net/tcpsock.go:288 +0x3d
github.com/lxc/lxd/lxd/endpoints/listeners.(*FancyTLSListener).Accept(0xc000a2cc80)
/build/lxd/parts/lxd/src/lxd/endpoints/listeners/fancytls.go:37 +0x5e
net/http.(*Server).Serve(0xc00022c0f0, {0x1dd8960, 0xc000a2cc80})
/snap/go/10030/src/net/http/server.go:3070 +0x385
github.com/lxc/lxd/lxd/endpoints.(*Endpoints).serve.func1()
/build/lxd/parts/lxd/src/lxd/endpoints/endpoints.go:415 +0x25
gopkg.in/tomb%2ev2.(*Tomb).run(0xc000a2cd70, 0x0?)
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:163 +0x36
created by gopkg.in/tomb%2ev2.(*Tomb).Go
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:159 +0xee

goroutine 138 [select, 2351 minutes]:
database/sql.(*DB).connectionOpener(0xc000a0f860, {0x1ddadd8, 0xc000246b80})
/snap/go/10030/src/database/sql/sql.go:1224 +0x8d
created by database/sql.OpenDB
/snap/go/10030/src/database/sql/sql.go:792 +0x18d

goroutine 780765 [semacquire, 1050 minutes]:
sync.runtime_SemacquireMutex(0x110000000000?, 0x0?, 0xc00091c250?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0012f0300?, 0x7?}, {0xc0006a5e77, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000c44f20)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000c44f20, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000c44f20, {0xc000bd4a50?, 0xc0012f0188?, 0x7?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 448 [IO wait, 10974 minutes]:
internal/poll.runtime_pollWait(0x7fc82e606a80, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc0006ad800?, 0x5?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0006ad800)
/snap/go/10030/src/internal/poll/fd_unix.go:614 +0x234
net.(*netFD).accept(0xc0006ad800)
/snap/go/10030/src/net/fd_unix.go:172 +0x35
net.(*UnixListener).accept(0x41115d?)
/snap/go/10030/src/net/unixsock_posix.go:166 +0x1c
net.(*UnixListener).Accept(0xc000bca690)
/snap/go/10030/src/net/unixsock.go:260 +0x3d
github.com/lxc/lxd/lxd/seccomp.NewSeccompServer.func1()
/build/lxd/parts/lxd/src/lxd/seccomp/seccomp.go:1052 +0x55
created by github.com/lxc/lxd/lxd/seccomp.NewSeccompServer
/build/lxd/parts/lxd/src/lxd/seccomp/seccomp.go:1050 +0x20a

goroutine 784395 [semacquire, 985 minutes]:
sync.runtime_SemacquireMutex(0x2110000000000?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000661b97?, 0x7?}, {0xc0012f0157, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc0004e0dc0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc0004e0dc0, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc0004e0dc0, {0xc000df07b0?, 0xc001012468?, 0x6?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 359 [select, 10974 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 360 [syscall, 10974 minutes]:
syscall.Syscall6(0x7fc85629aa68?, 0x10?, 0xc00070e000?, 0xc000c54f40?, 0x0?, 0x1?, 0xae8690?)
/snap/go/10030/src/syscall/syscall_linux.go:90 +0x36
os.(*Process).blockUntilWaitable(0xc000c5c1e0)
/snap/go/10030/src/os/wait_waitid.go:32 +0x87
os.(*Process).wait(0xc000c5c1e0)
/snap/go/10030/src/os/exec_unix.go:22 +0x28
os.(*Process).Wait(…)
/snap/go/10030/src/os/exec.go:132
github.com/lxc/lxd/shared/subprocess.(*Process).start.func3()
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:172 +0x6c
created by github.com/lxc/lxd/shared/subprocess.(*Process).start
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:169 +0x79d

goroutine 405 [select, 8221 minutes]:
main.deviceEventListener(0xc000678420)
/build/lxd/parts/lxd/src/lxd/devices.go:538 +0x212
created by main.(*Daemon).init
/build/lxd/parts/lxd/src/lxd/daemon.go:1415 +0x3db5

goroutine 336 [syscall, 35 minutes]:
syscall.Syscall(0x0?, 0xc000835c00?, 0xc0008358b0?, 0x41e5f7?)
/snap/go/10030/src/syscall/syscall_linux.go:68 +0x27
golang.org/x/sys/unix.read(0x1818680?, {0xc0008d3000?, 0x1a73453?, 0x6?})
/build/lxd/parts/lxd/src/.go/pkg/mod/golang.org/x/sys@v0.4.0/unix/zsyscall_linux.go:1366 +0x4d
golang.org/x/sys/unix.Read(...)
/build/lxd/parts/lxd/src/.go/pkg/mod/golang.org/x/sys@v0.4.0/unix/syscall_unix.go:151
main.deviceNetlinkListener.func1(0xc00036daa0?, 0xc000138f00?, 0xc000138f60?, 0xc000138fc0?)
/build/lxd/parts/lxd/src/lxd/devices.go:100 +0xa6
created by main.deviceNetlinkListener
/build/lxd/parts/lxd/src/lxd/devices.go:97 +0x1ca

goroutine 2265 [select, 10973 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 829407 [semacquire, 61 minutes]:
sync.runtime_Semacquire(0xc000cf13d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc000cf14f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc000055a00)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc000cf1610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e4b60}, 0xc000055a00)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000055800?, {0x1dd9ec0?, 0xc0002e4b60?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e4b60}, 0xc000055700)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e4b60}, 0xc000055700)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc0007b2bd0?}, {0x1dd9ec0, 0xc0002e4b60}, 0xc000055700)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000c19ae0, {0x1ddae80, 0xc0007b2b70})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 72258 [select, 10129 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 2113 [select, 10973 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 695154 [chan send, 2372 minutes]:
github.com/lxc/lxd/lxd/instance/operationlock.(*InstanceOperation).ResetTimeout(0xc000c1b1a0, 0x6fc23ac00)
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:228 +0x1e5
github.com/lxc/lxd/lxd/instance/operationlock.(*InstanceOperation).Reset(…)
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:207
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Shutdown(0xc000c44000, 0xffffffffc4653600)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:724 +0x910
main.doInstanceStatePut({0x1dff710?, 0xc000c44000?}, {{0xc00098fc58?, 0x0?}, 0x4a48c0?, 0x90?, 0xe5?})
/build/lxd/parts/lxd/src/lxd/instance_state.go:235 +0x83
main.instanceStatePut.func1(0xc0000c40e0?)
/build/lxd/parts/lxd/src/lxd/instance_state.go:195 +0x6a
github.com/lxc/lxd/lxd/operations.(*Operation).Start.func1(0xc0009b5680)
/build/lxd/parts/lxd/src/lxd/operations/operations.go:281 +0x2c
created by github.com/lxc/lxd/lxd/operations.(*Operation).Start
/build/lxd/parts/lxd/src/lxd/operations/operations.go:280 +0xf7

goroutine 2263 [select, 10973 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 72080 [select, 10129 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 911 [select, 10974 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 1042 [select, 10973 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 1043 [syscall, 10973 minutes]:
syscall.Syscall6(0x7fc85629aa68?, 0x10?, 0xc000980000?, 0xc000d27470?, 0x0?, 0x719380?, 0xc00099aea0?)
/snap/go/10030/src/syscall/syscall_linux.go:90 +0x36
os.(*Process).blockUntilWaitable(0xc000374000)
/snap/go/10030/src/os/wait_waitid.go:32 +0x87
os.(*Process).wait(0xc000374000)
/snap/go/10030/src/os/exec_unix.go:22 +0x28
os.(*Process).Wait(…)
/snap/go/10030/src/os/exec.go:132
github.com/lxc/lxd/shared/subprocess.(*Process).start.func3()
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:172 +0x6c
created by github.com/lxc/lxd/shared/subprocess.(*Process).start
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:169 +0x79d

goroutine 1044 [select, 10973 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 1045 [syscall, 10973 minutes]:
syscall.Syscall6(0xc000c9c1c0?, 0xc000141f2a?, 0xc0005a2ea0?, 0xc000141f68?, 0xc000c9c0c0?, 0xc00004ec00?, 0xc000139260?)
/snap/go/10030/src/syscall/syscall_linux.go:90 +0x36
os.(*Process).blockUntilWaitable(0xc000e18720)
/snap/go/10030/src/os/wait_waitid.go:32 +0x87
os.(*Process).wait(0xc000e18720)
/snap/go/10030/src/os/exec_unix.go:22 +0x28
os.(*Process).Wait(…)
/snap/go/10030/src/os/exec.go:132
github.com/lxc/lxd/shared/subprocess.(*Process).start.func3()
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:172 +0x6c
created by github.com/lxc/lxd/shared/subprocess.(*Process).start
/build/lxd/parts/lxd/src/shared/subprocess/proc.go:169 +0x79d

goroutine 1009 [IO wait]:
internal/poll.runtime_pollWait(0x7fc82e606990, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc0002fe900?, 0xc000633291?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0002fe900, {0xc000633291, 0xd6f, 0xd6f})
/snap/go/10030/src/internal/poll/fd_unix.go:167 +0x25a
net.(*netFD).Read(0xc0002fe900, {0xc000633291?, 0x445e80?, 0xc00048f1e0?})
/snap/go/10030/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc0009320c0, {0xc000633291?, 0xc000833e08?, 0x411725?})
/snap/go/10030/src/net/net.go:183 +0x45
bufio.(*Scanner).Scan(0xc000833f08)
/snap/go/10030/src/bufio/scan.go:214 +0x876
github.com/digitalocean/go-qemu/qmp.(*SocketMonitor).listen(0xc000041180, {0x1dd0be0?, 0xc0009320c0?}, 0xc0002a3980, 0xc0002a39e0)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/digitalocean/go-qemu@v0.0.0-20221209210016-f035778c97f7/qmp/socket.go:175 +0x10b
created by github.com/digitalocean/go-qemu/qmp.(*SocketMonitor).Connect
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/digitalocean/go-qemu@v0.0.0-20221209210016-f035778c97f7/qmp/socket.go:151 +0x358

goroutine 1090 [select]:
github.com/lxc/lxd/lxd/instance/drivers/qmp.(*Monitor).start.func2()
/build/lxd/parts/lxd/src/lxd/instance/drivers/qmp/monitor.go:91 +0xf9
created by github.com/lxc/lxd/lxd/instance/drivers/qmp.(*Monitor).start
/build/lxd/parts/lxd/src/lxd/instance/drivers/qmp/monitor.go:85 +0xea

goroutine 1006 [select, 10973 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 696789 [semacquire, 2346 minutes]:
sync.runtime_SemacquireMutex(0xc000e12270?, 0x0?, 0x7fc85629a108?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc00098ee23?, 0x7?}, {0xc00098ef07, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000bab4a0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000bab4a0, {0x0, 0x0, 0x203000?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000bab4a0, {0x1a781cd?, 0x1a781cd?, 0xc0006ae013?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.instanceGet(0xc0007c9610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instance_get.go:145 +0x2be
main.(*Daemon).createCmd.func1.3({0x1ba4818?, 0xc0001205b8?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e42a0}, 0xc000d0c300)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000d0c100?, {0x1dd9ec0?, 0xc0002e42a0?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e42a0}, 0xc000d0c000)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e42a0}, 0xc000d0c000)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc0009ee030?}, {0x1dd9ec0, 0xc0002e42a0}, 0xc000d0c000)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000904a00, {0x1ddae80, 0xc000c72bd0})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 695841 [semacquire, 2358 minutes]:
sync.runtime_Semacquire(0xc000bf53d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc000bf54f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc00012c700)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc000bf5610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e40e0}, 0xc00012c700)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc00012c200?, {0x1dd9ec0?, 0xc0002e40e0?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e40e0}, 0xc00012c000)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e40e0}, 0xc00012c000)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000382ab0?}, {0x1dd9ec0, 0xc0002e40e0}, 0xc00012c000)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000a10e60, {0x1ddae80, 0xc00131ff80})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 72744 [select, 10127 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 101867 [select, 9768 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 780690 [semacquire, 1053 minutes]:
sync.runtime_SemacquireMutex(0x48255e?, 0xe8?, 0xc000c898a0?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0012f0777?, 0x7?}, {0xc0006a5317, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*common).onStopOperationSetup(0xc0014326e0, {0x1a6fdba, 0x4})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_common.go:906 +0xab
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).onStop(0xc0014326e0, {0x1a6fdba, 0x4})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:554 +0x265
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).getMonitorEventHandler.func1({0xc0006a5130, 0x8}, 0xc0006b4f00?)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:395 +0x7da
created by github.com/lxc/lxd/lxd/instance/drivers/qmp.(*Monitor).start.func2
/build/lxd/parts/lxd/src/lxd/instance/drivers/qmp/monitor.go:97 +0x20d

goroutine 695170 [semacquire, 2363 minutes]:
sync.runtime_SemacquireMutex(0x7fc82ef77ca9?, 0x49?, 0x2022706f74732220?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.(*InstanceOperation).Done(0xc000c1b1a0, {0x1dca8a0?, 0xc0001d9520})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:251 +0x95
github.com/lxc/lxd/lxd/instance/operationlock.Create.func1(0xc000c1b1a0)
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:116 +0x21b
created by github.com/lxc/lxd/lxd/instance/operationlock.Create
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:99 +0x915

goroutine 72742 [select, 10127 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 738955 [semacquire, 1818 minutes]:
sync.runtime_SemacquireMutex(0x110000000000?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc00051f5b7?, 0x7?}, {0xc000a1bc27, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000b1b4a0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000b1b4a0, {0x0, 0x0, 0x4230b3?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000b1b4a0, {0xc0009eefc0?, 0xc00051f130?, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 72275 [select, 10129 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 814772 [semacquire, 359 minutes]:
sync.runtime_Semacquire(0xc0008b93d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc0008b94f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc000ea0400)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc0008b9610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e47e0}, 0xc000ea0400)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000ea0200?, {0x1dd9ec0?, 0xc0002e47e0?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e47e0}, 0xc000ea0100)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e47e0}, 0xc000ea0100)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000c1fda0?}, {0x1dd9ec0, 0xc0002e47e0}, 0xc000ea0100)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000692dc0, {0x1ddae80, 0xc000c1fd40})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 737941 [semacquire, 1828 minutes]:
sync.runtime_SemacquireMutex(0xc000943ad0?, 0x0?, 0x7fc85629aa68?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000f0f3d7?, 0x7?}, {0xc00098eb40, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc0006ce000)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc0006ce000, {0x0, 0x0, 0x203000?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc0006ce000, {0x1a781cd?, 0x1a781cd?, 0xc001190013?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.instanceGet(0xc0005db610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instance_get.go:145 +0x2be
main.(*Daemon).createCmd.func1.3({0x1ba4818?, 0xc0001205b8?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e4460}, 0xc0003b0800)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc0003b0600?, {0x1dd9ec0?, 0xc0002e4460?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e4460}, 0xc0003b0500)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e4460}, 0xc0003b0500)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000500030?}, {0x1dd9ec0, 0xc0002e4460}, 0xc0003b0500)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc00050ebe0, {0x1ddae80, 0xc000c73e00})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 695858 [semacquire, 2358 minutes]:
sync.runtime_SemacquireMutex(0x211c001430370?, 0x10?, 0xc000c65210?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0006cc4c3?, 0x7?}, {0xc0006cc56b, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000baa420)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000baa420, {0x0, 0x0, 0x4230b3?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000baa420, {0xc00092c4b0?, 0xc000922218?, 0x6?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 101865 [select, 9768 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 738954 [semacquire, 1818 minutes]:
sync.runtime_SemacquireMutex(0x2110000000000?, 0x0?, 0xc00091c248?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc00051f5b7?, 0x7?}, {0xc000a1bb3b, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000b1b340)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000b1b340, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000b1b340, {0xc0009eefc0?, 0xc00051f2c0?, 0x10?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 781119 [semacquire, 1048 minutes]:
sync.runtime_SemacquireMutex(0x11c000678160?, 0x10?, 0xc000b0b210?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000a50737?, 0x7?}, {0xc000a508a7, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc001432840)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc001432840, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc001432840, {0xc0008cf950?, 0xc000a1b158?, 0x7?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 72640 [select, 10127 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 101894 [select, 9768 minutes]:
os/exec.(*Cmd).watchCtx.func1()
/snap/go/10030/src/os/exec/exec.go:648 +0x96
created by os/exec.(*Cmd).watchCtx
/snap/go/10030/src/os/exec/exec.go:647 +0x8e

goroutine 738243 [semacquire, 1826 minutes]:
sync.runtime_SemacquireMutex(0x3?, 0xe0?, 0xc000a2a0c0?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc00098f100?, 0x7?}, {0xc00098f1d0, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000b1ab00)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Stop(0xc000b1ab00, 0x0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:3958 +0x216
main.doInstanceStatePut({0x1dff710?, 0xc000b1ab00?}, {{0xc000378f98?, 0xc00004e0c0?}, 0xc000d91590?, 0xc0?, 0x80?})
/build/lxd/parts/lxd/src/lxd/instance_state.go:233 +0x63
main.instanceStatePut.func1(0xc0000c40e0?)
/build/lxd/parts/lxd/src/lxd/instance_state.go:195 +0x6a
github.com/lxc/lxd/lxd/operations.(*Operation).Start.func1(0xc0008585a0)
/build/lxd/parts/lxd/src/lxd/operations/operations.go:281 +0x2c
created by github.com/lxc/lxd/lxd/operations.(*Operation).Start
/build/lxd/parts/lxd/src/lxd/operations/operations.go:280 +0xf7

goroutine 814825 [semacquire, 359 minutes]:
sync.runtime_SemacquireMutex(0x0?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000c4f5b7?, 0x7?}, {0xc000a51347, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc0014331e0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc0014331e0, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc0014331e0, {0xc000ab27b0?, 0xc000c4f188?, 0x7?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 829299 [IO wait]:
internal/poll.runtime_pollWait(0x7fc82e6067b0, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc0002fe180?, 0x6?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0002fe180)
/snap/go/10030/src/internal/poll/fd_unix.go:614 +0x234
net.(*netFD).accept(0xc0002fe180)
/snap/go/10030/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc000121b90)
/snap/go/10030/src/net/tcpsock_posix.go:142 +0x28
net.(*TCPListener).Accept(0xc000121b90)
/snap/go/10030/src/net/tcpsock.go:288 +0x3d
net/http.(*Server).Serve(0xc00022c4b0, {0x1dd9c80, 0xc000121b90})
/snap/go/10030/src/net/http/server.go:3070 +0x385
github.com/lxc/lxd/lxd/endpoints.(*Endpoints).serve.func1()
/build/lxd/parts/lxd/src/lxd/endpoints/endpoints.go:415 +0x25
gopkg.in/tomb%2ev2.(*Tomb).run(0xc000a2cd70, 0xc0005b9280?)
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:163 +0x36
created by gopkg.in/tomb%2ev2.(*Tomb).Go
/build/lxd/parts/lxd/src/.go/pkg/mod/gopkg.in/tomb.v2@v2.0.0-20161208151619-d5d1b5820637/tomb.go:159 +0xee

goroutine 784386 [semacquire, 985 minutes]:
sync.runtime_Semacquire(0xc000d233d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc000d234f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc000fe0500)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc000d23610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e4620}, 0xc000fe0500)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000fe0200?, {0x1dd9ec0?, 0xc0002e4620?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e4620}, 0xc000fe0100)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e4620}, 0xc000fe0100)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000ab2930?}, {0x1dd9ec0, 0xc0002e4620}, 0xc000fe0100)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000c18280, {0x1ddae80, 0xc000ab28a0})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 696118 [semacquire, 2356 minutes]:
sync.runtime_SemacquireMutex(0x11c000b42820?, 0x0?, 0x7fc85629b3c8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0006cc4e7?, 0x7?}, {0xc0006cc6e7, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000baac60)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000baac60, {0x0, 0x0, 0x203000?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000baac60, {0x1a781cd?, 0x1a781cd?, 0xc0013124f3?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.instanceGet(0xc000c69610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instance_get.go:145 +0x2be
main.(*Daemon).createCmd.func1.3({0x1ba4818?, 0xc0001205b8?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e41c0}, 0xc000ea0300)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000ea0100?, {0x1dd9ec0?, 0xc0002e41c0?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e41c0}, 0xc000ea0000)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e41c0}, 0xc000ea0000)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000bd45a0?}, {0x1dd9ec0, 0xc0002e41c0}, 0xc000ea0000)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000904b40, {0x1ddae80, 0xc00108f110})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 781069 [semacquire, 1048 minutes]:
sync.runtime_Semacquire(0xc000c893d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc000c894f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc0003b0a00)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc000c89610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e4700}, 0xc0003b0a00)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc0003b0700?, {0x1dd9ec0?, 0xc0002e4700?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e4700}, 0xc0003b0600)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e4700}, 0xc0003b0600)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc00131e780?}, {0x1dd9ec0, 0xc0002e4700}, 0xc0003b0600)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000c19400, {0x1ddae80, 0xc0008cf740})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 781121 [semacquire, 1048 minutes]:
sync.runtime_SemacquireMutex(0x200c000678160?, 0x10?, 0xc0008b5210?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000a50737?, 0x7?}, {0xc000a507db, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc001432dc0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc001432dc0, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc001432dc0, {0xc0008cf950?, 0xc000a1b358?, 0x6?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 738938 [semacquire, 1818 minutes]:
sync.runtime_Semacquire(0xc0009653d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc0009654f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc000fe1700)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc000965610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc000ba81c0}, 0xc000fe1700)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000fe1500?, {0x1dd9ec0?, 0xc000ba81c0?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc000ba81c0}, 0xc000fe1400)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc000ba81c0}, 0xc000fe1400)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc0003b7e00?}, {0x1dd9ec0, 0xc000ba81c0}, 0xc000fe1400)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000a10500, {0x1ddae80, 0xc0003b7c50})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 814827 [semacquire, 359 minutes]:
sync.runtime_SemacquireMutex(0x200c000678160?, 0x10?, 0xc000f17210?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000c4f5b7?, 0x7?}, {0xc000a5127b, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc001433340)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc001433340, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc001433340, {0xc000ab27b0?, 0xc000c4f340?, 0x10?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 769949 [semacquire, 1249 minutes]:
sync.runtime_SemacquireMutex(0xc000c169c0?, 0x0?, 0x7fc85629aa68?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0006a4b43?, 0x7?}, {0xc0006a4d57, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000c446e0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000c446e0, {0x0, 0x0, 0x203000?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000c446e0, {0x1a781cd?, 0x1a781cd?, 0xc0005d6073?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.instanceGet(0xc000969610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instance_get.go:145 +0x2be
main.(*Daemon).createCmd.func1.3({0x1ba4818?, 0xc0001205b8?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc000ba80e0}, 0xc0003b1c00)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc0003b1a00?, {0x1dd9ec0?, 0xc000ba80e0?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc000ba80e0}, 0xc0003b1900)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc000ba80e0}, 0xc0003b1900)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000ab2690?}, {0x1dd9ec0, 0xc000ba80e0}, 0xc0003b1900)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000a47d60, {0x1ddae80, 0xc000ab2630})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 738869 [semacquire, 1812 minutes]:
sync.runtime_SemacquireMutex(0x100c00068eba0?, 0x78?, 0x0?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000f0e1e3?, 0x7?}, {0xc000f38187, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000b1a580)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).IsRunning(0xc000b1a580)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5945 +0x1e
main.(*Daemon).numRunningInstances(…)
/build/lxd/parts/lxd/src/lxd/daemon.go:1594
main.(*Daemon).Stop(0xc00040e3c0, {0x1ddae10, 0xc00004a0b0}, {0x1dd79a0?, 0x2920478})
/build/lxd/parts/lxd/src/lxd/daemon.go:1717 +0x15e2
main.(*cmdDaemon).Run.func1()
/build/lxd/parts/lxd/src/lxd/main_daemon.go:90 +0x38
created by main.(*cmdDaemon).Run
/build/lxd/parts/lxd/src/lxd/main_daemon.go:89 +0x885

goroutine 695859 [semacquire, 2358 minutes]:
sync.runtime_SemacquireMutex(0x0?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0006cc4c3?, 0x7?}, {0xc0006cc637, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000baa580)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000baa580, {0x0, 0x0, 0x4230b3?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000baa580, {0xc00092c4b0?, 0xc000922128?, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 780756 [semacquire, 1050 minutes]:
sync.runtime_Semacquire(0xc000bf13d8?)
/snap/go/10030/src/runtime/sema.go:62 +0x25
sync.(*WaitGroup).Wait(0xc000bf14f0?)
/snap/go/10030/src/sync/waitgroup.go:139 +0x52
main.doInstancesGet(0xc00040e3c0, 0xc000fe0300)
/build/lxd/parts/lxd/src/lxd/instances_get.go:500 +0xb7a
main.instancesGet(0xc000bf1610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instances_get.go:222 +0x56
main.(*Daemon).createCmd.func1.3({0x1ba48b0?, 0xc000120d80?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc0002e4540}, 0xc000fe0300)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000fe0100?, {0x1dd9ec0?, 0xc0002e4540?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc0002e4540}, 0xc000fe0000)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc0002e4540}, 0xc000fe0000)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000a4e450?}, {0x1dd9ec0, 0xc0002e4540}, 0xc000fe0000)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000bd6000, {0x1ddae80, 0xc000a4e270})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 832566 [IO wait]:
internal/poll.runtime_pollWait(0x7fc82c39edd0, 0x72)
/snap/go/10030/src/runtime/netpoll.go:305 +0x89
internal/poll.(*pollDesc).wait(0xc000724280?, 0xc0012090c1?, 0x0)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(…)
/snap/go/10030/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000724280, {0xc0012090c1, 0x1, 0x1})
/snap/go/10030/src/internal/poll/fd_unix.go:167 +0x25a
net.(*netFD).Read(0xc000724280, {0xc0012090c1?, 0x13e5408?, 0x1a7be92?})
/snap/go/10030/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc000388048, {0xc0012090c1?, 0xc000390320?, 0xc000d49ea8?})
/snap/go/10030/src/net/net.go:183 +0x45
net/http.(*connReader).backgroundRead(0xc0012090b0)
/snap/go/10030/src/net/http/server.go:678 +0x3f
created by net/http.(*connReader).startBackgroundRead
/snap/go/10030/src/net/http/server.go:674 +0xca

goroutine 784394 [semacquire, 985 minutes]:
sync.runtime_SemacquireMutex(0x110000000000?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000661b97?, 0x7?}, {0xc0012f0257, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc0004e0f20)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc0004e0f20, {0x0, 0x0, 0x4230b3?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc0004e0f20, {0xc000df07b0?, 0xc0010123c0?, 0x7?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 829385 [semacquire, 61 minutes]:
sync.runtime_SemacquireMutex(0x110000000000?, 0x0?, 0xc00091c250?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000f0e067?, 0x7?}, {0xc000660377, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000c322c0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000c322c0, {0x0, 0x0, 0x4230b3?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000c322c0, {0xc0007b3530?, 0xc000703d48?, 0x7?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 780766 [semacquire, 1050 minutes]:
sync.runtime_SemacquireMutex(0x2110000000000?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0012f0300?, 0x7?}, {0xc0006a5b9b, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000c45080)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000c45080, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000c45080, {0xc000bd4a50?, 0xc0012f0230?, 0x10?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

goroutine 782146 [semacquire, 1030 minutes]:
sync.runtime_SemacquireMutex(0xc0012812b0?, 0x0?, 0x7fc85629b878?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc0012f0267?, 0x7?}, {0xc0012f0590, 0x5})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc0004e02c0)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc0004e02c0, {0x0, 0x0, 0x203000?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc0004e02c0, {0x1a781cd?, 0x1a781cd?, 0xc000a08373?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.instanceGet(0xc000e0b610?, 0x419207?)
/build/lxd/parts/lxd/src/lxd/instance_get.go:145 +0x2be
main.(*Daemon).createCmd.func1.3({0x1ba4818?, 0xc0001205b8?, 0xc0?})
/build/lxd/parts/lxd/src/lxd/daemon.go:686 +0xef
main.(*Daemon).createCmd.func1({0x1dd9ec0, 0xc000ba8380}, 0xc000fe0900)
/build/lxd/parts/lxd/src/lxd/daemon.go:691 +0x143c
net/http.HandlerFunc.ServeHTTP(0xc000fe0700?, {0x1dd9ec0?, 0xc000ba8380?}, 0x1a6d826?)
/snap/go/10030/src/net/http/server.go:2109 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc0001dcd80, {0x1dd9ec0, 0xc000ba8380}, 0xc000fe0600)
/build/lxd/parts/lxd/src/.go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210 +0x1cf
main.(*lxdHttpServer).ServeHTTP(0xc000a24470, {0x1dd9ec0, 0xc000ba8380}, 0xc000fe0600)
/build/lxd/parts/lxd/src/lxd/api.go:177 +0xdc
net/http.serverHandler.ServeHTTP({0xc000d91a40?}, {0x1dd9ec0, 0xc000ba8380}, 0xc000fe0600)
/snap/go/10030/src/net/http/server.go:2947 +0x30c
net/http.(*conn).serve(0xc000a475e0, {0x1ddae80, 0xc000d919e0})
/snap/go/10030/src/net/http/server.go:1991 +0x607
created by net/http.(*Server).Serve
/snap/go/10030/src/net/http/server.go:3102 +0x4db

goroutine 829384 [semacquire, 61 minutes]:
sync.runtime_SemacquireMutex(0x2000000000000?, 0x0?, 0xc00091c2d8?)
/snap/go/10030/src/runtime/sema.go:77 +0x25
sync.(*Mutex).lockSlow(0x2f1ece0)
/snap/go/10030/src/sync/mutex.go:171 +0x165
sync.(*Mutex).Lock(…)
/snap/go/10030/src/sync/mutex.go:90
github.com/lxc/lxd/lxd/instance/operationlock.Get({0xc000f0e067?, 0x7?}, {0xc000660267, 0x3})
/build/lxd/parts/lxd/src/lxd/instance/operationlock/operationlock.go:176 +0x95
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).statusCode(0xc000c32420)
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:6047 +0x72
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).Render(0xc000c32420, {0x0, 0x0, 0x8?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5729 +0x312
github.com/lxc/lxd/lxd/instance/drivers.(*qemu).RenderFull(0xc000c32420, {0xc0007b3530?, 0xc000703dd0?, 0x10?})
/build/lxd/parts/lxd/src/lxd/instance/drivers/driver_qemu.go:5769 +0x4a
main.doInstancesGet.func5()
/build/lxd/parts/lxd/src/lxd/instances_get.go:480 +0x276
created by main.doInstancesGet
/build/lxd/parts/lxd/src/lxd/instances_get.go:457 +0x1091

Do you have any qemu processes running now?

Yes one. One debian vm. Only the win11 vm crashed now. containers are working.

But still cant do any lxc info, exec, list etc

That doesn’t really answer my question. Please show ps aux | grep qemu output

lxd 14624 5.4 5.7 8901696 7633520 ? Sl Apr27 598:43 /snap/lxd/24322/bin/qemu-system-x86_64 -S -name Debian -uuid e3932e4b-9226-463d-a85c-64005a85e83f -daemonize -cpu host,hv_passthrough -nographic -serial chardev:console -nodefaults -no-user-config -sandbox on,obsolete=deny,elevateprivileges=allow,spawn=allow,resourcecontrol=deny -readconfig /var/snap/lxd/common/lxd/logs/Debian/qemu.conf -spice unix=on,disable-ticketing=on,addr=/var/snap/lxd/common/lxd/logs/Debian/qemu.spice -pidfile /var/snap/lxd/common/lxd/logs/Debian/qemu.pid -D /var/snap/lxd/common/lxd/logs/Debian/qemu.log -smbios type=2,manufacturer=Canonical Ltd.,product=LXD -runas lxd
user 2735973 0.0 0.0 7004 2092 pts/4 S+ 14:58 0:00 grep --color=auto qemu

updated to latest stable. now i can do lxc list again without anything restarted

1 Like

@tomp little update.

Win11 vm crashed with this error: qemu-system-x86_64: Issue while setting TUNSETSTEERINGEBPF: Invalid argument with fd: 50, pro│
g_fd: -1

everything else is working and lxd is responsive. Debian vm is ok.
Started the win vm again so that worked.
Edit: Win11 crasched again. Ive been downloading, so maybe io thats causing this. Trying to see if the vm crashes with no activity.

281094 lxd 20 0 17.3g 16.1g 16.0g S 414.9 12.8 1476:43 qemu-system-x86

414.9% cpu usage. cant be good

Does this occur when snap refreshes perhaps?

What happens if you have the win11 VM running OK and then reload LXD, using sudo systemctl reload snap.lxd.daemon, do you see the same entries in lxc info <instance> --show-log afterwards?

I get Error: open /var/snap/lxd/common/lxd/logs/win11/qemu.log: no such file or directory

1 Like

Are you able to try this with the LXD 5.14 release that comes out this week?

Be aware that upgrading from 5.0.x LTS to LXD 5.x will prevent downgrading back to the LTS series, so may be worth trying it on a separate system.

This will come with a newer version of QEMU, and some improvements in LXD that will detect crashed QEMU processes in some circumstances, which may help here.

I already upgrades to 5.13 latest stable a few weeks ago so should be fine. It has worked better then the LTS. VM hasnt crashed in over a week.

1 Like

@tomp it winvm crashed yesterday. Debian vm times out but came back after a few minutes. Restarted the lxd daemon and it worked again. But at least it worked way longer now. I hope the 5.14 will fix it.

@tomp ubuntu updated to latest packages and lxd 5.14. Server rebooted.