jegan
April 13, 2020, 6:48am
1
After the snap refresh to lxd 4.0 on CentOS 7, I have the following issues.
“lxc shell cont1” takes around 25 Seconds
lxcfs high CPU usage (around 30%)
Create session errors inside the containers and slow ssh connections
Apr 13 12:00:26 cont1 crond[6715]: pam_systemd(crond:session): Failed to create session: Connection timed out
Apr 13 12:00:26 cont1 crond[6706]: pam_systemd(crond:session): Failed to create session: Connection timed out
Apr 13 12:00:26 cont1 crond[6700]: pam_systemd(crond:session): Failed to create session: Connection timed out
Apr 13 12:00:26 cont1 sshd[6728]: pam_systemd(sshd:session): Failed to create session: Connection timed out
Apr 13 12:00:26 cont1 sshd[6728]: pam_unix(sshd:session): session opened for user rss by (uid=0)
Apr 13 12:00:26 cont1 sshd[6732]: pam_systemd(sshd:session): Failed to create session: Connection timed out
unable to run systemctl commands inside the containers.
[root@cont1 ~]# systemctl
These issues appears again in few hours after restarting.
xlmnxp
April 13, 2020, 7:20am
2
Kernel: 3.10.0-1062.9.1.el7.x86_64 !
I too have the same issues. After a snap refresh to lxd 4.0.1 on Centos 7.7 has:
A similarly high CPU usage for lxcfs - around 25% CPU;
Similar issues with systemctl command:
Starting many sessions connection times out;
Containers that were running retain their ipv4 addresses but new containers and restarted containers do not get allocated ipv4 addresses.
OS: CentOS Linux release 7.7
stgraber
April 22, 2020, 1:29pm
4
Can you show snap version?ps fauxww and journalctl -u snap.lxd.daemon -n 300 would be useful.
jegan
April 22, 2020, 2:10pm
6
@stgraber , thanks for looking into this.
sh-4.2# snap version
snap 2.42.2-1.el7
snapd 2.42.2-1.el7
series 16
centos 7
kernel 3.10.0-1062.9.1.el7.x86_64
sh-4.2# ps fauxww
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 2 0.0 0.0 0 0 ? S Apr13 0:00 [kthreadd]
root 4 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/0:0H]
root 6 0.0 0.0 0 0 ? S Apr13 0:26 \_ [ksoftirqd/0]
root 7 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/0]
root 8 0.0 0.0 0 0 ? S Apr13 0:00 \_ [rcu_bh]
root 9 0.5 0.0 0 0 ? S Apr13 70:30 \_ [rcu_sched]
root 10 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [lru-add-drain]
root 11 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/0]
root 12 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/1]
root 13 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/1]
root 14 0.0 0.0 0 0 ? S Apr13 0:17 \_ [ksoftirqd/1]
root 16 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/1:0H]
root 18 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/2]
root 19 0.0 0.0 0 0 ? S Apr13 0:06 \_ [migration/2]
root 20 0.0 0.0 0 0 ? S Apr13 0:26 \_ [ksoftirqd/2]
root 22 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/2:0H]
root 23 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/3]
root 24 0.0 0.0 0 0 ? S Apr13 0:14 \_ [migration/3]
root 25 0.0 0.0 0 0 ? S Apr13 0:08 \_ [ksoftirqd/3]
root 27 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/3:0H]
root 28 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/4]
root 29 0.0 0.0 0 0 ? S Apr13 0:09 \_ [migration/4]
root 30 0.0 0.0 0 0 ? S Apr13 0:10 \_ [ksoftirqd/4]
root 32 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/4:0H]
root 33 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/5]
root 34 0.0 0.0 0 0 ? S Apr13 0:09 \_ [migration/5]
root 35 0.0 0.0 0 0 ? S Apr13 0:23 \_ [ksoftirqd/5]
root 37 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/5:0H]
root 38 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/6]
root 39 0.0 0.0 0 0 ? S Apr13 0:08 \_ [migration/6]
root 40 0.0 0.0 0 0 ? S Apr13 0:10 \_ [ksoftirqd/6]
root 42 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/6:0H]
root 43 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/7]
root 44 0.0 0.0 0 0 ? S Apr13 0:06 \_ [migration/7]
root 45 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/7]
root 47 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/7:0H]
root 48 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/8]
root 49 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/8]
root 50 0.0 0.0 0 0 ? S Apr13 0:11 \_ [ksoftirqd/8]
root 52 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/8:0H]
root 53 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/9]
root 54 0.0 0.0 0 0 ? S Apr13 0:08 \_ [migration/9]
root 55 0.0 0.0 0 0 ? S Apr13 0:23 \_ [ksoftirqd/9]
root 57 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/9:0H]
root 58 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/10]
root 59 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/10]
root 60 0.0 0.0 0 0 ? S Apr13 0:19 \_ [ksoftirqd/10]
root 62 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/10:0H]
root 63 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/11]
root 64 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/11]
root 65 0.0 0.0 0 0 ? S Apr13 0:10 \_ [ksoftirqd/11]
root 67 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/11:0H]
root 68 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/12]
root 69 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/12]
root 70 0.0 0.0 0 0 ? S Apr13 0:22 \_ [ksoftirqd/12]
root 72 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/12:0H]
root 73 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/13]
root 74 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/13]
root 75 0.0 0.0 0 0 ? S Apr13 0:04 \_ [ksoftirqd/13]
root 77 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/13:0H]
root 78 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/14]
root 79 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/14]
root 80 0.0 0.0 0 0 ? S Apr13 0:24 \_ [ksoftirqd/14]
root 82 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/14:0H]
root 83 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/15]
root 84 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/15]
root 85 0.0 0.0 0 0 ? S Apr13 0:21 \_ [ksoftirqd/15]
root 87 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/15:0H]
root 88 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/16]
root 89 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/16]
root 90 0.0 0.0 0 0 ? S Apr13 0:04 \_ [ksoftirqd/16]
root 92 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/16:0H]
root 94 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/17]
root 95 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/17]
root 96 0.0 0.0 0 0 ? S Apr13 0:04 \_ [ksoftirqd/17]
root 98 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/17:0H]
root 99 0.0 0.0 0 0 ? S Apr13 0:03 \_ [watchdog/18]
root 100 0.0 0.0 0 0 ? S Apr13 0:09 \_ [migration/18]
root 101 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/18]
root 103 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/18:0H]
root 104 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/19]
root 105 0.0 0.0 0 0 ? S Apr13 0:06 \_ [migration/19]
root 106 0.0 0.0 0 0 ? S Apr13 0:05 \_ [ksoftirqd/19]
root 108 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/19:0H]
root 109 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/20]
root 110 0.0 0.0 0 0 ? S Apr13 0:08 \_ [migration/20]
root 111 0.0 0.0 0 0 ? S Apr13 0:14 \_ [ksoftirqd/20]
root 113 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/20:0H]
root 114 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/21]
root 115 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/21]
root 116 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/21]
root 118 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/21:0H]
root 119 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/22]
root 120 0.0 0.0 0 0 ? S Apr13 0:07 \_ [migration/22]
root 121 0.0 0.0 0 0 ? S Apr13 0:15 \_ [ksoftirqd/22]
root 123 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/22:0H]
root 124 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/23]
root 125 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/23]
root 126 0.0 0.0 0 0 ? S Apr13 0:24 \_ [ksoftirqd/23]
root 128 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/23:0H]
root 129 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/24]
root 130 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/24]
root 131 0.0 0.0 0 0 ? S Apr13 0:14 \_ [ksoftirqd/24]
root 133 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/24:0H]
root 134 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/25]
root 135 0.0 0.0 0 0 ? S Apr13 0:05 \_ [migration/25]
root 136 0.0 0.0 0 0 ? S Apr13 0:21 \_ [ksoftirqd/25]
root 138 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/25:0H]
root 139 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/26]
root 140 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/26]
root 141 0.0 0.0 0 0 ? S Apr13 0:03 \_ [ksoftirqd/26]
root 143 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/26:0H]
root 144 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/27]
root 145 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/27]
root 146 0.0 0.0 0 0 ? S Apr13 0:06 \_ [ksoftirqd/27]
root 148 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/27:0H]
root 149 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/28]
root 150 0.0 0.0 0 0 ? S Apr13 0:05 \_ [migration/28]
root 151 0.0 0.0 0 0 ? S Apr13 0:25 \_ [ksoftirqd/28]
root 153 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/28:0H]
root 154 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/29]
root 155 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/29]
root 156 0.0 0.0 0 0 ? S Apr13 0:12 \_ [ksoftirqd/29]
root 158 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/29:0H]
root 159 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/30]
root 160 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/30]
root 161 0.0 0.0 0 0 ? S Apr13 0:01 \_ [ksoftirqd/30]
root 163 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/30:0H]
root 164 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/31]
root 165 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/31]
root 166 0.0 0.0 0 0 ? S Apr13 0:08 \_ [ksoftirqd/31]
root 168 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/31:0H]
root 169 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/32]
root 170 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/32]
root 171 0.0 0.0 0 0 ? S Apr13 0:08 \_ [ksoftirqd/32]
root 173 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/32:0H]
root 174 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/33]
root 175 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/33]
root 176 0.0 0.0 0 0 ? S Apr13 0:03 \_ [ksoftirqd/33]
root 178 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/33:0H]
root 179 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/34]
root 180 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/34]
root 181 0.0 0.0 0 0 ? S Apr13 0:06 \_ [ksoftirqd/34]
root 183 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/34:0H]
root 184 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/35]
root 185 0.0 0.0 0 0 ? S Apr13 0:06 \_ [migration/35]
root 186 0.0 0.0 0 0 ? S Apr13 0:22 \_ [ksoftirqd/35]
root 188 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/35:0H]
root 189 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/36]
root 190 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/36]
root 191 0.0 0.0 0 0 ? S Apr13 0:16 \_ [ksoftirqd/36]
root 193 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/36:0H]
root 194 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/37]
root 195 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/37]
root 196 0.0 0.0 0 0 ? S Apr13 0:13 \_ [ksoftirqd/37]
root 198 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/37:0H]
root 199 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/38]
root 200 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/38]
root 201 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/38]
root 203 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/38:0H]
root 204 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/39]
root 205 0.0 0.0 0 0 ? S Apr13 0:05 \_ [migration/39]
root 206 0.0 0.0 0 0 ? S Apr13 0:24 \_ [ksoftirqd/39]
root 208 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/39:0H]
root 209 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/40]
root 210 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/40]
root 211 0.0 0.0 0 0 ? S Apr13 0:05 \_ [ksoftirqd/40]
root 213 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/40:0H]
root 214 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/41]
root 215 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/41]
root 216 0.0 0.0 0 0 ? S Apr13 0:12 \_ [ksoftirqd/41]
root 218 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/41:0H]
root 219 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/42]
root 220 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/42]
root 221 0.0 0.0 0 0 ? S Apr13 0:05 \_ [ksoftirqd/42]
root 223 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/42:0H]
root 224 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/43]
root 225 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/43]
root 226 0.0 0.0 0 0 ? S Apr13 0:03 \_ [ksoftirqd/43]
root 228 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/43:0H]
root 229 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/44]
root 230 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/44]
root 231 0.0 0.0 0 0 ? S Apr13 0:08 \_ [ksoftirqd/44]
root 233 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/44:0H]
root 234 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/45]
root 235 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/45]
root 236 0.0 0.0 0 0 ? S Apr13 0:07 \_ [ksoftirqd/45]
root 238 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/45:0H]
root 239 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/46]
root 240 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/46]
root 241 0.0 0.0 0 0 ? S Apr13 0:05 \_ [ksoftirqd/46]
root 243 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/46:0H]
root 244 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/47]
root 245 0.0 0.0 0 0 ? S Apr13 0:05 \_ [migration/47]
root 246 0.0 0.0 0 0 ? S Apr13 0:03 \_ [ksoftirqd/47]
root 248 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/47:0H]
root 249 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/48]
root 250 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/48]
root 251 0.0 0.0 0 0 ? S Apr13 0:00 \_ [ksoftirqd/48]
root 253 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/48:0H]
root 254 0.0 0.0 0 0 ? S Apr13 0:03 \_ [watchdog/49]
root 255 0.0 0.0 0 0 ? S Apr13 0:16 \_ [migration/49]
root 256 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/49]
root 258 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/49:0H]
root 259 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/50]
root 260 0.0 0.0 0 0 ? S Apr13 0:05 \_ [migration/50]
root 261 0.0 0.0 0 0 ? S Apr13 0:01 \_ [ksoftirqd/50]
root 263 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/50:0H]
root 264 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/51]
root 265 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/51]
root 266 0.0 0.0 0 0 ? S Apr13 0:07 \_ [ksoftirqd/51]
root 268 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/51:0H]
root 269 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/52]
root 270 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/52]
root 271 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/52]
root 273 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/52:0H]
root 274 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/53]
root 275 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/53]
root 276 0.0 0.0 0 0 ? S Apr13 0:03 \_ [ksoftirqd/53]
root 278 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/53:0H]
root 279 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/54]
root 280 0.0 0.0 0 0 ? S Apr13 0:05 \_ [migration/54]
root 281 0.0 0.0 0 0 ? S Apr13 0:08 \_ [ksoftirqd/54]
root 283 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/54:0H]
root 284 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/55]
root 285 0.0 0.0 0 0 ? S Apr13 0:04 \_ [migration/55]
root 286 0.0 0.0 0 0 ? S Apr13 0:07 \_ [ksoftirqd/55]
root 288 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/55:0H]
root 289 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/56]
root 290 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/56]
root 291 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/56]
root 293 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/56:0H]
root 294 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/57]
root 295 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/57]
root 296 0.0 0.0 0 0 ? S Apr13 0:06 \_ [ksoftirqd/57]
root 298 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/57:0H]
root 299 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/58]
root 300 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/58]
root 301 0.0 0.0 0 0 ? S Apr13 0:13 \_ [ksoftirqd/58]
root 303 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/58:0H]
root 304 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/59]
root 305 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/59]
root 306 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/59]
root 308 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/59:0H]
root 309 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/60]
root 310 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/60]
root 311 0.0 0.0 0 0 ? S Apr13 0:01 \_ [ksoftirqd/60]
root 313 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/60:0H]
root 314 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/61]
root 315 0.0 0.0 0 0 ? S Apr13 0:01 \_ [migration/61]
root 316 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/61]
root 318 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/61:0H]
root 319 0.0 0.0 0 0 ? S Apr13 0:03 \_ [watchdog/62]
root 320 0.0 0.0 0 0 ? S Apr13 0:03 \_ [migration/62]
root 321 0.0 0.0 0 0 ? S Apr13 0:12 \_ [ksoftirqd/62]
root 323 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/62:0H]
root 324 0.0 0.0 0 0 ? S Apr13 0:02 \_ [watchdog/63]
root 325 0.0 0.0 0 0 ? S Apr13 0:02 \_ [migration/63]
root 326 0.0 0.0 0 0 ? S Apr13 0:02 \_ [ksoftirqd/63]
root 328 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/63:0H]
root 331 0.0 0.0 0 0 ? S Apr13 0:00 \_ [kdevtmpfs]
root 332 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [netns]
root 333 0.0 0.0 0 0 ? S Apr13 0:02 \_ [khungtaskd]
root 334 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [writeback]
root 335 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kintegrityd]
root 336 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [bioset]
root 337 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [bioset]
root 338 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [bioset]
root 339 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kblockd]
root 340 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [md]
root 341 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [edac-poller]
root 342 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [watchdogd]
root 349 0.0 0.0 0 0 ? S Apr13 1:54 \_ [kswapd0]
root 350 0.0 0.0 0 0 ? S Apr13 1:39 \_ [kswapd1]
root 351 0.0 0.0 0 0 ? SN Apr13 0:00 \_ [ksmd]
root 352 0.0 0.0 0 0 ? SN Apr13 0:15 \_ [khugepaged]
root 353 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [crypto]
root 361 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kthrotld]
root 365 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kmpath_rdacd]
root 366 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kaluad]
root 370 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kpsmoused]
root 371 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [ipv6_addrconf]
root 384 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [deferwq]
root 420 0.0 0.0 0 0 ? S Apr13 0:17 \_ [kworker/38:1]
root 433 0.0 0.0 0 0 ? S Apr13 0:20 \_ [kworker/47:1]
root 480 0.0 0.0 0 0 ? S Apr13 0:00 \_ [kauditd]
root 643 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [nfit]
root 665 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [ata_sff]
root 666 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [i40e]
root 667 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_0]
root 668 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_0]
root 882 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_1]
root 885 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_1]
root 904 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_2]
root 906 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_2]
root 928 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_3]
root 929 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_3]
root 953 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_4]
root 954 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_4]
root 968 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_5]
root 969 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_5]
root 983 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_6]
root 984 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_6]
root 1414 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [ttm_swap]
root 1465 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [poll_megasas0_s]
root 1466 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_7]
root 1467 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_7]
root 1468 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_8]
root 1469 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_8]
root 1470 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_9]
root 1471 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_9]
root 1472 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_10]
root 1473 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_10]
root 1474 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_11]
root 1475 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_11]
root 1476 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_12]
root 1477 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_12]
root 1478 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_13]
root 1479 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_13]
root 1480 0.0 0.0 0 0 ? S Apr13 0:00 \_ [scsi_eh_14]
root 1481 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [scsi_tmf_14]
root 1592 0.4 0.0 0 0 ? S Apr13 56:42 \_ [jbd2/sda5-8]
root 1593 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [ext4-rsv-conver]
root 1727 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [loop2]
root 1730 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [loop3]
root 1879 0.0 0.0 0 0 ? SN Apr13 0:00 \_ [kipmi0]
root 1880 0.0 0.0 0 0 ? S Apr13 0:00 \_ [irq/310-mei_me]
root 1904 0.0 0.0 0 0 ? S Apr13 0:16 \_ [kworker/52:2]
root 1938 0.0 0.0 0 0 ? S Apr13 0:00 \_ [jbd2/sda1-8]
root 1939 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [ext4-rsv-conver]
root 1941 0.0 0.0 0 0 ? S Apr13 0:00 \_ [jbd2/sda3-8]
root 1942 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [ext4-rsv-conver]
root 1970 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kvm-irqfd-clean]
root 3159 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/34:1H]
root 3189 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [bond0]
root 3606 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/6:1H]
root 3827 0.2 0.0 0 0 ? S< Apr13 27:06 \_ [hcp_watchdog]
root 4762 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/0:1H]
root 4821 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [dio/sda5]
root 9353 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/33:1H]
root 13973 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/29:1H]
root 20748 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/42:1H]
root 34681 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/24:1H]
root 44207 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/37:1H]
root 45217 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/26:1H]
root 45551 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/2:1H]
root 45705 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/15:1H]
root 46011 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/7:1H]
root 50660 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/38:1H]
root 50807 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/11:1H]
root 63549 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/23:1H]
root 64594 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/13:1H]
root 68398 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/56:1H]
root 70994 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/4:1H]
root 77015 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/27:1H]
root 84035 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/25:1H]
root 85620 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/35:1H]
root 90420 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/22:1H]
root 104287 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/20:1H]
root 111849 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/59:1H]
root 124931 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/10:1H]
root 132713 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/61:1H]
root 139342 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/1:1H]
root 170415 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/17:1H]
root 179586 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/5:1H]
root 180625 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/58:1H]
root 181391 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/3:1H]
root 181460 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/32:1H]
root 184868 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/39:1H]
root 193152 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/16:1H]
root 199646 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/14:1H]
root 201150 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/51:1H]
root 207335 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/57:1H]
root 223691 0.0 0.0 0 0 ? S< Apr13 0:01 \_ [kworker/43:1H]
root 231175 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/12:1H]
root 248734 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/50:1H]
root 251175 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/54:1H]
root 259231 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/52:1H]
root 263229 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/31:1H]
root 289775 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/62:1H]
root 7055 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/46:1H]
root 7445 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/41:1H]
root 25582 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/9:1H]
root 27306 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/28:1H]
root 66202 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/8:1H]
root 231867 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/21:1H]
root 273203 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/30:1H]
root 64351 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/19:1H]
root 147997 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/18:1H]
root 252145 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/44:1H]
root 13042 0.0 0.0 0 0 ? S< Apr13 0:00 \_ [kworker/49:1H]
root 136694 0.0 0.0 0 0 ? S Apr14 0:16 \_ [kworker/43:2]
root 151947 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/53:1H]
root 263926 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/63:1H]
root 143770 0.0 0.0 0 0 ? S< Apr14 0:01 \_ [kworker/45:1H]
root 97565 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/47:1H]
root 166371 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/36:1H]
root 234940 0.0 0.0 0 0 ? S< Apr14 0:01 \_ [kworker/40:1H]
root 5207 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/60:1H]
root 231997 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/55:1H]
root 232497 0.0 0.0 0 0 ? S< Apr14 0:00 \_ [kworker/48:1H]
root 150480 0.0 0.0 0 0 ? S Apr15 0:14 \_ [kworker/41:2]
root 110565 0.0 0.0 0 0 ? S< Apr15 0:00 \_ [loop4]
root 111160 0.0 0.0 0 0 ? S< Apr15 0:00 \_ [loop5]
root 98693 0.0 0.0 0 0 ? S Apr16 0:12 \_ [kworker/46:0]
root 163592 0.0 0.0 0 0 ? S< Apr16 0:00 \_ [loop0]
root 293214 0.0 0.0 0 0 ? S Apr16 0:15 \_ [kworker/45:0]
root 133827 0.0 0.0 0 0 ? S< Apr17 0:00 \_ [loop6]
root 163668 0.0 0.0 0 0 ? S Apr17 0:00 \_ [kworker/46:1]
root 183794 0.0 0.0 0 0 ? S Apr17 0:00 \_ [kworker/42:0]
root 191451 0.0 0.0 0 0 ? S Apr17 0:09 \_ [kworker/56:2]
root 225004 0.0 0.0 0 0 ? S Apr17 0:09 \_ [kworker/37:1]
root 292673 0.0 0.0 0 0 ? S Apr17 0:00 \_ [kworker/44:1]
root 157816 0.0 0.0 0 0 ? S Apr17 0:07 \_ [kworker/44:0]
root 183162 0.0 0.0 0 0 ? S< Apr17 0:00 \_ [loop1]
root 102667 0.0 0.0 0 0 ? S Apr17 0:09 \_ [kworker/17:0]
root 111402 0.0 0.0 0 0 ? S Apr18 0:09 \_ [kworker/53:0]
root 238227 0.0 0.0 0 0 ? S Apr18 0:03 \_ [kworker/59:2]
root 59910 0.0 0.0 0 0 ? S Apr18 0:05 \_ [kworker/58:0]
root 148904 0.0 0.0 0 0 ? S Apr18 0:01 \_ [kworker/61:1]
root 156654 0.0 0.0 0 0 ? S Apr18 0:04 \_ [kworker/32:1]
root 183007 0.0 0.0 0 0 ? S Apr18 0:12 \_ [kworker/11:1]
root 207285 0.0 0.0 0 0 ? S Apr18 0:01 \_ [kworker/63:2]
root 272560 0.0 0.0 0 0 ? S Apr18 0:00 \_ [kworker/32:2]
root 291310 0.0 0.0 0 0 ? S Apr18 0:12 \_ [kworker/6:0]
root 94163 0.0 0.0 0 0 ? S< Apr18 0:00 \_ [loop7]
root 44139 0.0 0.0 0 0 ? S Apr18 0:12 \_ [kworker/7:2]
root 132674 0.0 0.0 0 0 ? S Apr18 0:12 \_ [kworker/13:2]
root 264086 0.0 0.0 0 0 ? S Apr18 0:13 \_ [kworker/33:2]
root 154955 0.0 0.0 0 0 ? S Apr19 0:09 \_ [kworker/14:1]
root 250505 0.0 0.0 0 0 ? S Apr19 0:07 \_ [kworker/30:0]
root 285064 0.0 0.0 0 0 ? S Apr19 0:08 \_ [kworker/8:0]
root 241215 0.0 0.0 0 0 ? S Apr19 0:03 \_ [kworker/26:2]
root 42023 0.0 0.0 0 0 ? S Apr19 0:00 \_ [kworker/61:2]
root 204285 0.0 0.0 0 0 ? S Apr19 0:06 \_ [kworker/27:1]
root 106490 0.0 0.0 0 0 ? S Apr20 0:00 \_ [kworker/58:1]
root 153937 0.0 0.0 0 0 ? S Apr20 0:04 \_ [kworker/42:1]
root 143563 0.0 0.0 0 0 ? S Apr20 0:05 \_ [kworker/55:0]
root 109015 0.0 0.0 0 0 ? S Apr20 0:04 \_ [kworker/57:2]
root 240595 0.0 0.0 0 0 ? S Apr20 0:00 \_ [kworker/47:2]
root 114146 0.0 0.0 0 0 ? S Apr20 0:00 \_ [kworker/60:2]
root 45085 0.0 0.0 0 0 ? S Apr20 0:05 \_ [kworker/2:2]
root 46131 0.0 0.0 0 0 ? S Apr20 0:00 \_ [kworker/60:0]
root 114930 0.0 0.0 0 0 ? S Apr20 0:00 \_ [kworker/59:0]
root 229100 0.0 0.0 0 0 ? S Apr20 0:04 \_ [kworker/34:2]
root 65825 0.0 0.0 0 0 ? S Apr21 0:00 \_ [kworker/43:1]
root 106547 0.0 0.0 0 0 ? S Apr21 0:03 \_ [kworker/12:0]
root 223446 0.0 0.0 0 0 ? S Apr21 0:03 \_ [kworker/15:2]
root 187707 0.0 0.0 0 0 ? S Apr21 0:03 \_ [kworker/51:0]
root 229746 0.0 0.0 0 0 ? S Apr21 0:02 \_ [kworker/24:2]
root 290331 0.0 0.0 0 0 ? S Apr21 0:01 \_ [kworker/16:2]
root 71119 0.0 0.0 0 0 ? S Apr21 0:02 \_ [kworker/36:2]
root 164156 0.0 0.0 0 0 ? S Apr21 0:02 \_ [kworker/54:1]
root 101577 0.0 0.0 0 0 ? S Apr21 0:01 \_ [kworker/29:2]
root 260540 0.0 0.0 0 0 ? S Apr21 0:04 \_ [kworker/49:0]
root 129890 0.0 0.0 0 0 ? S Apr21 0:01 \_ [kworker/48:0]
root 43128 0.0 0.0 0 0 ? S 01:21 0:01 \_ [kworker/23:0]
root 270842 0.0 0.0 0 0 ? S 03:50 0:00 \_ [kworker/37:0]
root 230118 0.0 0.0 0 0 ? S 04:37 0:00 \_ [kworker/13:0]
root 13201 0.0 0.0 0 0 ? S 05:47 0:00 \_ [kworker/48:1]
root 35198 0.0 0.0 0 0 ? S 05:51 0:00 \_ [kworker/41:1]
root 72622 0.0 0.0 0 0 ? S 08:27 0:00 \_ [kworker/7:0]
root 66738 0.0 0.0 0 0 ? S 09:15 0:00 \_ [kworker/35:1]
root 154878 0.0 0.0 0 0 ? S 09:30 0:00 \_ [kworker/63:1]
root 93083 0.0 0.0 0 0 ? S 10:07 0:00 \_ [kworker/10:0]
root 90262 0.0 0.0 0 0 ? S 10:54 0:00 \_ [kworker/29:0]
root 26766 0.0 0.0 0 0 ? S 11:31 0:00 \_ [kworker/12:1]
root 133635 0.0 0.0 0 0 ? S 11:49 0:00 \_ [kworker/55:1]
root 135828 0.0 0.0 0 0 ? S< 11:49 0:00 \_ [loop8]
root 212354 0.0 0.0 0 0 ? S 12:02 0:00 \_ [kworker/22:0]
root 212365 0.0 0.0 0 0 ? S 12:02 0:00 \_ [kworker/27:2]
root 247265 0.0 0.0 0 0 ? S 12:08 0:00 \_ [kworker/28:2]
root 259359 0.0 0.0 0 0 ? S 12:10 0:00 \_ [kworker/21:0]
root 87402 0.0 0.0 0 0 ? S 12:30 0:00 \_ [kworker/25:1]
root 103384 0.0 0.0 0 0 ? S 12:32 0:00 \_ [kworker/31:0]
root 113349 0.0 0.0 0 0 ? S 12:34 0:03 \_ [kworker/3:2]
root 113355 0.0 0.0 0 0 ? S 12:34 0:01 \_ [kworker/4:1]
root 114084 0.1 0.0 0 0 ? S 12:34 0:27 \_ [kworker/u577:1]
root 278389 0.0 0.0 0 0 ? S 13:01 0:00 \_ [kworker/45:2]
root 3326 0.0 0.0 0 0 ? S 13:04 0:00 \_ [kworker/9:0]
root 39263 0.0 0.0 0 0 ? S 13:10 0:00 \_ [kworker/57:1]
root 125145 0.0 0.0 0 0 ? S 13:24 0:00 \_ [kworker/25:2]
root 237916 0.0 0.0 0 0 ? S 13:42 0:00 \_ [kworker/62:0]
root 266935 0.0 0.0 0 0 ? S 13:47 0:00 \_ [kworker/20:1]
root 273625 0.0 0.0 0 0 ? S 13:48 0:00 \_ [kworker/19:0]
root 287924 0.0 0.0 0 0 ? S 13:50 0:00 \_ [kworker/50:0]
root 107992 0.0 0.0 0 0 ? S 14:09 0:03 \_ [kworker/u578:1]
root 193361 0.0 0.0 0 0 ? S 14:23 0:00 \_ [kworker/1:2]
root 222443 0.0 0.0 0 0 ? S 14:29 0:00 \_ [kworker/4:2]
root 49460 0.0 0.0 0 0 ? S 14:49 0:00 \_ [kworker/35:2]
root 55691 0.0 0.0 0 0 ? S 14:50 0:00 \_ [kworker/9:2]
root 166209 0.0 0.0 0 0 ? S 15:08 0:00 \_ [kworker/14:2]
root 293282 0.0 0.0 0 0 ? S 15:30 0:00 \_ [kworker/15:1]
root 120463 0.0 0.0 0 0 ? S 15:50 0:00 \_ [kworker/3:1]
root 170813 0.0 0.0 0 0 ? S 15:58 0:00 \_ [kworker/31:2]
root 207144 0.0 0.0 0 0 ? S 16:03 0:00 \_ [kworker/40:1]
root 233881 0.0 0.0 0 0 ? S 16:08 0:00 \_ [kworker/36:1]
root 244111 0.0 0.0 0 0 ? S 16:10 0:00 \_ [kworker/38:0]
root 70701 0.0 0.0 0 0 ? S 16:30 0:00 \_ [kworker/22:1]
root 100506 0.0 0.0 0 0 ? S 16:34 0:01 \_ [kworker/u576:0]
root 243392 0.0 0.0 0 0 ? S 16:58 0:03 \_ [kworker/0:2]
root 42307 0.0 0.0 0 0 ? S 17:14 0:00 \_ [kworker/39:0]
root 46979 0.0 0.0 0 0 ? S 17:15 0:00 \_ [kworker/2:1]
root 99140 0.0 0.0 0 0 ? S 17:23 0:00 \_ [kworker/33:1]
root 110073 0.0 0.0 0 0 ? S 17:25 0:00 \_ [kworker/24:1]
root 137560 0.0 0.0 0 0 ? S 17:30 0:00 \_ [kworker/54:0]
root 199586 0.0 0.0 0 0 ? S 17:40 0:00 \_ [kworker/34:0]
root 258008 0.0 0.0 0 0 ? S 17:50 0:00 \_ [kworker/10:1]
root 270045 0.0 0.0 0 0 ? S 17:51 0:01 \_ [kworker/u578:0]
root 276618 0.0 0.0 0 0 ? S 17:52 0:00 \_ [kworker/21:2]
root 276624 0.0 0.0 0 0 ? S 17:52 0:00 \_ [kworker/39:1]
root 276629 0.0 0.0 0 0 ? S 17:52 0:00 \_ [kworker/18:2]
root 276654 0.0 0.0 0 0 ? S 17:52 0:00 \_ [kworker/5:2]
root 276771 0.0 0.0 0 0 ? S 17:52 0:00 \_ [kworker/u577:2]
root 30466 0.0 0.0 0 0 ? S 18:01 0:00 \_ [kworker/18:1]
root 70090 0.0 0.0 0 0 ? S 18:07 0:00 \_ [kworker/5:0]
root 82435 0.0 0.0 0 0 ? S 18:10 0:00 \_ [kworker/19:1]
root 103752 0.0 0.0 0 0 ? S 18:13 0:01 \_ [kworker/0:1]
root 119290 0.0 0.0 0 0 ? S 18:16 0:00 \_ [kworker/26:1]
root 182649 0.0 0.0 0 0 ? S 18:26 0:00 \_ [kworker/40:2]
root 187801 0.0 0.0 0 0 ? S 18:26 0:00 \_ [kworker/56:1]
root 209409 0.0 0.0 0 0 ? S 18:30 0:00 \_ [kworker/17:2]
root 244436 0.0 0.0 0 0 ? S 18:35 0:00 \_ [kworker/16:0]
root 272595 0.0 0.0 0 0 ? S 18:40 0:00 \_ [kworker/8:1]
root 19582 0.0 0.0 0 0 ? S 18:47 0:00 \_ [kworker/6:2]
root 34265 0.0 0.0 0 0 ? S 18:49 0:00 \_ [kworker/u576:2]
root 36899 0.0 0.0 0 0 ? S 18:50 0:00 \_ [kworker/53:1]
root 71539 0.0 0.0 0 0 ? S 18:56 0:00 \_ [kworker/50:2]
root 93827 0.0 0.0 0 0 ? S 19:00 0:00 \_ [kworker/20:0]
root 102576 0.0 0.0 0 0 ? S 19:01 0:00 \_ [kworker/23:2]
root 110727 0.0 0.0 0 0 ? S 19:02 0:00 \_ [kworker/51:2]
root 121395 0.0 0.0 0 0 ? S 19:04 0:00 \_ [kworker/30:1]
root 142898 0.0 0.0 0 0 ? S 19:07 0:00 \_ [kworker/11:0]
root 154980 0.0 0.0 0 0 ? S 19:10 0:00 \_ [kworker/28:1]
root 166613 0.0 0.0 0 0 ? S 19:11 0:00 \_ [kworker/1:1]
root 167496 0.0 0.0 0 0 ? S 19:12 0:00 \_ [kworker/52:0]
root 188277 0.0 0.0 0 0 ? S 19:15 0:00 \_ [kworker/62:1]
root 194947 0.0 0.0 0 0 ? S 19:16 0:00 \_ [kworker/49:2]
root 196689 0.0 0.0 0 0 ? S 19:16 0:00 \_ [kworker/56:0]
root 214623 0.0 0.0 0 0 ? S 19:20 0:00 \_ [kworker/25:0]
root 1 0.0 0.0 191176 4136 ? Ss Apr13 6:18 /usr/lib/systemd/systemd --switched-root --system --deserialize 22
root 1673 0.0 0.0 157008 56928 ? Ss Apr13 5:34 /usr/lib/systemd/systemd-journald
root 1698 0.0 0.0 45056 2152 ? Ss Apr13 0:02 /usr/lib/systemd/systemd-udevd
root 1962 0.0 0.0 52896 2888 ? Ss Apr13 0:00 /usr/sbin/smartd -n -q never
root 1963 0.1 0.0 22040 1672 ? Ss Apr13 17:08 /usr/sbin/irqbalance --foreground
polkitd 1966 0.0 0.0 613012 15156 ? Ssl Apr13 1:03 /usr/lib/polkit-1/polkitd --no-debug
dbus 1973 0.0 0.0 58268 2500 ? Ss Apr13 3:23 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
chrony 1981 0.0 0.0 117804 1836 ? S Apr13 0:00 /usr/sbin/chronyd
root 1993 0.0 0.0 2476656 53792 ? Ssl Apr13 2:29 /usr/libexec/snapd/snapd
node_ex+ 1996 4.0 0.0 129612 49256 ? Ssl Apr13 524:17 /usr/local/bin/node_exporter --collector.textfile.directory /var/lib/node_exporter/textfile_collector --no-collector.hwmon --web.listen-address=:8100
root 2005 0.0 0.0 358724 28964 ? Ssl Apr13 0:20 /usr/bin/python2 -Es /usr/sbin/firewalld --nofork --nopid
root 2008 0.0 0.0 126288 1600 ? Ss Apr13 0:09 /usr/sbin/crond -n
root 2083 0.0 0.0 474372 8812 ? Ssl Apr13 0:49 /usr/sbin/NetworkManager --no-daemon
root 3687 0.0 0.0 112920 4360 ? Ss Apr13 0:00 /usr/sbin/sshd -D
root 215317 0.0 0.0 154708 5588 ? Ss 19:20 0:00 \_ sshd: root@pts/0
root 215340 0.0 0.0 116504 3176 pts/0 Ss 19:20 0:00 \_ -bash
root 221242 0.0 0.0 115576 1896 pts/0 S 19:20 0:00 \_ sh
root 226689 0.0 0.0 156148 2684 pts/0 R+ 19:21 0:00 \_ ps fauxww
root 3689 0.0 0.0 574200 17624 ? Ssl Apr13 1:45 /usr/bin/python2 -Es /usr/sbin/tuned -l -P
root 3690 0.0 0.0 466132 40628 ? Ssl Apr13 3:55 /usr/sbin/rsyslogd -n
nrpe 3695 0.0 0.0 44904 2852 ? Ss Apr13 0:01 /usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f
root 3773 0.0 0.0 110108 848 tty1 Ss+ Apr13 0:00 /sbin/agetty --noclear tty1 linux
root 3841 2.7 0.0 4544476 102268 ? SNsl Apr13 363:31 /usr/sbin/r1soft/bin/cdp -s -c /usr/sbin/r1soft/conf/agent_config
root 3991 0.0 0.0 29676 1440 ? Sl Apr13 0:21 /var/ossec/bin/ossec-execd
ossec 4002 0.1 0.0 251180 2960 ? Sl Apr13 22:57 /var/ossec/bin/ossec-agentd
root 4014 0.1 0.0 179312 4408 ? Sl Apr13 15:12 /var/ossec/bin/ossec-syscheckd
root 4023 0.0 0.0 398328 1828 ? Sl Apr13 12:56 /var/ossec/bin/ossec-logcollector
root 4036 0.4 0.0 408592 16852 ? Sl Apr13 61:36 /var/ossec/bin/wazuh-modulesd
root 4203 0.0 0.0 89700 2176 ? Ss Apr13 0:02 /usr/libexec/postfix/master -w
postfix 4249 0.0 0.0 89872 4084 ? S Apr13 0:00 \_ qmgr -l -t unix -u
postfix 51414 0.0 0.0 89804 4080 ? S 18:04 0:00 \_ pickup -l -t unix -u
root 184008 37.6 0.0 3482992 374420 ? Sl Apr17 3005:51 lxcfs /var/snap/lxd/common/var/lib/lxcfs -p /var/snap/lxd/common/lxcfs.pid
root 184126 0.0 0.0 1972684 29956 ? Ss Apr17 0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers cont1
root 184146 0.2 0.0 56048 15648 ? Ss Apr17 22:03 \_ /sbin/init
root 186454 0.4 0.0 133512 69540 ? Ss Apr17 33:49 \_ /usr/lib/systemd/systemd-journald
dbus 210971 0.1 0.0 61940 5904 ? Ss Apr17 14:31 \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root 211891 0.0 0.0 254784 29296 ? Ssl Apr17 0:00 \_ /usr/bin/python2 -Es /usr/sbin/firewalld --nofork --nopid
505 213509 1.0 0.0 118604 26676 ? Ssl Apr17 82:56 \_ /usr/local/bin/node_exporter --collector.textfile.directory /var/lib/node_exporter/textfile_collector --no-collector.hwmon --web.listen-address=:8100
root 218074 0.0 0.0 6516 808 pts/0 Ss+ Apr17 0:00 \_ /sbin/agetty --noclear --keep-baud console 115200,38400,9600 vt220
root 218880 0.0 0.0 22728 1608 ? Ss Apr17 0:22 \_ /usr/sbin/crond -n
root 100745 0.0 0.0 70548 2444 ? S Apr20 0:01 | \_ /usr/sbin/CROND -n
root 104514 0.0 0.0 0 0 ? Zs Apr20 0:00 | \_ [sh] <defunct>
505 231771 0.1 0.0 115360 23468 ? Ssl Apr17 11:17 \_ /usr/local/bin/proxysql_exporter -collect.mysql_connection_list -collect.mysql_connection_pool -collect.mysql_status -collect.detailed.stats_mysql_processlist
root 232430 1.1 0.0 82212 71524 ? Ss Apr17 94:28 \_ /usr/bin/lsyncd -nodaemon /etc/lsyncd.conf
root 234506 0.0 0.0 53284 712 ? Ss Apr17 0:41 \_ /usr/sbin/vsftpd /etc/vsftpd/vsftpd.conf
nobody 222198 0.0 0.0 78340 2528 ? Ss 19:21 0:00 | \_ /usr/sbin/vsftpd /etc/vsftpd/vsftpd.conf
508 222269 0.0 0.0 78440 1392 ? S 19:21 0:00 | \_ /usr/sbin/vsftpd /etc/vsftpd/vsftpd.conf
503 236225 0.0 0.0 44904 2856 ? Ss Apr17 0:01 \_ /usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f
root 237213 0.0 0.0 112920 4352 ? Ss Apr17 0:31 \_ /usr/sbin/sshd -D
root 267845 0.0 0.0 155348 6140 ? Ss 17:51 0:00 | \_ sshd: rss [priv]
508 272216 0.0 0.0 155348 2308 ? S 17:52 0:00 | | \_ sshd: rss@pts/4
508 272283 0.0 0.0 115580 2188 ? Ss+ 17:52 0:00 | | \_ -bash
root 84766 0.0 0.0 155348 6136 ? Ss 18:58 0:00 | \_ sshd: entertainment3 [priv]
525 87499 0.0 0.0 155348 2312 ? S 18:58 0:00 | \_ sshd: entertainment3@pts/1
525 87522 0.0 0.0 115532 2160 ? Ss+ 18:58 0:00 | \_ -bash
root 238253 0.0 0.0 133492 4068 ? Ssl Apr17 4:07 \_ /usr/bin/monit -I
root 240856 0.0 0.0 29668 1400 ? Sl Apr17 0:15 \_ /var/ossec/bin/ossec-execd
polkitd 240887 0.4 0.0 251168 5068 ? Sl Apr17 37:26 \_ /var/ossec/bin/ossec-agentd
root 240916 0.1 0.0 707660 46756 ? Ssl Apr17 13:13 \_ /usr/sbin/rsyslogd -n
root 240934 0.0 0.0 178224 7344 ? Sl Apr17 5:00 \_ /var/ossec/bin/ossec-syscheckd
root 240970 0.1 0.0 398324 2300 ? Sl Apr17 12:16 \_ /var/ossec/bin/ossec-logcollector
root 241006 0.2 0.0 408588 16832 ? Sl Apr17 18:15 \_ /var/ossec/bin/wazuh-modulesd
root 241859 0.0 0.0 81884 5200 ? Ss Apr17 0:17 \_ /disk2/v/haproxy/sbin/haproxy -Ws -f /disk2/v/haproxy/conf/haproxy.conf -p /run/haproxy.pid -S /run/haproxy-master.sock
507 242122 3.0 0.0 1114072 12120 ? Sl Apr17 244:23 | \_ /disk2/v/haproxy/sbin/haproxy -Ws -f /disk2/v/haproxy/conf/haproxy.conf -p /run/haproxy.pid -S /run/haproxy-master.sock
root 242081 0.0 0.0 56612 5196 ? S Apr17 0:00 \_ proxysql -c /etc/proxysql.cnf -D /var/lib/proxysql
root 242088 2.9 0.0 189200 77460 ? Sl Apr17 232:54 | \_ proxysql -c /etc/proxysql.cnf -D /var/lib/proxysql
root 242614 0.0 0.0 68488 4060 ? Ss Apr17 0:00 \_ nginx: master process /disk2/v/nginx/sbin/nginx
daemon 159057 0.3 0.0 70296 27008 ? S 00:00 3:53 | \_ nginx: worker process
daemon 159059 0.4 0.0 70492 27388 ? S 00:00 4:48 | \_ nginx: worker process
daemon 159060 0.5 0.0 70788 27644 ? S 00:00 6:43 | \_ nginx: worker process
daemon 159061 2.0 0.0 73972 31120 ? S 00:00 23:36 | \_ nginx: worker process
daemon 159062 0.7 0.0 71128 28280 ? S 00:00 9:11 | \_ nginx: worker process
daemon 159063 6.0 0.0 88644 45752 ? S 00:00 70:04 | \_ nginx: worker process
daemon 159064 1.1 0.0 72136 29256 ? S 00:00 13:50 | \_ nginx: worker process
daemon 159065 3.6 0.0 79420 36800 ? S 00:00 42:31 | \_ nginx: worker process
root 242876 0.0 0.0 88844 2744 ? Ss Apr17 0:19 \_ sendmail: accepting connections
51 246148 0.0 0.0 84284 2052 ? Ss Apr17 0:00 \_ sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue
502 280082 0.0 0.0 612244 11420 ? Ssl Apr18 3:08 \_ /usr/lib/polkit-1/polkitd --no-debug
root 184420 0.0 0.0 2120724 30004 ? Ss Apr17 0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers cont2
root 184695 0.0 0.0 43924 3836 ? Ss Apr17 5:36 \_ /sbin/init
root 188350 0.0 0.0 93476 41556 ? Ss Apr17 1:04 \_ /usr/lib/systemd/systemd-journald
polkitd 213529 1.0 0.0 118540 23300 ? Ssl Apr17 83:18 \_ /usr/local/bin/node_exporter --collector.textfile.directory /var/lib/node_exporter/textfile_collector --no-collector.hwmon --web.listen-address=:8100
dbus 216931 0.0 0.0 58148 2296 ? Ss Apr17 1:20 \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root 217999 0.0 0.0 254884 25032 ? Ssl Apr17 0:00 \_ /usr/bin/python2 -Es /usr/sbin/firewalld --nofork --nopid
root 220522 0.0 0.0 6516 804 ? Ss+ Apr17 0:00 \_ /sbin/agetty --noclear --keep-baud console 115200,38400,9600 vt220
root 220987 0.0 0.0 22732 1576 ? Ss Apr17 0:06 \_ /usr/sbin/crond -n
523 233546 0.0 0.0 44904 2712 ? Ss Apr17 0:01 \_ /usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f
root 237355 0.0 0.0 29668 1280 ? Sl Apr17 0:16 \_ /var/ossec/bin/ossec-execd
chrony 237398 0.1 0.0 251168 2476 ? Sl Apr17 12:47 \_ /var/ossec/bin/ossec-agentd
root 237442 0.0 0.0 178036 2892 ? Sl Apr17 4:30 \_ /var/ossec/bin/ossec-syscheckd
root 237448 0.0 0.0 316660 24200 ? Ssl Apr17 0:57 \_ /usr/sbin/rsyslogd -n
root 237491 0.1 0.0 398324 1740 ? Sl Apr17 11:25 \_ /var/ossec/bin/ossec-logcollector
root 237531 0.2 0.0 408584 5404 ? Sl Apr17 16:52 \_ /var/ossec/bin/wazuh-modulesd
root 238370 0.0 0.0 112920 3644 ? Ss Apr17 0:00 \_ /usr/sbin/sshd -D
27 238871 129 5.1 28273920 20159740 ? Sl Apr17 10322:10 \_ /usr/sbin/mysqld --daemonize --pid-file=/var/run/mysqld/mysqld.pid
root 191854 0.0 0.0 26512 1908 ? Ss 19:16 0:00 \_ /usr/lib/systemd/systemd-logind
root 185832 0.0 0.0 2341856 32100 ? Ss Apr17 0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers cont3
root 186057 0.0 0.0 43696 3892 ? Ss Apr17 5:50 \_ /sbin/init
root 190347 0.0 0.0 117060 65700 ? Ss Apr17 0:30 \_ /usr/lib/systemd/systemd-journald
dbus 217495 0.0 0.0 58148 2452 ? Ss Apr17 1:26 \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root 218518 0.0 0.0 254524 30936 ? Ssl Apr17 0:00 \_ /usr/bin/python2 -Es /usr/sbin/firewalld --nofork --nopid
chrony 219362 1.1 0.0 118540 24768 ? Ssl Apr17 89:46 \_ /usr/local/bin/node_exporter --collector.textfile.directory /var/lib/node_exporter/textfile_collector --no-collector.hwmon --web.listen-address=:8100
root 222608 0.0 0.0 22732 1592 ? Ss Apr17 0:06 \_ /usr/sbin/crond -n
root 223060 0.0 0.0 6516 808 ? Ss+ Apr17 0:00 \_ /sbin/agetty --noclear --keep-baud console 115200,38400,9600 vt220
root 232402 0.0 0.0 112920 4324 ? Ss Apr17 0:00 \_ /usr/sbin/sshd -D
node_ex+ 233225 0.0 0.0 44904 2856 ? Ss Apr17 0:00 \_ /usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f
root 234100 0.0 0.0 131112 3688 ? Ssl Apr17 1:20 \_ /usr/bin/monit -I
root 235893 0.0 0.0 29668 1420 ? Sl Apr17 0:16 \_ /var/ossec/bin/ossec-execd
lxd 235927 0.1 0.0 251172 2956 ? Sl Apr17 12:00 \_ /var/ossec/bin/ossec-agentd
root 235960 0.0 0.0 178016 3132 ? Sl Apr17 2:23 \_ /var/ossec/bin/ossec-syscheckd
root 235984 0.1 0.0 398324 1812 ? Sl Apr17 11:04 \_ /var/ossec/bin/ossec-logcollector
root 236008 0.2 0.0 408584 7956 ? Sl Apr17 16:43 \_ /var/ossec/bin/wazuh-modulesd
root 236032 0.0 0.0 291984 37408 ? Ssl Apr17 0:34 \_ /usr/sbin/rsyslogd -n
root 238941 0.0 0.0 89700 2180 ? Ss Apr17 0:01 \_ /usr/libexec/postfix/master -w
postfix 239039 0.0 0.0 89980 4292 ? S Apr17 0:00 | \_ qmgr -l -t unix -u
postfix 292203 0.0 0.0 89804 4060 ? S 17:55 0:00 | \_ pickup -l -t unix -u
polkitd 262555 13.4 1.9 42748468 7565116 ? Ssl Apr17 1075:41 \_ /bin/java -Xms6g -Xmx6g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.io.tmpdir=/tmp/elasticsearch.utfvhots -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/lib/elasticsearch -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/log/elasticsearch/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=32 -XX:GCLogFileSize=64m -Des.path.home=/usr/share/elasticsearch -Des.path.conf=/etc/elasticsearch -Des.distribution.flavor=default -Des.distribution.type=rpm -cp /usr/share/elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch -p /var/run/elasticsearch/elasticsearch.pid --quiet
polkitd 263408 0.0 0.0 72140 5112 ? Sl Apr17 0:00 | \_ /usr/share/elasticsearch/modules/x-pack-ml/platform/linux-x86_64/bin/controller
root 189731 0.0 0.0 26508 1808 ? Ss 19:15 0:00 \_ /usr/lib/systemd/systemd-logind
root 24591 0.0 0.0 26380 1800 ? Ss Apr18 0:33 /usr/lib/systemd/systemd-logind
root 136409 0.0 0.0 4628 744 ? Ss 11:49 0:00 /bin/sh /snap/lxd/14804/commands/daemon.start
root 136535 0.1 0.0 5249320 163680 ? Sl 11:49 0:36 \_ lxd --logfile /var/snap/lxd/common/lxd/logs/lxd.log --group lxd
sh-4.2# journalctl -u snap.lxd.daemon -n 300
-- Logs begin at Mon 2020-04-13 18:54:24 IST, end at Wed 2020-04-22 19:37:01 IST. --
Apr 22 19:31:38 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:43 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:43 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:43 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:43 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:44 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:44 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:44 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:47 ne-r081-151cl.privatedns.com lxd.daemon[183916]: utils.c: 303: send_creds: No such process - Failed at sendmsg: 1
Apr 22 19:31:47 ne-r081-151cl.privatedns.com lxd.daemon[183916]: utils.c: 303: send_creds: No such process - Failed at sendmsg: 1
Apr 22 19:31:47 ne-r081-151cl.privatedns.com lxd.daemon[183916]: utils.c: 303: send_creds: No such process - Failed at sendmsg: 1
Apr 22 19:31:48 ne-r081-151cl.privatedns.com lxd.daemon[183916]: utils.c: 303: send_creds: No such process - Failed at sendmsg: 1
Apr 22 19:31:48 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:48 ne-r081-151cl.privatedns.com lxd.daemon[183916]: utils.c: 303: send_creds: No such process - Failed at sendmsg: 1
Apr 22 19:31:48 ne-r081-151cl.privatedns.com lxd.daemon[183916]: utils.c: 303: send_creds: No such process - Failed at sendmsg: 1
Apr 22 19:31:53 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:58 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:58 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:58 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:58 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:59 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:59 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:31:59 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:08 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:13 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:13 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:13 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:13 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:14 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:14 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:14 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:18 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
Apr 22 19:32:23 ne-r081-151cl.privatedns.com lxd.daemon[183916]: proc_cpuview.c: 1082: read_cpuacct_usage_all: read_cpuacct_usage_al
sh-4.2# snap list
Name Version Rev Tracking Publisher Notes
core 16-2.44.1 8935 stable canonical✓ core
core18 20200311 1705 stable canonical✓ base
lxd 4.0.1 14804 stable canonical✓ -
stgraber
April 22, 2020, 2:39pm
7
Can you show lxc network list and the content of /var/snap/lxd/common/lxd/logs/lxd.log?
Hello
More pieces of information:
All my containers restarted about 10 days ago - all of the packages internal to the containers restarted normally and the containers restarted but some with ipv4 addresses but systemd worked fine;
I have only limited snap logs, but about 4 days ago everything slowed and thats when systemd first started working intermittently and then just time out.
Just now I tried to install 3rd party packages and couldn’t complete the install because of a ‘cannot stat /var/lib/lxcfs’ error.
Sincerely - Ed
My network list:
+--------+----------+---------+-------------+---------+
| NAME | TYPE | MANAGED | DESCRIPTION | USED BY |
+--------+----------+---------+-------------+---------+
| eth0 | physical | NO | | 0 |
+--------+----------+---------+-------------+---------+
| eth1 | physical | NO | | 0 |
+--------+----------+---------+-------------+---------+
| lxdbr0 | bridge | YES | | 15 |
+--------+----------+---------+-------------+---------+
The contents of my lxd.log
t=2020-04-22T00:10:21-0700 lvl=info msg="LXD 4.0.1 is starting in normal mode" path=/var/snap/lxd/common/lxd
t=2020-04-22T00:10:21-0700 lvl=info msg="Kernel uid/gid map:"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - u 0 0 4294967295"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - g 0 0 4294967295"
t=2020-04-22T00:10:21-0700 lvl=info msg="Configured LXD uid/gid map:"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - u 0 1000000 1000000000"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - g 0 1000000 1000000000"
t=2020-04-22T00:10:21-0700 lvl=warn msg="AppArmor support has been disabled because of lack of kernel support"
t=2020-04-22T00:10:21-0700 lvl=info msg="Kernel features:"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - netnsid-based network retrieval: no"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - uevent injection: no"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - seccomp listener: no"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - seccomp listener continue syscalls: no"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - unprivileged file capabilities: yes"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - cgroup layout: legacy"
t=2020-04-22T00:10:21-0700 lvl=info msg=" - shiftfs support: disabled"
t=2020-04-22T00:10:21-0700 lvl=info msg="Initializing local database"
t=2020-04-22T00:10:22-0700 lvl=info msg="Starting /dev/lxd handler:"
t=2020-04-22T00:10:22-0700 lvl=info msg=" - binding devlxd socket" socket=/var/snap/lxd/common/lxd/devlxd/sock
t=2020-04-22T00:10:22-0700 lvl=info msg="REST API daemon:"
t=2020-04-22T00:10:22-0700 lvl=info msg=" - binding Unix socket" inherited=true socket=/var/snap/lxd/common/lxd/unix.socket
t=2020-04-22T00:10:22-0700 lvl=info msg=" - binding TCP socket" socket=[::]:8443
t=2020-04-22T00:10:22-0700 lvl=info msg="Initializing global database"
t=2020-04-22T00:10:22-0700 lvl=info msg="Firewall loaded driver \"xtables\""
t=2020-04-22T00:10:22-0700 lvl=info msg="Initializing storage pools"
t=2020-04-22T00:10:22-0700 lvl=info msg="Initializing daemon storage mounts"
t=2020-04-22T00:10:22-0700 lvl=info msg="Initializing networks"
t=2020-04-22T00:10:22-0700 lvl=info msg="Pruning leftover image files"
t=2020-04-22T00:10:22-0700 lvl=info msg="Done pruning leftover image files"
t=2020-04-22T00:10:22-0700 lvl=info msg="Loading daemon configuration"
t=2020-04-22T00:10:22-0700 lvl=info msg="Pruning expired images"
t=2020-04-22T00:10:22-0700 lvl=info msg="Done pruning expired images"
t=2020-04-22T00:10:22-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T00:10:22-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T00:10:22-0700 lvl=info msg="Expiring log files"
t=2020-04-22T00:10:22-0700 lvl=info msg="Updating instance types"
t=2020-04-22T00:10:22-0700 lvl=info msg="Done expiring log files"
t=2020-04-22T00:10:22-0700 lvl=info msg="Done updating instance types"
t=2020-04-22T00:10:22-0700 lvl=info msg="Updating images"
t=2020-04-22T00:10:22-0700 lvl=info msg="Done updating images"
t=2020-04-22T00:29:52-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T01:10:23-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T01:10:23-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T01:55:53-0700 lvl=info msg="Creating container" ephemeral=false name=TC project=default
=2020-04-22T01:59:18-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T02:10:22-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T02:10:22-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T03:10:23-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T03:10:23-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T03:21:59-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T04:10:22-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T04:10:22-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T04:39:57-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T04:40:08-0700 lvl=info msg="Shutting down container" action=shutdown created=2020-03-11T17:48:12-0700 ephemeral=false name=Raiseli-0 project=default timeout=-1s used=2020-03-24T05:24:32-0700
t=2020-04-22T04:44:07-0700 lvl=info msg="Shutting down container" action=shutdown created=2020-04-20T22:03:12-0700 ephemeral=false name=Raiseli-TestServer-1 project=default timeout=-1s used=2020-04-20T22:03:18-0700
t=2020-04-22T05:02:02-0700 lvl=info msg="Stopping container" action=stop created=2020-04-20T22:03:12-0700 ephemeral=false name=Raiseli-TestServer-1 project=default stateful=false used=2020-04-20T22:03:18-0700
t=2020-04-22T05:02:09-0700 lvl=info msg="Shut down container" action=shutdown created=2020-04-20T22:03:12-0700 ephemeral=false name=Raiseli-TestServer-1 project=default timeout=-1s used=2020-04-20T22:03:18-0700
t=2020-04-22T05:02:09-0700 lvl=info msg="Stopped container" action=stop created=2020-04-20T22:03:12-0700 ephemeral=false name=Raiseli-TestServer-1 project=default stateful=false used=2020-04-20T22:03:18-0700
t=2020-04-22T05:02:09-0700 lvl=info msg="Starting container" action=start created=2020-04-20T22:03:12-0700 ephemeral=false name=Raiseli-TestServer-1 project=default stateful=false used=2020-04-20T22:03:18-0700
t=2020-04-22T05:02:17-0700 lvl=info msg="Started container" action=start created=2020-04-20T22:03:12-0700 ephemeral=false name=Raiseli-TestServer-1 project=default stateful=false used=2020-04-20T22:03:18-0700
t=2020-04-22T05:10:22-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T05:10:22-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T05:16:24-0700 lvl=info msg="Stopping container" action=stop created=2020-04-20T22:02:28-0700 ephemeral=false name=Raiseli-TestServer-0 project=default stateful=false used=2020-04-20T22:02:33-0700
t=2020-04-22T05:16:32-0700 lvl=info msg="Stopped container" action=stop created=2020-04-20T22:02:28-0700 ephemeral=false name=Raiseli-TestServer-0 project=default stateful=false used=2020-04-20T22:02:33-0700
t=2020-04-22T05:16:32-0700 lvl=info msg="Starting container" action=start created=2020-04-20T22:02:28-0700 ephemeral=false name=Raiseli-TestServer-0 project=default stateful=false used=2020-04-20T22:02:33-0700
t=2020-04-22T05:16:41-0700 lvl=info msg="Started container" action=start created=2020-04-20T22:02:28-0700 ephemeral=false name=Raiseli-TestServer-0 project=default stateful=false used=2020-04-20T22:02:33-0700
t=2020-04-22T05:17:13-0700 lvl=info msg="Stopping container" action=stop created=2020-04-20T22:03:35-0700 ephemeral=false name=Raiseli-TestServer-2 project=default stateful=false used=2020-04-20T22:03:40-0700
t=2020-04-22T05:17:19-0700 lvl=info msg="Stopped container" action=stop created=2020-04-20T22:03:35-0700 ephemeral=false name=Raiseli-TestServer-2 project=default stateful=false used=2020-04-20T22:03:40-0700
t=2020-04-22T05:17:19-0700 lvl=info msg="Starting container" action=start created=2020-04-20T22:03:35-0700 ephemeral=false name=Raiseli-TestServer-2 project=default stateful=false used=2020-04-20T22:03:40-0700
t=2020-04-22T05:17:27-0700 lvl=info msg="Started container" action=start created=2020-04-20T22:03:35-0700 ephemeral=false name=Raiseli-TestServer-2 project=default stateful=false used=2020-04-20T22:03:40-0700
t=2020-04-22T05:18:18-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T05:21:46-0700 lvl=warn msg="Detected poll(POLLNVAL) event: exiting."
t=2020-04-22T05:21:46-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T05:48:48-0700 lvl=warn msg="Detected poll(POLLNVAL) event: exiting."
t=2020-04-22T05:48:48-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T06:10:22-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T06:10:22-0700 lvl=info msg="Done pruning expired instance backups"
t=2020-04-22T06:10:22-0700 lvl=info msg="Updating images"
t=2020-04-22T06:10:22-0700 lvl=info msg="Done updating images"
t=2020-04-22T06:10:28-0700 lvl=info msg="Downloading image" alias=centos/7/amd64 server=https://images.linuxcontainers.org
t=2020-04-22T06:10:32-0700 lvl=info msg="Image downloaded" alias=centos/7/amd64 server=https://images.linuxcontainers.org
t=2020-04-22T06:49:38-0700 lvl=warn msg="Detected poll(POLLNVAL) event: exiting."
t=2020-04-22T06:49:38-0700 lvl=warn msg="Detected poll(POLLNVAL) event."
t=2020-04-22T07:10:22-0700 lvl=info msg="Pruning expired instance backups"
t=2020-04-22T07:10:22-0700 lvl=info msg="Done pruning expired instance backups"
jegan
April 22, 2020, 4:05pm
11
Here is the network list and logs.
> sh-4.2# lxc network list
> +----------+----------+---------+-------------+---------+
> | NAME | TYPE | MANAGED | DESCRIPTION | USED BY |
> +----------+----------+---------+-------------+---------+
> | bond0 | bond | NO | | 0 |
> +----------+----------+---------+-------------+---------+
> | eth0 | physical | NO | | 0 |
> +----------+----------+---------+-------------+---------+
> | eth1 | physical | NO | | 0 |
> +----------+----------+---------+-------------+---------+
> | vlan3295 | vlan | NO | | 3 |
> +----------+----------+---------+-------------+---------+
> | vlan3296 | vlan | NO | | 3 |
> +----------+----------+---------+-------------+---------+
>
> sh-4.2# cat /var/snap/lxd/common/lxd/logs/lxd.log
> t=2020-04-22T11:49:40+0530 lvl=info msg="LXD 4.0.1 is starting in normal mode" path=/var/snap/lxd/common/lxd
> t=2020-04-22T11:49:40+0530 lvl=info msg="Kernel uid/gid map:"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - u 0 0 4294967295"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - g 0 0 4294967295"
> t=2020-04-22T11:49:40+0530 lvl=info msg="Configured LXD uid/gid map:"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - u 0 1000000 1000000000"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - g 0 1000000 1000000000"
> t=2020-04-22T11:49:40+0530 lvl=warn msg="AppArmor support has been disabled because of lack of kernel support"
> t=2020-04-22T11:49:40+0530 lvl=info msg="Kernel features:"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - netnsid-based network retrieval: no"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - uevent injection: no"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - seccomp listener: no"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - seccomp listener continue syscalls: no"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - unprivileged file capabilities: yes"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - cgroup layout: legacy"
> t=2020-04-22T11:49:40+0530 lvl=info msg=" - shiftfs support: disabled"
> t=2020-04-22T11:49:40+0530 lvl=info msg="Initializing local database"
> t=2020-04-22T11:49:41+0530 lvl=info msg="Starting /dev/lxd handler:"
> t=2020-04-22T11:49:41+0530 lvl=info msg=" - binding devlxd socket" socket=/var/snap/lxd/common/lxd/devlxd/sock
> t=2020-04-22T11:49:41+0530 lvl=info msg="REST API daemon:"
> t=2020-04-22T11:49:41+0530 lvl=info msg=" - binding Unix socket" inherited=true socket=/var/snap/lxd/common/lxd/unix.socket
> t=2020-04-22T11:49:41+0530 lvl=info msg="Initializing global database"
> t=2020-04-22T11:49:41+0530 lvl=info msg="Firewall loaded driver \"xtables\""
> t=2020-04-22T11:49:41+0530 lvl=info msg="Initializing storage pools"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Initializing daemon storage mounts"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Initializing networks"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Pruning leftover image files"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Done pruning leftover image files"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Loading daemon configuration"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Pruning expired images"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Done pruning expired images"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Updating images"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Updating instance types"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Done updating images"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Expiring log files"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Done updating instance types"
> t=2020-04-22T11:49:42+0530 lvl=info msg="Done expiring log files"
> t=2020-04-22T12:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T12:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T13:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T13:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T14:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T14:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T15:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T15:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T16:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T16:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T17:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T17:49:42+0530 lvl=info msg="Updating images"
> t=2020-04-22T17:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T17:49:42+0530 lvl=info msg="Done updating images"
> t=2020-04-22T17:49:43+0530 lvl=info msg="Downloading image" alias=centos/7/amd64 server=https://images.linuxcontainers.org
> t=2020-04-22T17:49:44+0530 lvl=info msg="Image downloaded" alias=centos/7/amd64 server=https://images.linuxcontainers.org
> t=2020-04-22T18:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T18:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T19:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T19:49:42+0530 lvl=info msg="Done pruning expired instance backups"
> t=2020-04-22T20:49:42+0530 lvl=info msg="Pruning expired instance backups"
> t=2020-04-22T20:49:42+0530 lvl=info msg="Done pruning expired instance backups"
stgraber
April 22, 2020, 4:07pm
12
Ok, so there’s no clear error but you’re also missing dnsmasq so that’s odd.
Can you show lxc network show lxdbr0 and try lxc network set lxdbr0 bridge.mtu 1500 to see if making such a minor change causes it to give you a clearer error (or to start the missing dnsmasq somehow).
jegan
April 22, 2020, 4:35pm
13
I have not created the bridge interface.
devices:
eth0:
name: eth0
nictype: macvlan
parent: vlan3295
type: nic
eth1:
name: eth1
nictype: macvlan
parent: vlan3296
type: nic
root:
path: /
pool: lxd_storage
type: disk
name: default
used_by:
- /1.0/instances/cont1
- /1.0/instances/cont2
- /1.0/instances/cont3
stgraber
April 22, 2020, 6:53pm
14
The connection timeout kinda suggests an issue with dbus in the container.ps fauxww look like?
Also, anything interesting in lxc console --show-log NAME?
stgraber:
lxc network list
Thanks Stefane, But before I answer your questions here is another piece to my puzzle:
Yesyerday
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Node | RUNNING | 10.148.69.21 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe73:685d (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another-Test-Network-1-0 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fea6:1c6e (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another-Test-Network-1-1 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fec3:9d95 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another-Test-Network-1-2 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe97:dbf7 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another-Test-Network-1-3 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe18:fb37 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-0 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe4a:dca5 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-1 | RUNNING | | | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-2 | RUNNING | 10.148.69.153 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe5b:473e (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-3 | RUNNING | 10.148.69.83 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe45:d235 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Container-TestServer-0 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe2b:9fcc (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Container-TestServer-1 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe93:8999 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
Container-TestServer-2 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fec2:34d2 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Container-TestServer-3 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fee6:b653 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| TB | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe59:ce40 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| TC | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe56:2492 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
Today
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Node | RUNNING | 10.148.69.21 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe73:685d (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another-Test-Network-1-0 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fea6:1c6e (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another--Test-Network-1-1 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fec3:9d95 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another--Test-Network-1-2 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe97:dbf7 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Another--Test-Network-1-3 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe18:fb37 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-0 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe4a:dca5 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-1 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe17:604c (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-2 | RUNNING | 10.148.69.153 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe5b:473e (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| MyContainer-3 | RUNNING | | | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Conatainer-TestServer-0 | RUNNING | 10.148.69.108 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe2b:9fcc (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Conatainer-TestServer-1 | RUNNING | 10.148.69.162 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe93:8999 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Conatainer-TestServer-2 | RUNNING | 10.148.69.168 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fec2:34d2 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| Conatainer-TestServer-3 | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fee6:b653 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| TB | RUNNING | 10.148.69.22 (eth0) | fd42:b2d9:ca9b:2ef6:216:3eff:fe59:ce40 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| TC | RUNNING | | fd42:b2d9:ca9b:2ef6:216:3eff:fe56:2492 (eth0) | CONTAINER | 0 |
+------------------------+---------+----------------------+-----------------------------------------------+-----------+-----------+
I am changing IP addresses around.
jegan
April 23, 2020, 7:18am
16
@stgraber , here is the console log and “ps fauxww” output inside the container.
lxc console --show-log cont1
Console log:
systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
Detected virtualization lxc.
Detected architecture x86-64.
Welcome to CentOS Linux 7 (Core)!
Set hostname to <cont1>.
Failed to install release agent, ignoring: No such file or directory
Generating systemd units for vsftpd
Cannot add dependency job for unit display-manager.service, ignoring: Unit not found.
[ OK ] Started Dispatch Password Requests to Console Directory Watch.
[ OK ] Started Forward Password Requests to Wall Directory Watch.
[ OK ] Reached target Remote File Systems.
[ OK ] Reached target Swap.
[ OK ] Reached target Local Encrypted Volumes.
[ OK ] Created slice Root Slice.
[ OK ] Created slice User and Session Slice.
[ OK ] Listening on Delayed Shutdown Socket.
[ OK ] Created slice System Slice.
[ OK ] Created slice system-getty.slice.
[ OK ] Listening on /dev/initctl Compatibility Named Pipe.
[ OK ] Listening on Journal Socket.
Mounting Huge Pages File System...
Starting Read and set NIS domainname from /etc/sysconfig/network...
Starting Configure read-only root support...
[ OK ] Reached target Local File Systems (Pre).
[ OK ] Reached target Slices.
Starting Journal Service...
[ OK ] Reached target Paths.
[ OK ] Mounted Huge Pages File System.
[ OK ] Started Journal Service.
[ OK ] Started Read and set NIS domainname from /etc/sysconfig/network.
[ OK ] Started Configure read-only root support.
[ OK ] Reached target Local File Systems.
Starting Load/Save Random Seed...
Starting Flush Journal to Persistent Storage...
[ OK ] Started Load/Save Random Seed.
[ OK ] Started Flush Journal to Persistent Storage.
Starting Create Volatile Files and Directories...
[ OK ] Started Create Volatile Files and Directories.
Starting Update UTMP about System Boot/Shutdown...
[ OK ] Started Update UTMP about System Boot/Shutdown.
[ OK ] Reached target System Initialization.
[ OK ] Started Daily Cleanup of Temporary Directories.
[ OK ] Reached target Timers.
[ OK ] Listening on D-Bus System Message Bus Socket.
[ OK ] Reached target Sockets.
[ OK ] Reached target Basic System.
Starting Network Time Service...
[ OK ] Started D-Bus System Message Bus.
Starting firewalld - dynamic firewall daemon...
Starting Permit User Sessions...
[ OK ] Started Node Exporter.
Starting Login Service...
[ OK ] Started Network Time Service.
[ OK ] Started Permit User Sessions.
[ OK ] Started firewalld - dynamic firewall daemon.
[ OK ] Reached target Network (Pre).
Starting LSB: Bring up/down networking...
Starting Cleanup of Temporary Directories...
[ OK ] Started Console Getty.
[ OK ] Started Command Scheduler.
[ OK ] Started Cleanup of Temporary Directories.
[ OK ] Started Login Service.
[ OK ] Created slice User Slice of rss.
[ OK ] Started Session c1 of user rss.
[ OK ] Started Session c2 of user rss.
[ OK ] Started Session c3 of user rss.
[ OK ] Created slice User Slice of root.
[ OK ] Started Session c4 of user root.
[ OK ] Started Session c5 of user rss.
[ OK ] Started Session c6 of user root.
[ OK ] Started Session c7 of user rss.
[ OK ] Started Session c8 of user rss.
CentOS Linux 7 (Core)
Kernel 3.10.0-1062.9.1.el7.x86_64 on an x86_64
cont1 login:
sh-4.2# ps fauxww
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 230034 0.0 0.0 185580 2212 ? Ss 12:46 0:00 su -l
root 230446 0.0 0.0 11828 1952 ? S 12:46 0:00 \_ -bash
root 230732 0.0 0.0 11824 1736 ? S 12:47 0:00 \_ sh
root 230808 0.0 0.0 51748 1692 ? R+ 12:47 0:00 \_ ps fauxww
root 1 0.1 0.0 44348 4232 ? Ss Apr17 6:33 /sbin/init
root 736 0.0 0.1 126164 69076 ? Ss Apr17 1:15 /usr/lib/systemd/systemd-journald
node_ex+ 4895 2.3 0.0 118540 23316 ? Ssl Apr17 94:29 /usr/local/bin/node_exporter --collector.textfile.directory /var/lib/node_exporter/textfile_collector --no-collector.hwmon --web.listen-address=:8100
dbus 5483 0.0 0.0 58148 2296 ? Ss Apr17 1:41 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root 5633 0.0 0.0 254884 25032 ? Ssl Apr17 0:00 /usr/bin/python2 -Es /usr/sbin/firewalld --nofork --nopid
root 6094 0.0 0.0 6516 804 console Ss+ Apr17 0:00 /sbin/agetty --noclear --keep-baud console 115200,38400,9600 vt220
root 6212 0.0 0.0 22732 1576 ? Ss Apr17 0:07 /usr/sbin/crond -n
root 230657 0.0 0.0 70548 2096 ? S 12:47 0:00 \_ /usr/sbin/crond -n
root 230658 0.0 0.0 70548 2096 ? S 12:47 0:00 \_ /usr/sbin/crond -n
nrpe 7466 0.0 0.0 44904 2712 ? Ss Apr17 0:01 /usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f
node_ex+ 7788 3.0 0.0 117012 27136 ? Ssl Apr17 123:36 /usr/local/bin/mysqld_exporter --config.my-cnf=/etc/.mysqld_exporter.cnf --collect.global_status --collect.info_schema.innodb_metrics --collect.info_schema.processlist --collect.info_schema.tablestats --collect.global_variables --collect.info_schema.query_response_time --collect.info_schema.userstats --collect.info_schema.tables --collect.perf_schema.tablelocks --collect.perf_schema.eventswaits --collect.perf_schema.indexiowaits --collect.perf_schema.tableiowaits --collect.perf_schema.eventsstatements --collect.slave_status --web.listen-address=0.0.0.0:9104
root 8140 0.0 0.0 29668 1280 ? Sl Apr17 0:18 /var/ossec/bin/ossec-execd
ossec 8151 0.3 0.0 251168 2476 ? Sl Apr17 14:29 /var/ossec/bin/ossec-agentd
root 8162 0.1 0.0 178036 2892 ? Sl Apr17 4:57 /var/ossec/bin/ossec-syscheckd
root 8165 0.0 0.0 349128 37256 ? Ssl Apr17 1:06 /usr/sbin/rsyslogd -n
root 8175 0.3 0.0 398324 1740 ? Sl Apr17 12:54 /var/ossec/bin/ossec-logcollector
root 8191 0.4 0.0 408584 5404 ? Sl Apr17 19:04 /var/ossec/bin/wazuh-modulesd
root 8370 0.0 0.0 112920 3644 ? Ss Apr17 0:00 /usr/sbin/sshd -D
mysql 8494 282 51.9 28273920 20284900 ? Sl Apr17 11431:05 /usr/sbin/mysqld --daemonize --pid-file=/var/run/mysqld/mysqld.pid
root 229921 0.0 0.0 26736 2044 ? Ss 12:46 0:00 /usr/lib/systemd/systemd-logind
stgraber:
lxc console --show-log
Hellp, my apologies for my absence. Here is my logs.
Console log:
systemd 237 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
Detected virtualization lxc.
Detected architecture x86-64.
Welcome to Ubuntu 18.04.4 LTS!
Set hostname to <Container-Test-Network-1-0>.
Failed to install release agent, ignoring: No such file or directory
Couldn't move remaining userspace processes, ignoring: Invalid argument
(sd-executor) terminated by signal ALRM.
File /lib/systemd/system/systemd-journald.service:36 configures an IP firewall (IPAddressDeny=any), but the local system does not support BPF/cgroup based firewalling.
Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.)
[ OK ] Created slice System Slice.
[ OK ] Listening on LVM2 poll daemon socket.
[ OK ] Listening on Network Service Netlink Socket.
[ OK ] Listening on /dev/initctl Compatibility Named Pipe.
[ OK ] Listening on Syslog Socket.
[ OK ] Reached target Swap.
[ OK ] Reached target User and Group Name Lookups.
[ OK ] Listening on Journal Socket.
Mounting Huge Pages File System...
Starting Uncomplicated firewall...
Starting Set the console keyboard layout...
Starting Apply Kernel Variables...
[ OK ] Listening on Journal Socket (/dev/log).
Starting Journal Service...
[ OK ] Listening on LVM2 metadata daemon socket.
[ OK ] Created slice User and Session Slice.
[ OK ] Reached target Slices.
[ OK ] Started Forward Password Requests to Wall Directory Watch.
[ OK ] Listening on Device-mapper event daemon FIFOs.
[ OK ] Started Journal Service.
[ OK ] Mounted Huge Pages File System.
[ OK ] Started Uncomplicated firewall.
[ OK ] Started Set the console keyboard layout.
[ OK ] Started Apply Kernel Variables.
[ OK ] Reached target Local File Systems (Pre).
[ OK ] Reached target Local File Systems.
Starting Set console font and keymap...
Starting Tell Plymouth To Write Out Runtime Data...
Starting ebtables ruleset management...
[ OK ] Started Dispatch Password Requests to Console Directory Watch.
[ OK ] Reached target Local Encrypted Volumes.
Starting Flush Journal to Persistent Storage...
[ OK ] Started Set console font and keymap.
[ OK ] Started Tell Plymouth To Write Out Runtime Data.
[ OK ] Started ebtables ruleset management.
[FAILED] Failed to start Flush Journal to Persistent Storage.
See 'systemctl status systemd-journal-flush.service' for details.
Starting Create Volatile Files and Directories...
[ OK ] Reached target Network (Pre).
Starting Network Service...
[ OK ] Started Create Volatile Files and Directories.
[ OK ] Started Network Service.
Starting Wait for Network to be Configured...
Starting Network Name Resolution...
[ OK ] Reached target System Time Synchronized.
Starting Update UTMP about System Boot/Shutdown...
[ OK ] Started Network Name Resolution.
[ OK ] Started Wait for Network to be Configured.
[ OK ] Started Update UTMP about System Boot/Shutdown.
[ OK ] Reached target System Initialization.
Starting Socket activation for snappy daemon.
[ OK ] Listening on Open-iSCSI iscsid Socket.
[ OK ] Listening on UUID daemon activation socket.
[ OK ] Listening on D-Bus System Message Bus Socket.
[ OK ] Started ACPI Events Check.
[ OK ] Reached target Paths.
[ OK ] Started Daily apt download activities.
[ OK ] Started Daily apt upgrade and clean activities.
Starting LXD - unix socket.
[ OK ] Listening on Unix socket for apport crash forwarding.
[ OK ] Started Message of the Day.
[ OK ] Started Daily Cleanup of Temporary Directories.
[ OK ] Reached target Timers.
[ OK ] Listening on ACPID Listen Socket.
[ OK ] Reached target Host and Network Name Lookups.
[ OK ] Reached target Network.
[ OK ] Reached target Network is Online.
[ OK ] Reached target Remote File Systems (Pre).
[ OK ] Reached target Remote File Systems.
Starting Availability of block devices...
[ OK ] Listening on Socket activation for snappy daemon.
[ OK ] Listening on LXD - unix socket.
Starting Cleanup of Temporary Directories...
[ OK ] Reached target Sockets.
[ OK ] Reached target Basic System.
[ OK ] Started D-Bus System Message Bus.
Starting Dispatcher daemon for systemd-networkd...
Starting Message of the Day...
Starting LXD - container startup/shutdown...
Starting Accounts Service...
Starting LSB: automatic crash report generation...
Starting Permit User Sessions...
Starting Login Service...
Starting OpenBSD Secure Shell server...
[ OK ] Started Deferred execution scheduler.
[ OK ] Started Regular background program processing daemon.
Starting System Logging Service...
Starting Snappy daemon...
[ OK ] Started Dispatcher daemon for systemd-networkd.
[ OK ] Started System Logging Service.
[ OK ] Started Availability of block devices.
[ OK ] Started Snappy daemon.
[ OK ] Started Cleanup of Temporary Directories.
[ OK ] Started Message of the Day.
[ OK ] Started LXD - container startup/shutdown.
[ OK ] Started Accounts Service.
[ OK ] Started LSB: automatic crash report generation.
[ OK ] Started Permit User Sessions.
[ OK ] Started OpenBSD Secure Shell server.
[FAILED] Failed to start Login Service.
See 'systemctl status systemd-logind.service' for details.
[ OK ] Stopped Login Service.
Starting Login Service...
Starting Terminate Plymouth Boot Screen...
Starting Hold until boot process finishes up...
Starting Wait until snapd is fully seeded...
[ OK ] Started Terminate Plymouth Boot Screen.
[ OK ] Started Hold until boot process finishes up.
[FAILED] Failed to start Login Service.
See 'systemctl status systemd-logind.service' for details.
[ OK ] Stopped Login Service.
Starting Login Service...
Starting Snappy daemon...
Starting Daily apt download activities...
[ OK ] Started Console Getty.