Hi everyone,
We run few lxc host with on each some (30-40) lxc container without any issue.
All run either Debian 11 or Debian 12.
But on one server which are our «biggest» server 64 cores (128 with MT), 512 Go and full SSD we don’t have any issue until we pass from ~ 10 to 50 containers.
Since this add we got random issue on few container with icinga2 throw very strange error like
[2024-11-21 16:37:06 +0100] critical/Application: Error: boost::thread_resource_error: Resource temporarily unavailable
and
Stacktrace:
0# __cxa_throw in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
1# 0x0000561E1EE29A37 in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
2# icinga::WorkQueue::EnqueueUnlocked(std::unique_lock<std::mutex>&, std::function<void ()>&&, icinga::WorkQueuePriority) in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
3# icinga::ConfigItem::CommitNewItems(boost::intrusive_ptr<icinga::ActivationContext> const&, icinga::WorkQueue&, std::vector<boost::intrusive_ptr<icinga::ConfigItem>, std::allocator<boost::
intrusive_ptr<icinga::ConfigItem> > >&) in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
4# icinga::ConfigItem::CommitItems(boost::intrusive_ptr<icinga::ActivationContext> const&, icinga::WorkQueue&, std::vector<boost::intrusive_ptr<icinga::ConfigItem>, std::allocator<boost::int
rusive_ptr<icinga::ConfigItem> > >&, bool) in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
5# icinga::DaemonUtility::LoadConfigFiles(std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::ch
ar_traits<char>, std::allocator<char> > > > const&, std::vector<boost::intrusive_ptr<icinga::ConfigItem>, std::allocator<boost::intrusive_ptr<icinga::ConfigItem> > >&, icinga::String const&,
icinga::String const&) in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
6# icinga::DaemonCommand::Run(boost::program_options::variables_map const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::_
_cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&) const in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
7# 0x0000561E1EE5DE2F in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
8# main in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
9# 0x00007F0FAE6A524A in /lib/x86_64-linux-gnu/libc.so.6
10# __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6
11# _start in /usr/lib/x86_64-linux-gnu/icinga2/sbin/icinga2
We check every value of ulimit, event getconf but nothing.
We find no error neither dmesg or syslog.
Any idea ?