Периодически рестартует Asterisk (segfault)

[Jonny]

Здравствуйте
Подскажите пожалуйста куда правильно смотреть при периодических падениях Asterisk'а
FreePBX 12.0.76.2 + Asterisk 13.3.2 + SHMZ release 6.5 (Final)
Работало все полгода нормально а с неделю как начал валиться в течении рабочего дня - примерно с 10 дня и до 16 через каждый час.

в messages - asterisk[19864]: segfault at 954 ip 00000000004ca7b8 sp 00007f5f98ee98b0 error 4 in asterisk[400000+2aa000]

гуглил подобные ошибки - может быть и плохая память и старый модуль
Так называемая CORE`ка показывает вот такое в 99 % случаев

#0 0x00000000004ca7b8 in ast_channel_hangupcause ()
#1 0x00007f5fb3750af6 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
#2 0x00007f5fead2fd36 in ?? () from /usr/lib64/asterisk/modules/res_pjsip_session.so
#3 0x00007f6051b2c9d5 in ?? () from /usr/lib64/libpjsip-ua.so.2
#4 0x00007f6051b3149e in ?? () from /usr/lib64/libpjsip-ua.so.2
#5 0x00007f6051b31d6d in ?? () from /usr/lib64/libpjsip-ua.so.2
#6 0x00007f6051b2b566 in ?? () from /usr/lib64/libpjsip-ua.so.2
#7 0x00007f60516f7358 in pjsip_dlg_on_tsx_state () from /usr/lib64/libpjsip.so.2
#8 0x00007f60516f2f09 in ?? () from /usr/lib64/libpjsip.so.2
#9 0x00007f60516f459f in ?? () from /usr/lib64/libpjsip.so.2
#10 0x00007f60516f283a in pjsip_tsx_recv_msg () from /usr/lib64/libpjsip.so.2
#11 0x00007f60516f5b52 in ?? () from /usr/lib64/libpjsip.so.2
#12 0x00007f60516e0153 in pjsip_endpt_process_rx_data () from /usr/lib64/libpjsip.so.2
#13 0x00007f5feb361964 in ?? () from /usr/lib64/asterisk/modules/res_pjsip.so
#14 0x00000000005db37b in ast_taskprocessor_execute ()
#15 0x00000000005e204d in ?? ()
#16 0x00000000005e353b in ?? ()
#17 0x00000000005e32eb in ?? ()
#18 0x00000000005eedeb in ?? ()
#19 0x00007f60558d19d1 in start_thread () from /lib64/libpthread.so.0
#20 0x00007f6054c598fd in clone () from /lib64/libc.so.6

То ли на процедуре"ast_taskprocessor_execute ()" то ли на библиотеке "libpthread.so"
Думал что Asterisk создает большое количество потоков и по переполнению валится но валился и при количестве потоков в 190 и 240 и 160
Что характерно - утром до 10 и вечером после 16 все нормально.
Обновил все модули с freepbx веб интерфейса до последних стабильных.

[Zavr2008]

chan_pjsip.so - а если и тут поменять на chan_sip?

[Jonny]

Ну поменять можно но хотелось бы без таких кардинальных мер.
Конечно 13 версия и пишут что сырая и Бета - но ведь работало все полгода нормально.
Может связано с увеличением количества операторов - и соответственно нагрузки на этот самый модуль.
Версия Asterisk 13.3.2 - пишут что есть уже стабильная ( бета стабильная) 13.5 - попробую обновиться на нее на резервном сервере - перевести туда всех операторов и проследить как и что будет.
Пока что можно работать - падение на 10-15 секунд но все же неприятно.

[Zavr2008]

о какой стабильности можно вести речь, если в корки падает?

[Jonny]

Еще глянул - таблица cel - 60 Млн записей
и в дебаге астериска есть такое

[2015-11-05 12:21:25] DEBUG[17470] app_queue.c: Extension '9002@ext-local' changed to state '1' (Not in use) but we don't care because they're not a member o
[2015-11-05 12:21:25] DEBUG[28117][C-000004f5] audiohook.c: Write factory 0x7f603eb7ae38 was pretty quick last time, waiting for them.
[2015-11-05 12:21:25] DEBUG[17472] cel_odbc.c: Executing SQL statement: INSERT INTO cel (eventtype,eventtime,cid_name,cid_num,cid_ani,cid_rdnis,cid_dnid,exten,context,channame,appname,appdata,amaflags,accountcode,uniqueid,linkedid,peer,userdeftype,userfield) VALUES (значения)
[2015-11-05 12:21:31] Asterisk 13.3.2 built by mockbuild @ jenkins2.schmoozecom.net on a x86_64 running Linux on 2015-04-09 00:37:16 UTC
[2015-11-05 12:21:31] VERBOSE[28508] manager.c: Manager registered action DBGet
[2015-11-05 12:21:31] VERBOSE[28508] manager.c: Manager registered action DBPut

может конечно совпадение что именно на вставке данных в cel - Asterisk и упал

[Zavr2008]

тогда попробовать CEL временно выключить..

[Vlad1983]

собрать с отладочными символами, чтоб gdb по человечески отобразил стек

Код: Выделить всё

set pagination off
info threads
bt
bt full
thread apply all bt
thread apply all bt full

[virus_net]

тогда попробовать CEL временно выключить..

+1
Была похожая проблема на 1.8 с включенным CEL. Отключение CEL - падения прекратились.

[Jonny]

Ну отключение cel сразу казалось помогло но видимо не оно тоже - опять валится

Пишут что в версии 13.5 исправили некоторые баги как раз в модуле chan_pjsip - попробую с понедельника перейти на эту версию.
Ну если уж ничего не поможет то есть варианты перейти на обычный chan_sip либо сменить centos на debian


по поводу gdd

info threads (последние 60 потоков )

PRIME_BBCODE_SPOILER_SHOW PRIME_BBCODE_SPOILER:

226 Thread 0x7f493c246700 (LWP 10449) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
225 Thread 0x7f49f4e34700 (LWP 9675) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
224 Thread 0x7f49f95c4700 (LWP 9661) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
223 Thread 0x7f493eb72700 (LWP 10479) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
222 Thread 0x7f49f408f700 (LWP 9687) 0x00007f49f7a16bcd in sem_post () from /lib64/libpthread.so.0
221 Thread 0x7f493ba0a700 (LWP 11046) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
220 Thread 0x7f493db76700 (LWP 9914) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
219 Thread 0x7f493d88e700 (LWP 9920) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
218 Thread 0x7f493d796700 (LWP 9922) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
217 Thread 0x7f493d0ce700 (LWP 11167) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
216 Thread 0x7f493da02700 (LWP 9917) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
215 Thread 0x7f49406b5700 (LWP 9720) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
214 Thread 0x7f493ce62700 (LWP 9944) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
213 Thread 0x7f493d622700 (LWP 9925) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
212 Thread 0x7f493b81a700 (LWP 10111) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
211 Thread 0x7f493d52a700 (LWP 9927) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
210 Thread 0x7f49f568d700 (LWP 11102) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
209 Thread 0x7f493d432700 (LWP 9929) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
208 Thread 0x7f493e04e700 (LWP 9897) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
207 Thread 0x7f493cc72700 (LWP 9948) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
206 Thread 0x7f493cb7a700 (LWP 9950) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
205 Thread 0x7f493ca82700 (LWP 9952) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
204 Thread 0x7f493c4b2700 (LWP 10966) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
203 Thread 0x7f493f886700 (LWP 11210) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
202 Thread 0x7f49f4eb0700 (LWP 9674) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
201 Thread 0x7f493ee5a700 (LWP 11165) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
200 Thread 0x7f493f23a700 (LWP 11070) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
199 Thread 0x7f493faf2700 (LWP 9743) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
198 Thread 0x7f49f4d3c700 (LWP 9677) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
197 Thread 0x7f493b5ae700 (LWP 10789) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
196 Thread 0x7f493f2b6700 (LWP 10472) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
195 Thread 0x7f49868a0700 (LWP 9689) 0x00007f49f7a13c50 in pthread_rwlock_wrlock () from /lib64/libpthread.so.0
194 Thread 0x7f49f410b700 (LWP 9686) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
193 Thread 0x7f4940351700 (LWP 9728) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
192 Thread 0x7f493ae6a700 (LWP 11096) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
191 Thread 0x7f493f902700 (LWP 11166) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
190 Thread 0x7f493c056700 (LWP 9996) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
189 Thread 0x7f493f3ae700 (LWP 11218) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
188 Thread 0x7f493b79e700 (LWP 10112) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
187 Thread 0x7f49f4b4c700 (LWP 9681) 0x00007f49f7a145bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
186 Thread 0x7f4940046700 (LWP 9732) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
185 Thread 0x7f49f5231700 (LWP 9671) 0x00007f49f7a145bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
184 Thread 0x7f493afde700 (LWP 11160) 0x00007f49f7a14e58 in pthread_cond_signal@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
183 Thread 0x7f493fa76700 (LWP 9744) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
182 Thread 0x7f49f96be820 (LWP 9658) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
181 Thread 0x7f49f9640700 (LWP 9660) 0x00007f49f7a173f5 in __lll_unlock_wake () from /lib64/libpthread.so.0
180 Thread 0x7f493eaf6700 (LWP 10925) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
179 Thread 0x7f493ad72700 (LWP 11080) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
178 Thread 0x7f493e80e700 (LWP 11221) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
177 Thread 0x7f493dafa700 (LWP 9915) 0x00007f49f7a17264 in __lll_lock_wait () from /lib64/libpthread.so.0
176 Thread 0x7f49f5519700 (LWP 9665) 0x00007f49f7a145bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
175 Thread 0x7f49f53a5700 (LWP 9668) 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
174 Thread 0x7f498672c700 (LWP 10292) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
173 Thread 0x7f493d33a700 (LWP 9931) 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
172 Thread 0x7f493c14e700 (LWP 11219) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
171 Thread 0x7f49f5611700 (LWP 9663) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
170 Thread 0x7f493c626700 (LWP 10887) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
169 Thread 0x7f493e792700 (LWP 11189) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
168 Thread 0x7f493f80a700 (LWP 11193) 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6

bt

PRIME_BBCODE_SPOILER_SHOW PRIME_BBCODE_SPOILER:

#0 0x00000000004ca7b8 in ast_channel_hangupcause ()
#1 0x00007f4955a34af6 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
#2 0x00007f498cfb8d36 in ?? () from /usr/lib64/asterisk/modules/res_pjsip_session.so
#3 0x00007f498fbe69d5 in ?? () from /usr/lib64/libpjsip-ua.so.2
#4 0x00007f498fbeb49e in ?? () from /usr/lib64/libpjsip-ua.so.2
#5 0x00007f498fbebd6d in ?? () from /usr/lib64/libpjsip-ua.so.2
#6 0x00007f498fbe5566 in ?? () from /usr/lib64/libpjsip-ua.so.2
#7 0x00007f498f7b1358 in pjsip_dlg_on_tsx_state () from /usr/lib64/libpjsip.so.2
#8 0x00007f498f7acf09 in ?? () from /usr/lib64/libpjsip.so.2
#9 0x00007f498f7ae59f in ?? () from /usr/lib64/libpjsip.so.2
#10 0x00007f498f7ae9a2 in ?? () from /usr/lib64/libpjsip.so.2
#11 0x00007f498f7ac83a in pjsip_tsx_recv_msg () from /usr/lib64/libpjsip.so.2
#12 0x00007f498f7afb52 in ?? () from /usr/lib64/libpjsip.so.2
#13 0x00007f498f79a153 in pjsip_endpt_process_rx_data () from /usr/lib64/libpjsip.so.2
#14 0x00007f498d5ea964 in ?? () from /usr/lib64/asterisk/modules/res_pjsip.so
#15 0x00000000005db37b in ast_taskprocessor_execute ()
#16 0x00000000005e204d in ?? ()
#17 0x00000000005e353b in ?? ()
#18 0x00000000005e32eb in ?? ()
#19 0x00000000005eedeb in ?? ()
#20 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#21 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

bt full

PRIME_BBCODE_SPOILER_SHOW PRIME_BBCODE_SPOILER:

#0 0x00000000004ca7b8 in ast_channel_hangupcause ()
No symbol table info available.
#1 0x00007f4955a34af6 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
No symbol table info available.
#2 0x00007f498cfb8d36 in ?? () from /usr/lib64/asterisk/modules/res_pjsip_session.so
No symbol table info available.
#3 0x00007f498fbe69d5 in ?? () from /usr/lib64/libpjsip-ua.so.2
No symbol table info available.
#4 0x00007f498fbeb49e in ?? () from /usr/lib64/libpjsip-ua.so.2
No symbol table info available.
#5 0x00007f498fbebd6d in ?? () from /usr/lib64/libpjsip-ua.so.2
No symbol table info available.
#6 0x00007f498fbe5566 in ?? () from /usr/lib64/libpjsip-ua.so.2
No symbol table info available.
#7 0x00007f498f7b1358 in pjsip_dlg_on_tsx_state () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#8 0x00007f498f7acf09 in ?? () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#9 0x00007f498f7ae59f in ?? () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#10 0x00007f498f7ae9a2 in ?? () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#11 0x00007f498f7ac83a in pjsip_tsx_recv_msg () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#12 0x00007f498f7afb52 in ?? () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#13 0x00007f498f79a153 in pjsip_endpt_process_rx_data () from /usr/lib64/libpjsip.so.2
No symbol table info available.
#14 0x00007f498d5ea964 in ?? () from /usr/lib64/asterisk/modules/res_pjsip.so
No symbol table info available.
#15 0x00000000005db37b in ast_taskprocessor_execute ()
No symbol table info available.
#16 0x00000000005e204d in ?? ()
No symbol table info available.
#17 0x00000000005e353b in ?? ()
No symbol table info available.
#18 0x00000000005e32eb in ?? ()
No symbol table info available.
#19 0x00000000005eedeb in ?? ()
No symbol table info available.
#20 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#21 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

thread apply all bt (последних несколько потоков)

PRIME_BBCODE_SPOILER_SHOW PRIME_BBCODE_SPOILER:

Thread 226 (Thread 0x7f493c246700 (LWP 10449)):
#0 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
#1 0x00000000004b1ae6 in ast_waitfor_nandfds ()
#2 0x00000000004838fd in ?? ()
#3 0x00000000004840c8 in bridge_channel_internal_join ()
#4 0x000000000046b2a4 in ast_bridge_join ()
#5 0x000000000050812c in ast_bridge_call_with_flags ()
#6 0x00007f494b181718 in ?? () from /usr/lib64/asterisk/modules/app_queue.so
#7 0x00007f494b18589d in ?? () from /usr/lib64/asterisk/modules/app_queue.so
#8 0x000000000056587e in pbx_exec ()
#9 0x00000000005700b5 in ?? ()
#10 0x0000000000572da8 in ast_spawn_extension ()
#11 0x000000000057445b in ?? ()
#12 0x0000000000575e12 in ?? ()
#13 0x00000000005eedeb in ?? ()
#14 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#15 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

Thread 225 (Thread 0x7f49f4e34700 (LWP 9675)):
#0 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
#1 0x00000000005d9a97 in ?? ()
#2 0x00000000005eedeb in ?? ()
#3 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

Thread 224 (Thread 0x7f49f95c4700 (LWP 9661)):
#0 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005344b6 in __ast_cond_timedwait ()
#2 0x00000000005e3625 in ?? ()
#3 0x00000000005e3340 in ?? ()
#4 0x00000000005eedeb in ?? ()
#5 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

Thread 223 (Thread 0x7f493eb72700 (LWP 10479)):
#0 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
#1 0x00000000004b1ae6 in ast_waitfor_nandfds ()
#2 0x00000000004b23c0 in ast_waitfordigit_full ()
#3 0x00000000004b1fb8 in ast_waitfordigit ()
#4 0x00007f494b17ac4b in ?? () from /usr/lib64/asterisk/modules/app_queue.so
#5 0x00007f494b1855da in ?? () from /usr/lib64/asterisk/modules/app_queue.so
#6 0x000000000056587e in pbx_exec ()
#7 0x00000000005700b5 in ?? ()
#8 0x0000000000572da8 in ast_spawn_extension ()
#9 0x000000000057445b in ?? ()
#10 0x0000000000575e12 in ?? ()
#11 0x00000000005eedeb in ?? ()
#12 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#13 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

Thread 222 (Thread 0x7f49f408f700 (LWP 9687)):
#0 0x00007f49f7a16bcd in sem_post () from /lib64/libpthread.so.0
#1 0x00000000005d9bdf in ?? ()
#2 0x00000000005db1f1 in ?? ()
#3 0x00000000005db26c in ast_taskprocessor_push_local ()
#4 0x00000000005c1742 in ?? ()
#5 0x00000000005c19da in ?? ()
#6 0x00000000005c1a49 in stasis_publish ()
#7 0x00000000005c89f8 in ?? ()
#8 0x00000000005c0abd in ?? ()
#9 0x00000000005c16f2 in ?? ()
#10 0x00000000005c19da in ?? ()
#11 0x00000000005c1a49 in stasis_publish ()
#12 0x00000000005cd502 in ast_channel_publish_snapshot ()
#13 0x00000000004aee27 in ?? ()
#14 0x000000000045bcc6 in ?? ()
#15 0x000000000045bfa9 in __ao2_ref ()
#16 0x00007f4955a30be2 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
#17 0x000000000045bcc6 in ?? ()
#18 0x000000000045bfa9 in __ao2_ref ()
#19 0x000000000045c024 in __ao2_cleanup ()
#20 0x00007f4955a32ee1 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
#21 0x00000000005db37b in ast_taskprocessor_execute ()
#22 0x00000000005e3854 in ?? ()
#23 0x00000000005db37b in ast_taskprocessor_execute ()
#24 0x00000000005e204d in ?? ()
#25 0x00000000005e353b in ?? ()
#26 0x00000000005e32eb in ?? ()
#27 0x00000000005eedeb in ?? ()
#28 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#29 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

Thread 221 (Thread 0x7f493ba0a700 (LWP 11046)):
#0 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
#1 0x00000000004b1ae6 in ast_waitfor_nandfds ()
#2 0x00000000004838fd in ?? ()
#3 0x00000000004840c8 in bridge_channel_internal_join ()
#4 0x000000000046b2a4 in ast_bridge_join ()
#5 0x000000000050812c in ast_bridge_call_with_flags ()
#6 0x00007f494b181718 in ?? () from /usr/lib64/asterisk/modules/app_queue.so
#7 0x00007f494b18589d in ?? () from /usr/lib64/asterisk/modules/app_queue.so
#8 0x000000000056587e in pbx_exec ()
#9 0x00000000005700b5 in ?? ()
#10 0x0000000000572da8 in ast_spawn_extension ()
#11 0x000000000057445b in ?? ()
#12 0x0000000000575e12 in ?? ()
#13 0x00000000005eedeb in ?? ()
#14 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#15 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

Thread 220 (Thread 0x7f493db76700 (LWP 9914)):
#0 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00000000005344b6 in __ast_cond_timedwait ()
#2 0x00000000005e3625 in ?? ()
#3 0x00000000005e3340 in ?? ()
#4 0x00000000005eedeb in ?? ()
#5 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f49f6d988fd in clone () from /lib64/libc.so.6

thread apply all bt full (последних несколько потоков)

PRIME_BBCODE_SPOILER_SHOW PRIME_BBCODE_SPOILER:

Thread 226 (Thread 0x7f493c246700 (LWP 10449)):
#0 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
No symbol table info available.
#1 0x00000000004b1ae6 in ast_waitfor_nandfds ()
No symbol table info available.
#2 0x00000000004838fd in ?? ()
No symbol table info available.
#3 0x00000000004840c8 in bridge_channel_internal_join ()
No symbol table info available.
#4 0x000000000046b2a4 in ast_bridge_join ()
No symbol table info available.
#5 0x000000000050812c in ast_bridge_call_with_flags ()
No symbol table info available.
#6 0x00007f494b181718 in ?? () from /usr/lib64/asterisk/modules/app_queue.so
No symbol table info available.
#7 0x00007f494b18589d in ?? () from /usr/lib64/asterisk/modules/app_queue.so
No symbol table info available.
#8 0x000000000056587e in pbx_exec ()
No symbol table info available.
#9 0x00000000005700b5 in ?? ()
No symbol table info available.
#10 0x0000000000572da8 in ast_spawn_extension ()
No symbol table info available.
#11 0x000000000057445b in ?? ()
No symbol table info available.
#12 0x0000000000575e12 in ?? ()
No symbol table info available.
#13 0x00000000005eedeb in ?? ()
No symbol table info available.
#14 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#15 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 225 (Thread 0x7f49f4e34700 (LWP 9675)):
#0 0x00007f49f7a16930 in sem_wait () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00000000005d9a97 in ?? ()
No symbol table info available.
#2 0x00000000005eedeb in ?? ()
No symbol table info available.
#3 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 224 (Thread 0x7f49f95c4700 (LWP 9661)):
#0 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00000000005344b6 in __ast_cond_timedwait ()
No symbol table info available.
#2 0x00000000005e3625 in ?? ()
No symbol table info available.
#3 0x00000000005e3340 in ?? ()
No symbol table info available.
#4 0x00000000005eedeb in ?? ()
No symbol table info available.
#5 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#6 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 223 (Thread 0x7f493eb72700 (LWP 10479)):
#0 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
No symbol table info available.
#1 0x00000000004b1ae6 in ast_waitfor_nandfds ()
No symbol table info available.
#2 0x00000000004b23c0 in ast_waitfordigit_full ()
No symbol table info available.
#3 0x00000000004b1fb8 in ast_waitfordigit ()
No symbol table info available.
#4 0x00007f494b17ac4b in ?? () from /usr/lib64/asterisk/modules/app_queue.so
No symbol table info available.
#5 0x00007f494b1855da in ?? () from /usr/lib64/asterisk/modules/app_queue.so
No symbol table info available.
#6 0x000000000056587e in pbx_exec ()
No symbol table info available.
#7 0x00000000005700b5 in ?? ()
No symbol table info available.
#8 0x0000000000572da8 in ast_spawn_extension ()
No symbol table info available.
#9 0x000000000057445b in ?? ()
No symbol table info available.
#10 0x0000000000575e12 in ?? ()
No symbol table info available.
#11 0x00000000005eedeb in ?? ()
No symbol table info available.
#12 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#13 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 222 (Thread 0x7f49f408f700 (LWP 9687)):
#0 0x00007f49f7a16bcd in sem_post () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00000000005d9bdf in ?? ()
No symbol table info available.
#2 0x00000000005db1f1 in ?? ()
No symbol table info available.
#3 0x00000000005db26c in ast_taskprocessor_push_local ()
No symbol table info available.
#4 0x00000000005c1742 in ?? ()
No symbol table info available.
#5 0x00000000005c19da in ?? ()
No symbol table info available.
#6 0x00000000005c1a49 in stasis_publish ()
No symbol table info available.
#7 0x00000000005c89f8 in ?? ()
No symbol table info available.
#8 0x00000000005c0abd in ?? ()
No symbol table info available.
#9 0x00000000005c16f2 in ?? ()
No symbol table info available.
#10 0x00000000005c19da in ?? ()
No symbol table info available.
#11 0x00000000005c1a49 in stasis_publish ()
No symbol table info available.
#12 0x00000000005cd502 in ast_channel_publish_snapshot ()
No symbol table info available.
#13 0x00000000004aee27 in ?? ()
No symbol table info available.
#14 0x000000000045bcc6 in ?? ()
No symbol table info available.
#15 0x000000000045bfa9 in __ao2_ref ()
No symbol table info available.
#16 0x00007f4955a30be2 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
No symbol table info available.
#17 0x000000000045bcc6 in ?? ()
No symbol table info available.
#18 0x000000000045bfa9 in __ao2_ref ()
No symbol table info available.
#19 0x000000000045c024 in __ao2_cleanup ()
No symbol table info available.
#20 0x00007f4955a32ee1 in ?? () from /usr/lib64/asterisk/modules/chan_pjsip.so
No symbol table info available.
#21 0x00000000005db37b in ast_taskprocessor_execute ()
No symbol table info available.
#22 0x00000000005e3854 in ?? ()
No symbol table info available.
#23 0x00000000005db37b in ast_taskprocessor_execute ()
No symbol table info available.
#24 0x00000000005e204d in ?? ()
No symbol table info available.
#25 0x00000000005e353b in ?? ()
No symbol table info available.
#26 0x00000000005e32eb in ?? ()
No symbol table info available.
#27 0x00000000005eedeb in ?? ()
No symbol table info available.
#28 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#29 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 221 (Thread 0x7f493ba0a700 (LWP 11046)):
#0 0x00007f49f6d8f0d3 in poll () from /lib64/libc.so.6
No symbol table info available.
#1 0x00000000004b1ae6 in ast_waitfor_nandfds ()
No symbol table info available.
#2 0x00000000004838fd in ?? ()
No symbol table info available.
#3 0x00000000004840c8 in bridge_channel_internal_join ()
No symbol table info available.
#4 0x000000000046b2a4 in ast_bridge_join ()
No symbol table info available.
#5 0x000000000050812c in ast_bridge_call_with_flags ()
No symbol table info available.
#6 0x00007f494b181718 in ?? () from /usr/lib64/asterisk/modules/app_queue.so
No symbol table info available.
#7 0x00007f494b18589d in ?? () from /usr/lib64/asterisk/modules/app_queue.so
No symbol table info available.
#8 0x000000000056587e in pbx_exec ()
No symbol table info available.
#9 0x00000000005700b5 in ?? ()
No symbol table info available.
#10 0x0000000000572da8 in ast_spawn_extension ()
No symbol table info available.
#11 0x000000000057445b in ?? ()
No symbol table info available.
#12 0x0000000000575e12 in ?? ()
No symbol table info available.
#13 0x00000000005eedeb in ?? ()
No symbol table info available.
#14 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#15 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 220 (Thread 0x7f493db76700 (LWP 9914)):
#0 0x00007f49f7a1498e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00000000005344b6 in __ast_cond_timedwait ()
No symbol table info available.
#2 0x00000000005e3625 in ?? ()
No symbol table info available.
#3 0x00000000005e3340 in ?? ()
No symbol table info available.
#4 0x00000000005eedeb in ?? ()
No symbol table info available.
#5 0x00007f49f7a109d1 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#6 0x00007f49f6d988fd in clone () from /lib64/libc.so.6
No symbol table info available.

[Vlad1983]

не нужно бесполезный мусор постить

не выполнено главное

собрать с отладочными символами