LiteSpeed core dumping like crazy

#1
Hey,

My LiteSpeed has been core dumping like crazy, and I can't figure out why. In the past month or so, I have got over 1000 core dumps. When I go to the GDB command "gdb /usr/local/lsws/bin/core.XXXXXX", all the ones I looked at come back with something very similar to this

warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fffcb278000
Core was generated by `httpd'.
Program terminated with signal 6, Aborted.
#0 0x0000003494a32925 in ?? ()
"/usr/local/lsws/bin/core.1000796" is a core file.
Please specify an executable to debug.
(gdb) bt
#0 0x0000003494a32925 in ?? ()
#1 0x0000003494a34105 in ?? ()
#2 0x00007fffcb21e148 in ?? ()
#3 0x00007fffcb21e130 in ?? ()
#4 0x00007fffcb222fa9 in ?? ()
#5 0x000000000000000e in ?? ()
#6 0x0000003494b578af in ?? ()
#7 0x0000000000000003 in ?? ()
#8 0x00007fffcb21e13a in ?? ()
#9 0x0000000000000006 in ?? ()
#10 0x0000003494b578b3 in ?? ()
#11 0x0000000000000002 in ?? ()
#12 0x00007fffcb21e12e in ?? ()
#13 0x0000000000000002 in ?? ()
#14 0x0000003494b55e64 in ?? ()
#15 0x0000000000000001 in ?? ()
#16 0x0000003494b578af in ?? ()
#17 0x0000000000000003 in ?? ()
#18 0x00007fffcb21e136 in ?? ()
#19 0x000000000000000a in ?? ()
#20 0x0000003494b578b3 in ?? ()
#21 0x0000000000000002 in ?? ()
#22 0x0000000000000020 in ?? ()
#23 0x0000000000000000 in ?? ()

-----------------

warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff1ebfe000
Core was generated by `httpd'.
Program terminated with signal 6, Aborted.
#0 0x0000003494a32925 in ?? ()
"/usr/local/lsws/bin/core.477210" is a core file.
Please specify an executable to debug.
(gdb) bt
#0 0x0000003494a32925 in ?? ()
#1 0x0000003494a34105 in ?? ()
#2 0x00007fff1ebee708 in ?? ()
#3 0x00007fff1ebee6f0 in ?? ()
#4 0x00007fff1ebf2fa9 in ?? ()
#5 0x000000000000000e in ?? ()
#6 0x0000003494b578af in ?? ()
#7 0x0000000000000003 in ?? ()
#8 0x00007fff1ebee6fa in ?? ()
#9 0x0000000000000006 in ?? ()
#10 0x0000003494b578b3 in ?? ()
#11 0x0000000000000002 in ?? ()
#12 0x00007fff1ebee6ee in ?? ()
#13 0x0000000000000002 in ?? ()
#14 0x0000003494b55e64 in ?? ()
#15 0x0000000000000001 in ?? ()
#16 0x0000003494b578af in ?? ()
#17 0x0000000000000003 in ?? ()
#18 0x00007fff1ebee6f6 in ?? ()
#19 0x000000000000000a in ?? ()
#20 0x0000003494b578b3 in ?? ()
#21 0x0000000000000002 in ?? ()
#22 0x0000000000000020 in ?? ()
#23 0x0000000000000000 in ?? ()

--------------------------------------------

I can post more if required.

Thanks in advance!
 
#3
Got this:

[/usr/local/lsws/bin]# gdb /usr/local/lsws/bin/lshttpd /usr/local/lsws/bin/core.889072

GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...

Reading symbols from /usr/local/lsws/bin/lshttpd...done.
warning: core file may not match specified executable file.
[New Thread 889072]
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2

warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff241fe000
Core was generated by `httpd'.
Program terminated with signal 6, Aborted.
#0 0x0000003494a32925 in ?? ()

Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.132.el6.x86_64

(gdb) bt
#0 0x0000003494a32925 in ?? ()
#1 0x0000003494a34105 in ?? ()
#2 0x00007fff2416f098 in ?? ()
#3 0x00007fff2416f080 in ?? ()
#4 0x00007fff24173fa9 in ?? ()
#5 0x000000000000000e in ?? ()
#6 0x0000003494a76166 in ?? ()
#7 0x3030303030303030 in ?? ()
#8 0x3061643235333130 in ?? ()
#9 0x00007fc702acd000 in ?? ()
#10 0x000000349460dff0 in _dl_fixup () from /lib64/ld-linux-x86-64.so.2
#11 0x0000000001352da0 in ?? ()
#12 0x0000000000000000 in ?? ()
(gdb)
 

NiteWave

Administrator
#4
warning: core file may not match specified executable file.
......
Core was generated by `httpd'.

so the binary still wrong. please try this one:
gdb /usr/local/lsws/bin/httpd /usr/local/lsws/bin/core.XXXXXX
 
#5
# gdb /usr/local/lsws/bin/httpd /usr/local/lsws/bin/core.889072
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...

Reading symbols from /usr/local/lsws/bin/httpd...(no debugging symbols found)...done.
[New Thread 889072]
Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo='*-debug*' install /usr/lib/debug/.build-id/37/8b18264e38409ad6d84e85f98e2d72822550e4
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /usr/lib64/liblve.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/liblve.so.0
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1

warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff241fe000
Core was generated by `httpd'.
Program terminated with signal 6, Aborted.
#0 0x0000003494a32925 in raise () from /lib64/libc.so.6
Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.132.el6.x86_64 libgcc-4.4.7-4.el6.x86_64 liblve-1.2-1.4.el6.cloudlinux.x86_64
(gdb) bt
#0 0x0000003494a32925 in raise () from /lib64/libc.so.6
#1 0x0000003494a34105 in abort () from /lib64/libc.so.6
#2 0x0000003494a70837 in __libc_message () from /lib64/libc.so.6
#3 0x0000003494a76166 in malloc_printerr () from /lib64/libc.so.6
#4 0x0000003494a78c93 in _int_free () from /lib64/libc.so.6
#5 0x0000003494a667cd in fclose@@GLIBC_2.2.5 () from /lib64/libc.so.6
#6 0x00007fc702ad40ea in _nss_files_getpwuid_r () from /lib64/libnss_files.so.2
#7 0x0000003494aac06d in getpwuid_r@@GLIBC_2.2.5 () from /lib64/libc.so.6
#8 0x0000003494aab95f in getpwuid () from /lib64/libc.so.6
#9 0x0000000000402d8a in ?? ()
#10 0x00000000004038c2 in ?? ()
#11 0x0000003494a1ed1d in __libc_start_main () from /lib64/libc.so.6
#12 0x00000000004018da in ?? ()
#13 0x00007fff24172408 in ?? ()
#14 0x000000000000001c in ?? ()
#15 0x0000000000000001 in ?? ()
#16 0x00007fff24173fa9 in ?? ()
#17 0x0000000000000000 in ?? ()
(gdb)
 

NiteWave

Administrator
#6
now the binary is correct. what's your current lsws version ? and OS version ?
#ls -al /usr/local/lsws/bin
#uname -a
will help
 
#7
Before I believe it was at 4.2.1, however when I made this ticket a member of the LiteSpeed support staff told me to upgrade to the debug build of :

lsws-4.2.7-ent-x86_64-linux-dbg.tar.gz

so :

lsws 4.2.7 Debug
Linux XXXX.XXXXXX.com 2.6.32-458.23.2.lve1.2.45.el6.x86_64 #1 SMP Fri Nov 22 08:02:49 EST 2013 x86_64 x86_64 x86_64 GNU/Linux
 

NiteWave

Administrator
#8
it's weird debug version has no symbol info, like this:
#15 0x0000000000000001 in ?? ()
#16 0x00007fff24173fa9 in ?? ()
#17 0x0000000000000000 in ?? ()
to be sure, delete all
/usr/local/lsws/bin/core.*
then after new core dumped -- /usr/local/lsws/bin/core.123456
#gdb /usr/local/lsws/bin/httpd /usr/local/lsws/bin/core.123456

run "bt" again
 
Top