https://redmine.lighttpd.net/https://redmine.lighttpd.net/favicon.ico?13667327412012-01-10T16:41:47Zlighty labsLighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77322012-01-10T16:41:47Zspaam
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Need Feedback</i></li></ul><p>Can you get a stack trace? you need to install a version with debug symbols for that. kinda hard to guess what it is if we don't have it..</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77332012-01-10T16:49:00Zspaam
<ul></ul><p>are you using mod_compress?</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77342012-01-10T17:00:53Zmolliver
<ul></ul><p>Hi,</p>
<p>No we are not using mod_compress and this is a live production server so we cant really switch to a debug version.</p>
<p>Sorry</p>
<p>Mark</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77352012-01-10T17:33:01Zstbuehler
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/7735/diff?detail_id=5983">diff</a>)</li><li><strong>Priority</strong> changed from <i>Urgent</i> to <i>High</i></li></ul><ul>
<li>You had segfaults from Dec 2 to Oct 20 (in 2011???) - looks like 10 months to me. can't be that urgent.</li>
<li>Oct 20 is before Dec 28, so no segfaults in the current version</li>
<li>segfaults in libz, but no mod_compress loaded: could be ssl - or mod_deflate (which isn't in upstream 1.4 and therefore not supported).</li>
<li>where does this version come from: -devel-b3fdfbf ? custom patches?</li>
</ul>
<p>debug symbols != debug version. you can compile with full optimization <strong>and</strong> debug symbols (-g), and even strip the debug symbols into separate files if the memory usage of these would be a problem.<br />then you can enable core dumps, and after the next crash you can load the core dump with gdb and get a useful backtrace.</p>
<p>i'm afraid we can't do anything without details.</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77362012-01-10T21:58:05Zmarek
<ul></ul><p>I got the same:</p>
<pre>
lighttpd[28625]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11052]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11187]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11210]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[2897]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11248]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11250]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11235]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11276]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11202]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11318]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[2855]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
lighttpd[11340]: segfault at 0000000000000358 rip 000000000040e9d7 rsp 00007fff26fde8f0 error 6
</pre> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77372012-01-10T21:59:05Zmarek
<ul></ul><p>Also php-cgi is segfaulting too:</p>
<pre>
php-cgi[11351]: segfault at 00000000059d5950 rip 00002b06f7c3ef50 rsp 00007fff44a34230 error 4
php-cgi[12109]: segfault at 0000000004420950 rip 00002b3baaee4f50 rsp 00007fff3713bcf0 error 4
php-cgi[13511]: segfault at 0000000014ca0860 rip 00002ae8f75a6d74 rsp 00007fffad5afb10 error 4
php-cgi[16595]: segfault at 000000000e0fb860 rip 00002addb06c5f50 rsp 00007fffa2daad00 error 4
php-cgi[16905]: segfault at 000000000ab5c860 rip 00002b91fff2ad74 rsp 00007fff35a49f20 error 4
php-cgi[24509]: segfault at 0000000017655950 rip 00002ad6d0e9cf50 rsp 00007fff6ac439e0 error 4
php-cgi[1387]: segfault at 00002ac97bdbd439 rip 00002ac97bdbd439 rsp 00000000449f90a0 error 14
php-cgi[1382]: segfault at 00002ac97bdbd5d2 rip 00002ac97bdbd5d2 rsp 0000000040ef60d8 error 14
php-cgi[1383]: segfault at 00002ac97bdbd5c8 rip 00002ac97bdbd5c8 rsp 00000000421f50d8 error 14
php-cgi[1384]: segfault at 00002ac97bdbd5d0 rip 00002ac97bdbd5d0 rsp 0000000042bf60d8 error 14
php-cgi[1385]: segfault at 00002ac97bdbd5c8 rip 00002ac97bdbd5c8 rsp 00000000435f70d8 error 14
php-cgi[1388]: segfault at 00002ac97bdbd5c8 rip 00002ac97bdbd5c8 rsp 00000000453fa0d8 error 14
php-cgi[1386]: segfault at 00002ac97bdbd5d6 rip 00002ac97bdbd5d6 rsp 0000000043ff80d8 error 14
php-cgi[7326]: segfault at 0000000020169860 rip 00002aabfcfc8f50 rsp 00007fff212e04e0 error 4
php-cgi[17901]: segfault at 000000001ae7e860 rip 00002ad8a462bd74 rsp 00007fffbb0d5e00 error 4
php-cgi[18380]: segfault at 000000001ae7e860 rip 00002b393b360d74 rsp 00007fff286c06b0 error 4
php-cgi[20190]: segfault at 00002ae8954fc5d6 rip 00002ae8954fc5d6 rsp 0000000041fef0d8 error 14
php-cgi[20196]: segfault at 00002ae8954fc5d6 rip 00002ae8954fc5d6 rsp 00000000451f40d8 error 14
php-cgi[20193]: segfault at 00002ae8954fc5d6 rip 00002ae8954fc5d6 rsp 00000000433f10d8 error 14
php-cgi[20195]: segfault at 00002ae8954fc5d6 rip 00002ae8954fc5d6 rsp 00000000447f30d8 error 14
php-cgi[20191]: segfault at 00002ae8954fc5d2 rip 00002ae8954fc5d2 rsp 0000000040ecb0d8 error 14
php-cgi[20192]: segfault at 00002ae8954fc5d2 rip 00002ae8954fc5d2 rsp 00000000429f00d8 error 14
php-cgi[20194]: segfault at 00002ae8954fc5cc rip 00002ae8954fc5cc rsp 0000000043df20d8 error 14
php-cgi[29854]: segfault at 0000000011e8f950 rip 00002ad1d32b1f50 rsp 00007fffc4c3fea0 error 4
php-cgi[2441]: segfault at 000000000a69e950 rip 00002b13cb0e3f50 rsp 00007fffb7995750 error 4
php-cgi[3677]: segfault at 000000000f26c950 rip 00002ba9e46a3f50 rsp 00007fff4fc5dc90 error 4
php-cgi[5459]: segfault at 00002ab77d92c5d2 rip 00002ab77d92c5d2 rsp 00000000434560d8 error 14
php-cgi[5456]: segfault at 00002ab77d92c5c8 rip 00002ab77d92c5c8 rsp 00000000420540d8 error 14
php-cgi[5458]: segfault at 00002ab77d92c5d6 rip 00002ab77d92c5d6 rsp 0000000042a550d8 error 14
php-cgi[7803]: segfault at 00002b6f2c5db5d0 rip 00002b6f2c5db5d0 rsp 00000000444af0d8 error 14
php-cgi[7799]: segfault at 00002b6f2c5db5d2 rip 00002b6f2c5db5d2 rsp 0000000041cab0d8 error 14
php-cgi[7805]: segfault at 00002b6f2c5db5d6 rip 00002b6f2c5db5d6 rsp 00000000458b10d8 error 14
php-cgi[7802]: segfault at 00002b6f2c5db5d2 rip 00002b6f2c5db5d2 rsp 0000000043aae0d8 error 14
php-cgi[7801]: segfault at 00002b6f2c5db5d0 rip 00002b6f2c5db5d0 rsp 00000000430ad0d8 error 14
php-cgi[16808]: segfault at 00000000123bb950 rip 00002b8fe88d0f50 rsp 00007fff45ffb5c0 error 4
php-cgi[16828]: segfault at 000000000e2ee950 rip 00002af501c3fd74 rsp 00007ffff47e7000 error 4
php-cgi[23617]: segfault at 000000000a32e950 rip 00002ae40e3fff50 rsp 00007fff7c2bdb90 error 4
php-cgi[7657]: segfault at 000000001adb3950 rip 00002b2699179d74 rsp 00007ffff320ac40 error 4
php-cgi[1659]: segfault at 0000000015119930 rip 00002b3eb386ff50 rsp 00007fff168309b0 error 4
php-cgi[1672]: segfault at 0000000004ce69f0 rip 00002b67e6b50f50 rsp 00007fffcdb0ead0 error 4
php-cgi[10391]: segfault at 000000001f879950 rip 00002b68b2f89f50 rsp 00007fffe94aa750 error 4
php-cgi[20404]: segfault at 0000000019412950 rip 00002b8a39feff50 rsp 00007fffa7cd96c0 error 4
php-cgi[25993]: segfault at 000000000cd3b860 rip 00002ba2a4b03f50 rsp 00007fff977e7c60 error 4
php-cgi[25892]: segfault at 000000000cd3b860 rip 00002ac821f85d74 rsp 00007fff6c05ab40 error 4
</pre> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77382012-01-10T22:01:40Zstbuehler
<ul></ul><p>"same"... you have a 64-bit build, the original report is 32-bit (afaics), and different error numbers (can be the same problem ofc)</p>
<p>and again: no details, no fixing possible.</p>
<p>btw: could it be that your memory is failing? and you could at least provide some environment details, like distribution and so on.</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77402012-01-12T19:23:43Zmarek
<ul></ul><p>I'm using CentOS 5.7 64-bit on dedicated server. My memory is fine.</p>
<p>Lighttpd 1.4.30 compiled with openssl 64-bit.</p>
<pre>
lighttpd/1.4.30 (ssl) - a light and fast webserver
Build-Date: Dec 27 2011 16:15:51
</pre> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77412012-01-12T19:25:18Zmarek
<ul></ul><p>Error logs:</p>
<pre>
2012-01-12 19:09:32: (mod_cgi.c.1313) cleaning up CGI: process died with signal 11
2012-01-12 19:14:08: (mod_cgi.c.601) cgi died, pid: 14840
2012-01-12 19:14:08: (mod_cgi.c.1313) cleaning up CGI: process died with signal 11
2012-01-12 19:15:11: (mod_cgi.c.601) cgi died, pid: 18889
2012-01-12 19:16:49: (mod_cgi.c.601) cgi died, pid: 25413
2012-01-12 19:19:25: (mod_cgi.c.601) cgi died, pid: 2781
2012-01-12 19:19:25: (mod_cgi.c.601) cgi died, pid: 2783
2012-01-12 19:19:27: (mod_cgi.c.1313) cleaning up CGI: process died with signal 11
2012-01-12 19:22:25: (mod_cgi.c.601) cgi died, pid: 28934
2012-01-12 19:22:26: (mod_cgi.c.601) cgi died, pid: 28211
</pre> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77422012-01-12T19:27:17Zmarek
<ul></ul><p>My server specs are:</p>
<p>Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 16 GB RAM DDR3, 2x3 TB HDD S/W RAID1 + 120 GB SSD</p>
<pre>
PHP 5.3.8 (cli) (built: Sep 30 2011 20:07:13)
Copyright (c) 1997-2011 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2011 Zend Technologies
with XCache v1.3.2, Copyright (c) 2005-2011, by mOo
with the ionCube PHP Loader v4.0.11, Copyright (c) 2002-2011, by ionCube Ltd., and
with TrueBug PHP Loader v1.2.0, Copyright (c) 2006-2010, by TrueBug Software
with SourceGuardian v8.2, Copyright (c) 2000-2010, by Inovica Ltd.
with Zend Guard Loader v3.3, Copyright (c) 1998-2010, by Zend Technologies
</pre> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77432012-01-12T19:36:40Zicy
<ul></ul><p>Please enable core-dumps and provide a stacktrace via gdb.<br />Or if it crashes very frequently or is producable just attach gdb to the running process.</p>
<p>Without that, we can't figure out at which part it's crashing.</p>
<p>BTW: how did you make sure you RAM is fine?</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77442012-01-13T09:08:16Zredsolar
<ul></ul><p>After getting the same error as marek, under the same OS (CentOS 5.7 x86_64), came across this issue, and did a backtrace in gdb with the following result:</p>
<p>This happens across multiple servers, and is not happening if i downgrade back to lighttpd 1.4.29</p>
<pre>
(gdb) backtrace
#0 ssl_info_callback (ssl=<value optimized out>, where=<value optimized out>,
ret=<value optimized out>) at network.c:36
#1 0x00002b6bb0d547a2 in ssl23_accept () from /lib64/libssl.so.6
#2 0x00002b6bb0d55786 in ssl23_read () from /lib64/libssl.so.6
#3 0x000000000040ab22 in connection_handle_read (srv=0x14ac25e0,
con=0x14b7ea40) at connections.c:224
#4 connection_handle_read_state (srv=0x14ac25e0, con=0x14b7ea40)
at connections.c:907
#5 0x000000000040c6cf in connection_state_machine (srv=0x14ac25e0,
con=0x14b7ea40) at connections.c:1655
#6 0x000000000040d59b in network_server_handle_fdevent (srv=0x14ac25e0,
context=0x14b22fc0, revents=<value optimized out>) at network.c:64
#7 0x0000000000408548 in main (argc=<value optimized out>,
argv=0x7fffed6ed828) at server.c:1470
</pre> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77452012-01-13T10:16:33Zdarix
<ul></ul><p>redsolar: your bug should be fixed with applying <a class="external" href="http://redmine.lighttpd.net/projects/lighttpd/repository/revisions/2822">http://redmine.lighttpd.net/projects/lighttpd/repository/revisions/2822</a> on top of 1.4.30</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77462012-01-13T22:43:06Zmarek
<ul></ul><p>So this will be fixed in 1.4.31 ? I've tested my memory with memtest.</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77472012-01-13T23:30:01Zredsolar
<ul></ul><p>Thanks for the link to the patch, darix, everything works for me now</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77482012-01-19T17:23:39Zmarek
<ul></ul><p>1.4.31-devel works fine for me too.</p>
<p>lighttpd/1.4.31-devel-2826 (ssl) - a light and fast webserver<br />Build-Date: Jan 14 2012 13:16:59</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77502012-01-20T12:39:37Zstbuehler
<ul><li><strong>Status</strong> changed from <i>Need Feedback</i> to <i>Fixed</i></li></ul><p>Fixed in r2822</p> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=77512012-01-20T12:44:35Zstbuehler
<ul><li><strong>Status</strong> changed from <i>Fixed</i> to <i>Missing Feedback</i></li></ul><p>ah, i didn't have the initial report in mind.</p>
<ul>
<li>the crashes in ssl are fixed in r2822.</li>
<li>the initial report (segfaults in libc/zlib): Missing Feedback.</li>
</ul> Lighttpd - Bug #2382: Lighttpd Segfaulthttps://redmine.lighttpd.net/issues/2382?journal_id=138432024-01-03T05:23:27Zgstrauss
<ul><li><strong>Status</strong> changed from <i>Missing Feedback</i> to <i>Fixed</i></li><li><strong>ASK QUESTIONS IN Forums</strong> set to <i>No</i></li></ul><p>mod_compress was replaced with mod_deflate (backported to lighttpd in lighttpd 1.4.42) and there are no known outstanding crashes.</p>