Hi,
We are using FastCGI servers only. Sometimes by some unknown reason phpdaemon start to spawn new workers without control, despite the limit in the config file.
This ends up in a out of memory and OS goes down.
I'm attaching logs, please note the timestamp, in the end the workers have no chance to die during this short timeframe.
Could you please help me to resolve this issue or point to what the problem could be?
phpdaemon version: 1.0-beta3 (was updated today, 6 March)
phpinfo
System => Linux api-01 2.6.32-358.18.1.el6.centos.plus.x86_64 #1 SMP Wed Aug 28 16:14:04 UTC 2013 x86_64
Build Date => Oct 2 2013 16:17:31
Configure Command => './configure' '--prefix=/srv/php' '--with-config-file-path=/srv/php/etc' '--enable-mbstring' '--enable-fpm' '--with-fpm-user=php' '--with-fpm-group=php' '--with-mysql' '--with-gd' '--with-jpeg-dir=/usr/' '--with-openssl' '--enable-pcntl' '--with-curl' '--enable-libxml' '--with-libxml-dir' '--enable-xmlwriter' '--enable-xmlreader' '--enable-xml' '--enable-posix' '--enable-bcmath' '--enable-json' '--with-pgsql' '--without-pear' '--enable-sockets' '--enable-shmop' '--enable-zip'
Server API => Command Line Interface
Virtual Directory Support => disabled
Configuration File (php.ini) Path => /srv/php/etc
Loaded Configuration File => /srv/php/etc/php.ini
Scan this dir for additional .ini files => (none)
Additional .ini files parsed => (none)
PHP API => 20100412
PHP Extension => 20100525
Zend Extension => 220100525
Zend Extension Build => API220100525,NTS
PHP Extension Build => API20100525,NTS
Debug Build => no
Thread Safety => disabled
Zend Signal Handling => disabled
Zend Memory Manager => enabled
Zend Multibyte Support => provided by mbstring
IPv6 Support => enabled
DTrace Support => disabled
eio
eio support => enabled
Debug support => disabled
Version => 1.2.3
event
event support => enabled
Debug support => disabled
Extra functionality support including HTTP, DNS, and RPC => enabled
OpenSSL support => enabled
Thread safety support => disabled
Version => 1.7.3
Thanks!!!
Logs starts here:
This is where everything goes just fine:
[Thu, 6 Mar 2014 17:55:25.357339 +0000] M#31248 Spawning worker-replacer for reloaded worker #1004
[Thu, 6 Mar 2014 17:55:25.666464 +0000] W#4882 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:27.905212 +0000] W#4786 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:28.073531 +0000] M#31248 Spawning worker-replacer for reloaded worker #1002
[Thu, 6 Mar 2014 17:55:28.217885 +0000] W#4884 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:28.564890 +0000] W#4684 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:29.133475 +0000] M#31248 Spawning worker-replacer for reloaded worker #978
[Thu, 6 Mar 2014 17:55:29.439365 +0000] W#4886 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:37.812265 +0000] W#4532 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:38.029016 +0000] M#31248 Spawning worker-replacer for reloaded worker #951
[Thu, 6 Mar 2014 17:55:38.327381 +0000] W#4930 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:38.771934 +0000] W#4540 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:39.235271 +0000] M#31248 Spawning worker-replacer for reloaded worker #955
[Thu, 6 Mar 2014 17:55:39.540215 +0000] W#4932 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:41.137304 +0000] Spawning 1 worker(s)
[Thu, 6 Mar 2014 17:55:41.442150 +0000] W#4936 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:42.402186 +0000] Spawning 2 worker(s)
[Thu, 6 Mar 2014 17:55:42.705692 +0000] W#4938 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:42.706157 +0000] W#4939 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:43.284194 +0000] W#4550 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:43.616367 +0000] M#31248 Spawning worker-replacer for reloaded worker #959
[Thu, 6 Mar 2014 17:55:43.616484 +0000] Spawning 2 worker(s)
[Thu, 6 Mar 2014 17:55:43.926321 +0000] W#4942 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:43.927454 +0000] W#4943 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:43.929552 +0000] W#4944 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:44.840558 +0000] Spawning 2 worker(s)
[Thu, 6 Mar 2014 17:55:45.144466 +0000] W#4949 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:45.145120 +0000] W#4948 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:46.049425 +0000] Spawning 2 worker(s)
[Thu, 6 Mar 2014 17:55:46.340310 +0000] W#4952 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:46.340931 +0000] W#4953 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:47.091672 +0000] W#4548 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:47.250309 +0000] M#31248 Spawning worker-replacer for reloaded worker #958
[Thu, 6 Mar 2014 17:55:47.250423 +0000] Spawning 3 worker(s)
[Thu, 6 Mar 2014 17:55:47.558718 +0000] W#4956 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:47.559091 +0000] W#4958 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:47.562711 +0000] W#4957 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:47.565347 +0000] W#4959 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:48.462530 +0000] Spawning 3 worker(s)
[Thu, 6 Mar 2014 17:55:48.649319 +0000] W#4541 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:48.767455 +0000] W#4965 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:48.768179 +0000] W#4964 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:48.775493 +0000] W#4966 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
things are starting to get crazy here
[Thu, 6 Mar 2014 17:55:49.156641 +0000] W#4534 'max-requests' exceed. Graceful shutdown.
[Thu, 6 Mar 2014 17:55:49.690276 +0000] M#31248 Spawning worker-replacer for reloaded worker #952
[Thu, 6 Mar 2014 17:55:49.690369 +0000] M#31248 Spawning worker-replacer for reloaded worker #956
[Thu, 6 Mar 2014 17:55:49.690439 +0000] Spawning 3 worker(s)
[Thu, 6 Mar 2014 17:55:49.997087 +0000] W#4972 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:49.999313 +0000] W#4976 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:49.999349 +0000] W#4973 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:50.012817 +0000] W#4975 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:50.014513 +0000] W#4974 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:50.777281 +0000] Spawning 4 worker(s)
[Thu, 6 Mar 2014 17:55:51.088644 +0000] W#4982 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:51.089061 +0000] W#4984 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:51.090635 +0000] W#4983 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:51.090869 +0000] W#4985 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:51.982448 +0000] Spawning 6 worker(s)
[Thu, 6 Mar 2014 17:55:52.295514 +0000] W#4995 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:52.297532 +0000] W#4992 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:52.299258 +0000] W#4994 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:52.301571 +0000] W#4993 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:52.305751 +0000] W#4991 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:52.318936 +0000] W#4990 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:53.203417 +0000] Spawning 6 worker(s)
[Thu, 6 Mar 2014 17:55:53.508526 +0000] W#5004 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:53.511501 +0000] W#5007 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:53.515406 +0000] W#5005 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:53.517924 +0000] W#5002 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:53.531455 +0000] W#5006 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:55:53.513904 +0000] W#5003 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
after a few (3) seconds everything winds up out of control
[Thu, 6 Mar 2014 17:58:30.776636 +0000] W#6361 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:30.778895 +0000] Spawning 14 worker(s)
[Thu, 6 Mar 2014 17:58:30.991519 +0000] W#6360 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:31.268950 +0000] W#6377 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:33.525269 +0000] W#6358 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:34.349243 +0000] W#6402 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:34.361707 +0000] W#6397 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:35.348382 +0000] Spawning 14 worker(s)
[Thu, 6 Mar 2014 17:58:35.375137 +0000] W#6428 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:35.378280 +0000] W#6418 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:38.623374 +0000] W#6345 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:38.955308 +0000] W#6333 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:39.396686 +0000] W#6348 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:40.601376 +0000] W#6398 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:42.156584 +0000] Spawning 14 worker(s)
[Thu, 6 Mar 2014 17:58:50.666827 +0000] W#6421 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:53.162647 +0000] Spawning 14 worker(s)
[Thu, 6 Mar 2014 17:58:54.275637 +0000] W#6408 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:54.789033 +0000] W#6433 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:54.793226 +0000] W#6400 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:54.793834 +0000] W#6434 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:54.809619 +0000] W#6405 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:54.830724 +0000] W#6432 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:56.287545 +0000] W#6431 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:56.380189 +0000] W#6399 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:58.598930 +0000] W#6404 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.157050 +0000] W#6426 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.544690 +0000] W#6401 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.678871 +0000] W#6423 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.678925 +0000] W#6403 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.679469 +0000] W#6396 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.804130 +0000] W#6422 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.836343 +0000] W#6450 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:58:59.848257 +0000] W#6449 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:00.344097 +0000] W#6448 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:00.494307 +0000] W#6453 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:00.518081 +0000] W#6411 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:00.657016 +0000] W#6443 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:00.966787 +0000] W#6437 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:00.994397 +0000] W#6444 \PHPDaemon\Core\Pool:\PHPDaemon\Servers\FastCGI\Pool up.
[Thu, 6 Mar 2014 17:59:01.489796 +0000] Spawning 14 worker(s)
Please help!
Thank you!!!