WebFaction
Community site: login faq

Hi guys, I've just received message on the control panel that my supervisor instance was killed because i was using too much memory.

here is the report:

mywedding - 28MB - 1 day, 14:23:58 - 2771 - python2.7 manage.py supervisor --daemonize
mywedding - 1MB - 1 day, 14:23:58 - 17869 - sshd: mywedding@pts/12
mywedding - 1MB - 1 day, 14:23:58 - 17870 - -bash
mywedding - 32MB - 1 day, 14:23:58 - 25066 - /usr/local/bin/python2.7 /home/mywedding/webapps/mywedding/mywedding/wedding_webservices/manage.py celerybeat -l debug
mywedding - 36MB - 1 day, 14:23:58 - 25067 - /usr/local/bin/python2.7 /home/mywedding/webapps/mywedding/mywedding/wedding_webservices/manage.py celeryd -l debug --logfile=celery.log --concurrency=3
mywedding - 9MB - 1 day, 14:23:58 - 25092 - redis-server
mywedding - 45MB - 1 day, 14:23:58 - 25106 - /usr/local/bin/python2.7 /home/mywedding/webapps/mywedding/mywedding/wedding_webservices/manage.py celeryd -l debug --logfile=celery.log --concurrency=3
mywedding - 27MB - 1 day, 14:23:58 - 25107 - /usr/local/bin/python2.7 /home/mywedding/webapps/mywedding/mywedding/wedding_webservices/manage.py celeryd -l debug --logfile=celery.log --concurrency=3
mywedding - 45MB - 1 day, 14:23:58 - 25108 - /usr/local/bin/python2.7 /home/mywedding/webapps/mywedding/mywedding/wedding_webservices/manage.py celeryd -l debug --logfile=celery.log --concurrency=3
mywedding - 1MB - 1 day, 14:23:58 - 26547 - /home/mywedding/webapps/mywedding/apache2/bin/httpd.worker -f /home/mywedding/webapps/mywedding/apache2/conf/httpd.conf -k start
mywedding - 44MB - 1 day, 14:23:58 - 26548 - /home/mywedding/webapps/mywedding/apache2/bin/httpd.worker -f /home/mywedding/webapps/mywedding/apache2/conf/httpd.conf -k start
mywedding - 39MB - 1 day, 14:23:58 - 26549 - /home/mywedding/webapps/mywedding/apache2/bin/httpd.worker -f /home/mywedding/webapps/mywedding/apache2/conf/httpd.conf -k start
mywedding - 2MB - 1 day, 14:23:58 - 26550 - /home/mywedding/webapps/mywedding/apache2/bin/httpd.worker -f /home/mywedding/webapps/mywedding/apache2/conf/httpd.conf -k start

Can I check, is the memory usage for supervisor and the celery workers normal? I am running a pretty small application so I am quite surprised with this.

asked 17 Jan '13, 21:11

carrier24sg's gravatar image

carrier24sg
115
accept rate: 0%


I think this is normal, yes, for the configuration settings you've chosen.

That said, for a small site, you may not need Concurrency 3 on celeryd, and you may also want to lower your mod_wsgi concurrent process setting as well. There is a perpetual trade-off between the amount of traffic your site can handle and how much memory it uses, so the assumptions may be too high in your case, causing more memory usage than necessary for your application.

Finally, supervisor itself was using 28MB of RAM. If you're looking for a lighter alternative, you can consider using a simple watchdog script instead.

Finally, if there's any static media you're not using our front-end Nginx server to serve, that is another common source of unnecessary RAM usage.

Hope that helps!

permanent link

answered 18 Jan '13, 01:51

ryans's gravatar image

ryans ♦♦
5.0k42856
accept rate: 43%

edited 18 Jan '13, 01:52

Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×891
×82
×8

question asked: 17 Jan '13, 21:11

question was seen: 2,093 times

last updated: 18 Jan '13, 01:52

WEBFACTION
REACH US
SUPPORT
AFFILIATE PROGRAM
LEGAL
© COPYRIGHT 2003-2017 PARAGON INTERNET GROUP LIMITED
WEBFACTION IS A SERVICE OF PARAGON INTERNET GROUP LIMITED
REGISTERED IN ENGLAND AND WALES 7573953 - VAT REGISTRATION NUMBER 182147021
5TH FLOOR, THE OLD VINYL FACTORY, HAYES, UB3 1HA, UNITED KINGDOM