WebFaction
Community site: login faq

My site is using the Requests python package to make a good number of requests to another site. This happens whenever a user triggers a particular ajax request on mine. (I on-demand scrape the other site to provide the info, and it involves navigating through around 8 pages via post requests, and two or three parsings via the BeautifulSoup package.)

When I'm making normal requests to my site, the apache worker memory usage is very stable at 33MB or so. However, each time I make a request triggering the actions to get this extra info, it leaks about 12MB (!).

I'm thinking this may have something to do with making the requests out, but I really am no expert at the workings of Apache, mod_wsgi, or Django. Any insight would be appreciated! :)

P.S. Merry Christmas! :)

asked 24 Dec '12, 22:49

Chris%20Cooper's gravatar image

Chris Cooper
315
accept rate: 0%


There are some tips elsewhere in the forum with links to resources to help you debug your memory usage. Here's a good one: Apache allocates to my app a lot of memory

Hope that helps!

permanent link

answered 25 Dec '12, 10:16

seanf's gravatar image

seanf
12.1k21635
accept rate: 37%

Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×898
×221
×82
×2

question asked: 24 Dec '12, 22:49

question was seen: 3,025 times

last updated: 25 Dec '12, 10:16

WEBFACTION
REACH US
SUPPORT
AFFILIATE PROGRAM
LEGAL
© COPYRIGHT 2003-2016 SWARMA LIMITED - WEBFACTION IS A SERVICE OF SWARMA LIMITED
REGISTERED IN ENGLAND AND WALES 5729350 - VAT REGISTRATION NUMBER 877397162
5TH FLOOR, THE OLD VINYL FACTORY, HAYES, UB3 1HA, UNITED KINGDOM