aMule Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

We're back! (IN POG FORM)

Pages: [1] 2 3

Author Topic: 9649 mem leak?  (Read 25452 times)

gav616

  • Guest
9649 mem leak?
« on: June 07, 2009, 12:09:01 AM »
been using amuled for ages now and it never normally goes above 30-50MB (on heavy load) but ATM im only uploading and i've logged back into my nix box and its nearly 350MB with only 600 on queue,
for my config, this is not normal.
Logged

myth

  • Global Moderator
  • Hero Member
  • *****
  • Karma: 38
  • Offline Offline
  • Posts: 570
Re: 9649 mem leak?
« Reply #1 on: June 07, 2009, 03:08:39 AM »
Here only uploading, 1 file, 620 clients on queue...and about 50 MB...

...i use amule (not amuled!)...
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #2 on: June 07, 2009, 01:32:06 PM »
gav616, are you one of the blessed ones with insane upload rates (> 1 MB/s) ?
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

gav616

  • Guest
Re: 9649 mem leak?
« Reply #3 on: June 07, 2009, 01:52:07 PM »
nope... 30KiB here (laugh)
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #4 on: June 07, 2009, 03:45:14 PM »
Can you try to watch memory usage through a script and match it against the logfile to see if it raises continuously, or when certain actions happen?
Did you compile with mmap or without?
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

gav616

  • Guest
Re: 9649 mem leak?
« Reply #5 on: June 08, 2009, 01:28:23 AM »
yeah, strangely enough its the first time i noticed and enabled 'mmap' at build, i will disable this, as i think now this was the leak..
Logged

gav616

  • Guest
Re: 9649 mem leak?
« Reply #6 on: June 18, 2009, 12:29:36 AM »
build: r9661
build parameters:
Code: [Select]
        --disable-monolithic \
--enable-amule-daemon \
--disable-amulecmd \
--disable-webserver \
--enable-amule-gui \
--disable-cas \
--disable-wxcas \
--disable-ed2k \
--disable-alc \
--disable-alcc \
--disable-upnp \
--disable-xas \
--enable-geoip \
--disable-mmap \
--disable-nls \
--disable-debug \
--enable-optimizeconnection: KAD only
uptime: 2 D 11 H 32 M
downlaods: 7
clients on queue: 320
peak connections: 73
average connections: 16

max new connections / 5 secs: 20 (default)
file buffer size: 240000 bytes (default)
upload queue size: 5000 clients (default)

current 'amuled' usage: 101 MB ....and slowly rising...


Still seems way too big for my liking...
« Last Edit: June 18, 2009, 12:36:58 AM by gav616 »
Logged

gav616

  • Guest
Re: 9649 mem leak?
« Reply #7 on: June 18, 2009, 03:09:53 PM »
Quote from: iz0bbz on June 18, 2009, 08:35:45 AM
gav616,
I see that running amuled for a long time (>1-2D),  the memory usage tend to reach a steady state.
So, against what I said previously, I currently don't think there is a 'leakage'.

Absolute memory footprint is another story, and it depends on several factors: number of connections, downloads, shared files, clients, IP filter enabled or not, and so on.
Looking at your last post, I'd say that in your running conditions 100Mbyte footprint is appropriate.


ah, ok, thanks for info.
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #8 on: June 18, 2009, 10:02:37 PM »
Can one of you please try aMule instead of amuled to see if it has the same memory usage?
And please also try amuled with optimize and without debug.
Of course memory use is supposed to rise over time (with KAD tables building), but I think amuled is using way too much memory here.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #9 on: June 19, 2009, 11:49:58 PM »
What about amuled 2.2.5 ? How much memory does it take ?
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #10 on: June 26, 2009, 08:49:36 PM »
Thank you very much for making these tests for us. So it's probably nothing introduced recently.

Some other things to test (individually, just with SVN and either with or without SVN as you like):

- remove your known*.met (back it up and restore it later)
- disable Kad
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #11 on: July 03, 2009, 09:18:18 PM »
known.met: I thought a BIG load of known AICH hashes might be part of the problem. Well, seems not to be.

I can't say what Kad does when it gets disconnected (maybe it doesn't free its internal tables). Please try to disable Kad and then restart the client and see how memory behaves then.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #12 on: July 08, 2009, 10:49:58 PM »
I wonder what hogs all that memory.  ???
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #13 on: July 10, 2009, 09:40:50 PM »
KAD is supposed to store data about other nodes, who has which file and which keyword results in which hash. And this data raises with time as more information is being published, reaching some maximum. No idea how much memory it's supposed to take.

I'm rather surprised how much memory it takes without Kad. I think I should do an analysis how much the different data structures take, and how big they grow, but that takes some time.

Freddy77 did a lot of memory analysis, but I can't say if he's still around.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #14 on: July 10, 2009, 11:59:54 PM »
Could you possibly run amuled with the Valgrind heap profiler?
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon
Pages: [1] 2 3
« previous next »