aMule Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

We're back! (IN POG FORM)

Pages: 1 2 [3]

Author Topic: 9649 mem leak?  (Read 25405 times)

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
Re: 9649 mem leak?
« Reply #30 on: September 14, 2009, 12:01:52 AM »

I think it's time to talk to the Powers That Be, Stu.

But wait for me to do so, don't do it yourself for now.
Logged

EloiBosc

  • Approved Newbie
  • *
  • Karma: 3
  • Offline Offline
  • Posts: 6
Re: 9649 mem leak?
« Reply #31 on: September 15, 2009, 10:21:37 AM »

Great, you're under way. The "trust value" can be a smart solution: Weeks ago I manually blocked these addresses and since then amuled is stable.

In my July 26 post I quoted some brisk memory rise due to a spontaneous "Stop/Start Kad". This is caused by a detection of no-kad-traffic on the udpport. The port is not receiving and it is turned off/on to unblock. On my amuled this happens 1 or 2 times per day.

I checked the income packets looking for something (high udp traffic, malformed packets, ...) but apparently all was normal when the udpport was blocked. I'd like to know what part is responsible (os, wxWidgets, amule, ...) and some solution, since the code is protected about it somebody may know. I didn't find references, only some on wxWidgets (I put last version: no changes).



Logged

gav616

  • Guest
Re: 9649 mem leak?
« Reply #32 on: September 15, 2009, 11:18:01 PM »

I'm convinced '979*' have fixed the massive mem leak.......?

..couple of days up-time ATM, and its still under 90mb (same number onqueue,  downloads,  KAD-only, build flags)
It looks 'better' to me anyway.
Logged

gav616

  • Guest
Re: 9649 mem leak?
« Reply #33 on: September 26, 2009, 02:12:17 PM »

forget my last post, today mule is taking nearly 400mb with 1 download and 400 on queue. (9871)
Logged

EloiBosc

  • Approved Newbie
  • *
  • Karma: 3
  • Offline Offline
  • Posts: 6
Re: 9649 mem leak?
« Reply #34 on: September 27, 2009, 09:30:05 AM »

If you got big key_index.dat, cause of big memory usage, and while waiting for a solution based on "trust value" try to filter (iptables or other) the nets:

sudo iptables -A INPUT -s 129.47.136.0/24 -j DROP
sudo iptables -A INPUT -s 129.47.160.0/24 -j DROP
sudo iptables -A INPUT -s 129.47.161.0/24 -j DROP
sudo iptables -A INPUT -s 129.47.147.0/24 -j DROP


Logged

p.r.

  • Jr. Member
  • **
  • Karma: 0
  • Offline Offline
  • Posts: 50
Re: 9649 mem leak?
« Reply #35 on: November 14, 2009, 03:52:06 PM »

I have a similar problem with amuled 2.2.6.

If KAD is disabled amuled VmSize is about 12-13MB.

IF KAD is enabled memory usage begins to slowly and continuously grow -
amuled starts with VmSize 18MB and 10 hours later VmSize reaches 30MB,
size of key_index.dat grows from 1MB to 2M.
But in my case Moblock doesn't detect any Whittaker IPs, although I know for sure these ip ranges are in my ipfilter.p2p

When I was running amuled 2.2.3 with KAD enabled VmSize never went over 20MB.
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #36 on: November 15, 2009, 12:56:26 PM »

Sounds perfectly normal to me. Information gets posted slowly and so memory usage grows slowly. Does it still increase further after 24 hours?
When I was running amuled 2.2.3 with KAD enabled VmSize never went over 20MB.
How long ago was that? And same conditions?  You know, just a different KAD-ID might get you to a "hotter" spot in the network with more data to handle.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

p.r.

  • Jr. Member
  • **
  • Karma: 0
  • Offline Offline
  • Posts: 50
Re: 9649 mem leak?
« Reply #37 on: November 15, 2009, 02:59:48 PM »

Sounds perfectly normal to me. Information gets posted slowly and so memory usage grows slowly. Does it still increase further after 24 hours?
...
Yes,  perhaps it's normal, but I have little RAM - 32MB.
I don't run amuled for 24h.

...
When I was running amuled 2.2.3 with KAD enabled VmSize never went over 20MB.
How long ago was that? And same conditions?
...
It was two months ago,  conditions didn't changed except  Shared Files that increased a little in number.

...  You know, just a different KAD-ID might get you to a "hotter" spot in the network with more data to handle.
Yes, perhaps that is true.
Today amuled 2.2.6  (with enabled KAD) starts with VmSize 14MB, and 6 hours later VmSize reaches 20MB.  Size of key_index.dat grows from 70kB to 380kb.
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #38 on: November 15, 2009, 09:21:30 PM »

You will be having trouble running KAD with 32MB. That's a fact.

Try the SVN version with the mmap configure option - it has a bunch of optimizations for low memory platforms.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

p.r.

  • Jr. Member
  • **
  • Karma: 0
  • Offline Offline
  • Posts: 50
Re: 9649 mem leak?
« Reply #39 on: November 15, 2009, 10:06:59 PM »

Stu Redman
aMuled SVN with  mmap enabled  don't reduce or limit VmSize.
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #40 on: November 16, 2009, 10:39:39 PM »

Well, at least it should cut some peaks, like at hashing.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

gav616

  • Guest
Re: 9649 mem leak?
« Reply #41 on: November 27, 2009, 07:40:04 PM »

This is definitely fixed for me with 'mmap'.

wxgtk 2.8.10
Code: [Select]
  --with-gtk=2 --enable-gui --enable-graphics_ctx --enable-unicode \
  --disable-all-features --without-odbc --without-expat --without-libmspack --without-sdl

amule-svn
Code: [Select]
--disable-monolithic \
--enable-amule-daemon \
--disable-amulecmd \
--disable-webserver \
--enable-amule-gui \
--disable-cas \
--disable-wxcas \
--disable-ed2k \
--disable-alc \
--disable-alcc \
--disable-upnp \
--disable-xas \
--enable-geoip \
--enable-mmap \
--disable-nls \
--disable-debug

obviously this for a minimal remote gui setup only, but still, its fixed.
Logged

Stu Redman

  • Administrator
  • Hero Member
  • *****
  • Karma: 214
  • Offline Offline
  • Posts: 3739
  • Engines screaming
Re: 9649 mem leak?
« Reply #42 on: December 08, 2009, 10:32:21 PM »

Ha, just checked my "productive" environment. Windows had increased the swap file. aMule was at 140MB memory, 60001 entries in the keyword index (13.8MB saved), 46939 from 129.47.136.*  >:(
That's 129.47.136.215     US     United States     CA     California     Simi Valley     93063     34.3021     -118.7208     Whittaker Corporation     Whittaker Corporation  ???

Kry, any news? I'm starting to think a hard coded Kad firewall of that IP range would not be such a bad idea.
Logged
The image of mother goddess, lying dormant in the eyes of the dead, the sheaf of the corn is broken, end the harvest, throw the dead on the pyre -- Iron Maiden, Isle of Avalon

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
Re: 9649 mem leak?
« Reply #43 on: December 09, 2009, 12:25:13 AM »

Look into a way to solve the problem, not workaround it. Check what can we see that would help detect it behaviouraly and feel free to talk about it in less public places.

In case whoever is doing that is reading this: Poisoning a distribution network is not the way to fight anything, no matter what your reasons are. You are intentionally disrupting a networking service intentionally, and that's very morally, if not legally, wrong. I'm all for fighting for law compliance with the respective's country law, but you're disrupting a content delivery service that hosts plenty of legal files, and most of them outside your country.
Logged
Pages: 1 2 [3]