aMule Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

We're back! (IN POG FORM)

Author Topic: Major slowdown with many concurrent downloads (1.2.4)  (Read 3204 times)

diesel

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
Major slowdown with many concurrent downloads (1.2.4)
« on: February 06, 2004, 01:20:23 AM »

Hi

I experienced a major slowdown when adding many (=474) downloads via `ed2k`. I'll explain in detail:

I used my script web-spid0r to parse edokus.de and add all ed2k links. Well, that works but the aMule GUI slows down and sometimes freezes for several seconds. Same behavior after amule restart.

Software:
Im using SuSE 9 with all the rpms listed on the front page (version 1.2.4). I expirienced the same problems with an up-to-date gentoo system.

Hardware:
3 Ghz Intel, 512Mb Ram, 4x 160Gb SATA on Highpoint RAID using XFS (non root mount).

Some info:
The command >> strace -p `ps -C amule -o pid= | sort | line` <<  shows strange behavior related to the _llseek system call (up to 50k calls per second). Also the stat functions get called bit to often... but well, i dont know the aMule code very good... Or maybe an XFS problem? (temp folder size is 12Mb after adding 474 files because the 0-feature of XFS)

Some ideas:
Do you guys ever thought about splitting the GUI code from the core? Otherwise a slow GUI can slow or even skip the down and upload for an entire time slice (thats whats happening in my case).
Do you guys ever thought about supporting the epoll feature of 2.6.0? This would solve the big "poll+many fds"-problem. For BSD would kqueue be the way to go. But just some ideas...

greetings
diesel
Logged

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
Re: Major slowdown with many concurrent downloads (1.2.4)
« Reply #1 on: February 06, 2004, 06:44:52 AM »

core/gui split. old stuff, hard to do, timeline in long time (or never?)

epoll: how? more info?

I have not that much stat and lseek, so I guess is XFS - related? an user downloaded ~ 530 ebooks yesterday with no slowdown at all.
Logged

diesel

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
Re: Major slowdown with many concurrent downloads (1.2.4)
« Reply #2 on: February 06, 2004, 04:16:25 PM »

core/gui split: why is that so hard to do? its just a lot of work...

epoll: http://bulk.fefe.de/scalable-networking.pdf theres also a german version on fefe.de Few months ago i started to write an iohandler framework for xmule2 supporting poll, epoll and kqueue, but didnt finish

xfs: looks like xfs is the problem, ill try to find a solution.
Logged

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
Re: Major slowdown with many concurrent downloads (1.2.4)
« Reply #3 on: February 06, 2004, 04:22:07 PM »

In fact, core-gui split is *slowly* happening.
Logged