aMule Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

We're back! (IN POG FORM)

Pages: 1 [2]

Author Topic: amuleweb searchs  (Read 8803 times)

phoenix

  • Evil respawning bird from aMule Dev Team
  • Developer
  • Hero Member
  • *****
  • Karma: 44
  • Offline Offline
  • Posts: 2503
  • The last shadow you'll ever see
Re: amuleweb searchs
« Reply #15 on: February 23, 2005, 01:28:09 PM »

tsark,

Please state your problem clearly now, I can't understand it from the previous messages. Tell me exactly what is happening.
Logged

tsark

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
problem description(s)
« Reply #16 on: February 24, 2005, 09:11:44 PM »

I've been lookng kind of carefully at this for a few days. Here's a summary of what I've seen so far. Note that I start with a blank slate, no existing .aMule dir.

*) Periodically (no pattern I can see yet) there is nothing visible in the log or debug log (via the web).  "WARNING: logfile is empty. Something wrong" Sometimes when you start it up it works, other times not... More often not. When it does work the last line often truncates in the middle, often with a garbage character. Buffer problem? (100% repeatable)

*) Settings in preferences (number of connections) appear to be ignored, or at least not saved. I adjust things by hand via .eMule. (100% repeatable)

*) server.met downloaded via the web interface seems not to work. When amuled starts up and I connect via amuleweb, I see a correct-looking list of servers, but status is "now connecting" and it never connects. stdout indicates repeated attempts to connect to "0.0.0.0 : 0". Very quickly if I click around, the web interface will stop responding. Once it's wedged, amuleweb starts spitting out socket errors. (recreated this twice)

*) If I rm the server.met file, everything is stable but with no servers. If I hand-enter a single server, everything works more or less OK for a while, which is what I've been doing. But very quickly a server appears in the server list: "0.0.0.0 : 0"; you can remove it but it always comes right back. (100% repeatable)

*) Eventually after 10-30 hours I'll check the web interface and see that dreaded "Now connecting" message. It never goes away. The web interface will be slow at that point and will eventually stop responding. (This has happened twice)

*) Weirdest thing of all. After running for some number of hours, I run top on the box, and see a load average of 3.0-5.0 and 75% user CPU, 25% sys. Meanwhile no processes actually in the list are showing up as taking any CPU time! By the summary the box looks swamped, but by the process list it looks idle! Crazy. Occasionally amuled blinks up to the top and the most it ever appears to use is 5% CPU. Meanwhile the system is brutally sluggish and obviously struggling.  

That's crazy, watching linux bog down while not indicating what process is doing it, seeing the two stats disagree with each other. Never seen that before. Sure enough, on a hunch I kill amuled and instantly everything is normal again. (happened twice)
« Last Edit: February 24, 2005, 09:20:03 PM by tsark »
Logged

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
RE: problem description(s)
« Reply #17 on: February 24, 2005, 10:05:53 PM »

Quote
Originally posted by tsark

*) server.met downloaded via the web interface seems not to work. When amuled starts up and I connect via amuleweb, I see a correct-looking list of servers, but status is "now connecting" and it never connects. stdout indicates repeated attempts to connect to "0.0.0.0 : 0". Very quickly if I click around, the web interface will stop responding. Once it's wedged, amuleweb starts spitting out socket errors. (recreated this twice)

*) If I rm the server.met file, everything is stable but with no servers. If I hand-enter a single server, everything works more or less OK for a while, which is what I've been doing. But very quickly a server appears in the server list: "0.0.0.0 : 0"; you can remove it but it always comes right back. (100% repeatable)

*) Eventually after 10-30 hours I'll check the web interface and see that dreaded "Now connecting" message. It never goes away. The web interface will be slow at that point and will eventually stop responding. (This has happened twice)


This is solved on current CVS. New tarball will follow soon.


Quote
Originally posted by tsark
*) Periodically (no pattern I can see yet) there is nothing visible in the log or debug log (via the web).  "WARNING: logfile is empty. Something wrong" Sometimes when you start it up it works, other times not... More often not. When it does work the last line often truncates in the middle, often with a garbage character. Buffer problem? (100% repeatable)

This seems to come from unicode issues. Will look at it later.

Quote
Originally posted by tsark
*) Settings in preferences (number of connections) appear to be ignored, or at least not saved. I adjust things by hand via .eMule. (100% repeatable)


Bad thing. I'll check it also.

Quote
Originally posted by tsark
*) Weirdest thing of all. After running for some number of hours, I run top on the box, and see a load average of 3.0-5.0 and 75% user CPU, 25% sys. Meanwhile no processes actually in the list are showing up as taking any CPU time! By the summary the box looks swamped, but by the process list it looks idle! Crazy. Occasionally amuled blinks up to the top and the most it ever appears to use is 5% CPU. Meanwhile the system is brutally sluggish and obviously struggling.  

That's crazy, watching linux bog down while not indicating what process is doing it, seeing the two stats disagree with each other. Never seen that before. Sure enough, on a hunch I kill amuled and instantly everything is normal again. (happened twice)

Probably a threads issue. tried ps to see amuled threads?
Logged

tsark

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
RE: problem description(s)
« Reply #18 on: February 24, 2005, 11:31:05 PM »

Wow, you guys are fast!  :baby:

I just now read about ps's ability to give thread info, after you mentioned it. Next time it happens I will use it and see what it looks like.

Strange, I would have thought a process' threads' CPU time would be counted towards the process, but who knows what's going on there really.

I will do another build from CVS soon, at latest over the weekend...
Logged

tsark

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
RE: problem description(s)
« Reply #19 on: February 28, 2005, 04:00:38 PM »

Latest progress:

*) Server connection issues appear resolved. After 4+ days of testing, I haven't seen the dreaded "0.0.0.0 : 0" reappear once.

*) I am still seeing amuled pegging the CPU at 100%, load averages of 3-5. This looks the same, 75% user 25% sys. On your advice I did ps auww -T and it is indeed one amuled thread doing it. It's unpredictable and difficult to reproduce. It feels like if I let it run for a while it will happen eventually. But once this morning I got it almost immediately, within seconds after starting the daemon.

*) Preferences changes still not saved.

*) Another minor detail, transfer and shared file page controls don't seem to work (i.e. adjusting priorities seems to have no effect, or - once - the opposite effect)
Logged

phoenix

  • Evil respawning bird from aMule Dev Team
  • Developer
  • Hero Member
  • *****
  • Karma: 44
  • Offline Offline
  • Posts: 2503
  • The last shadow you'll ever see
Re: amuleweb searchs
« Reply #20 on: March 01, 2005, 12:19:44 AM »

tsark,

What is the CVS version you are testing? The high cpu usage should have been fixed in the 20050221 tarball. Please, report if this behaviour persists and do post a backtrace if possible.

Thanks!
Logged

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
RE: problem description(s)
« Reply #21 on: March 01, 2005, 02:05:07 AM »

Quote
Originally posted by tsark
Latest progress:

*) Server connection issues appear resolved. After 4+ days of testing, I haven't seen the dreaded "0.0.0.0 : 0" reappear once.

Good to know

Quote
Originally posted by tsark
*) I am still seeing amuled pegging the CPU at 100%, load averages of 3-5. This looks the same, 75% user 25% sys. On your advice I did ps auww -T and it is indeed one amuled thread doing it. It's unpredictable and difficult to reproduce. It feels like if I let it run for a while it will happen eventually. But once this morning I got it almost immediately, within seconds after starting the daemon.

Will be nice to know what'a happening there, indeed.

Quote
Originally posted by tsark

*) Preferences changes still not saved.

Fixed now.

Quote
Originally posted by tsark

*) Another minor detail, transfer and shared file page controls don't seem to work (i.e. adjusting priorities seems to have no effect, or - once - the opposite effect)

Hum, GonoszTopi, lfroen, please?
Logged

GonoszTopi

  • The current man in charge of most things.
  • Administrator
  • Hero Member
  • *****
  • Karma: 169
  • Offline Offline
  • Posts: 2685
Re: amuleweb searchs
« Reply #22 on: March 01, 2005, 10:29:30 AM »

Quote
Quote
Originally posted by tsark

*) Another minor detail, transfer and shared file page controls don't seem to work (i.e. adjusting priorities seems to have no effect, or - once - the opposite effect)
Hum, GonoszTopi, lfroen, please?
 
Will have a look.
Logged
concordia cum veritate

GonoszTopi

  • The current man in charge of most things.
  • Administrator
  • Hero Member
  • *****
  • Karma: 169
  • Offline Offline
  • Posts: 2685
Re: amuleweb searchs
« Reply #23 on: March 01, 2005, 12:57:31 PM »

Quote
adjusting priorities seems to have no effect, or - once - the opposite effect
I can confirm it did strange things.

Now it is fixed, will be in tomorrow's CVS tarball.
Logged
concordia cum veritate

tsark

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
Re: amuleweb searchs
« Reply #24 on: March 03, 2005, 03:54:11 PM »

Quote
Originally posted by phoenix
tsark,

What is the CVS version you are testing? The high cpu usage should have been fixed in the 20050221 tarball. Please, report if this behaviour persists and do post a backtrace if possible.

Thanks!

After watching this for several days, I can confirm that amuled still ends up spinning and using up all CPU time eventually. This happens every time it is started. It may take minutes or hours but it appears 100% reliable.

I have been using aMule-cvs-20050225.tar.bz2.

Since this is not a crash, I don't know how I can get you a backtrace.

I suppose you'll want some way of knowing what code is spinning. If there is some way I can turn on more debug logging we can hope that there is a log message inside whatever code is hot, and then it'll show up in the logs. Or if there was a c/c++ code profiling tool we could use that to see where in the code all the time is being spent. Or perhaps there is some way to use GDB... if we could identify the busy thread, break its execution, and look at a stack trace?

Or perhaps the 75% user/25% system thing is a clue. Whatever's running over and over is making a lot of system calls. I could try running amuled in strace but man, I don't know if my disk is big enough to fit everything until the problem starts.
Logged

phoenix

  • Evil respawning bird from aMule Dev Team
  • Developer
  • Hero Member
  • *****
  • Karma: 44
  • Offline Offline
  • Posts: 2503
  • The last shadow you'll ever see
Re: amuleweb searchs
« Reply #25 on: March 03, 2005, 06:34:45 PM »

tsark,

Yes, you can run it inside gdb. It should be easy, just read these:
http://www.amule.org/wiki/index.php/Using_gdb_and_valgrind
http://www.amule.org/wiki/index.php/Backtraces
Logged

tsark

  • Approved Newbie
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 9
Re: amuleweb searchs
« Reply #26 on: March 03, 2005, 11:29:17 PM »

Quote
Originally posted by phoenix
tsark,

Yes, you can run it inside gdb. It should be easy, just read these:
http://www.amule.org/wiki/index.php/Using_gdb_and_valgrind
http://www.amule.org/wiki/index.php/Backtraces

Running it inside gdb I can do. Figuring out how to tell you anything useful from that I'm not so sure about.

I'm doing all Java development lately and my unix C is rusty. I have used gdb but not valgrind. Can valgrind somehow magically break execution in the problem area?
Logged

Kry

  • Ex-developer
  • Retired admin
  • Hero Member
  • *****
  • Karma: -665
  • Offline Offline
  • Posts: 5795
Re: amuleweb searchs
« Reply #27 on: March 03, 2005, 11:48:11 PM »

no, but you can break amued when you see that happen on gdb, list threads, and change to the needed one, then step inside to see what's repeating.
Logged
Pages: 1 [2]