aMule Forum

English => en_Bugs => Topic started by: myth on March 09, 2009, 04:32:36 PM

Title: Strange problem with uploaded data amount, and slots
Post by: myth on March 09, 2009, 04:32:36 PM
Hi there!

...i'm back to linux...(i give another try)

...and so also on aMule :D

But i have some problems...i use usually latest SVN compiled here on Ubuntu 8.04 (hardy) 2.6.24.23-generic (32 bit)...

..the thing is as follows...i downloaded the file yesterday...and my max. upload is about 35 KiB/s....it would be nice if I could upload 17 Gib!!!

...but there seems to be an error, because when I just start aMule, i see the MiB's grow up very fast...impossible...
...and then...clients i get in upload take only about 1-5 KiB/s and get kicked after some seconds....except of mldonkey users....they stay in my upload for about 1 hour...finishing a chunk...

...download is just normal...
...and i testet also the upload speed on an ftp server...getting my full 42 KiB/s!

Look the screenshots....they are taken in distance of some seconds! And i have only this file in share!

(http://img83.imageshack.us/img83/941/screenshotv.png)
(http://img217.imageshack.us/img217/5880/screenshot1n.png)




Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on March 09, 2009, 08:32:21 PM
Sry for sad *bump*...but i need it!!!

...maybe some f*cked up library?! Or what could this be??!

...and part files seems to not be even shared... :/
Title: Re: Strange problem with uploaded data amount, and slots
Post by: skolnick on March 10, 2009, 01:51:59 AM
Are you sure the file is legitimate? I mean: Are you sure it's not a fake file whose contents will compress a lot and that way you upload lots of information in a very short time?

Regards.
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on March 10, 2009, 06:13:42 AM
Yes, I am!

...the strange thing are also the MB's in shared files windows growing up very fastly...and the upload only being used at about 3/6 KB...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on March 10, 2009, 04:09:53 PM
Still nobody?

...i need my Mule!! :D


EDIT:

Now i installed also wxgtk2.6-dev (next to 2.8), compiled and installed aMule release rev. 9500 and everything is fine... :P :)
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on March 12, 2009, 03:40:46 PM
Hi there...the problems are still there if i use the trunk archive to build aMule...with release_x_x the problems don't exist...

In debugLog i have many things like these:
Code: [Select]
2009-03-12 15:31:15: BaseClient.cpp(1390): ED2k Client: --- Disconnected client "Client http://emule-project.net on IP:Port 87.185.112.***:4662 using eMule v0.49c "; Reason was Client 'http://emule-project.net' (IP:87.185.112.***)  caused a wxSOCKET_LOST event.

and

2009-03-12 15:31:16: BaseClient.cpp(1386): ED2k Client: --- Deleted client "Client http://emule-project.net on IP:Port 79.18.198.***:22389 using eMule v0.49c "; Reason was Timeout

...and they don't get in upload....
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Kry on March 12, 2009, 07:58:46 PM
Maybe because you're banning them (http://www.amule.org/amule/index.php?topic=16477.msg88447#msg88447)?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on March 12, 2009, 08:59:44 PM
Nono...it isn't for this!

I tried also without my bad antileecher code ;)

Idk what it could be....what is the essential difference between trunk and release_x_x ?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on March 12, 2009, 09:21:31 PM
what is the essential difference between trunk and release_x_x ?
Look in docs/Changelog .
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 03, 2009, 03:51:15 PM
Hi

now on ubuntu 9.04 the problem persists...

Any idea? I just took the original tarball, did
./configure --enable-optimize --disable-debug --enable-geoip
make
sudo make install


Until here all fine...but i still upload with this strange problem... :/

EDIT:

Now i know where the problem comes from!
The file i had in share was there since i changed from eMule to aMule...now i shared another file, and everything works perfect!

Greets
MyTh
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 04, 2009, 08:39:13 PM
And no...the problem seems to not be resolved..

..i'm downloading some files, have yet downloaded about 10 chunks of 1 file, i can see it in shared files, but it doesn't seem to be published...

No requests...but there are clients needing the chunks i have completed...!
Title: Re: Strange problem with uploaded data amount, and slots
Post by: wuischke on May 04, 2009, 08:42:21 PM
In 2.2.4 there's a bug affecting the sharing of the last part of a file. Maybe that's the problem, here's the patch (by Stu):

Code: [Select]
Modified: branches/RELEASE-2_2_X/src/UploadClient.cpp
===================================================================
--- branches/RELEASE-2_2_X/src/UploadClient.cpp 2009-04-19 18:24:43 UTC (rev 9575)
+++ branches/RELEASE-2_2_X/src/UploadClient.cpp 2009-04-20 22:29:20 UTC (rev 9576)
@@ -247,7 +247,9 @@
                       }

                       uint64 togo;
-                       if (currentblock->EndOffset >= srcfile->GetFileSize()) {
+                       // THIS EndOffset points BEHIND the last byte requested
+                       // (other than the offsets used in the PartFile code)
+                       if (currentblock->EndOffset > srcfile->GetFileSize()) {
                               throw wxString(wxT("Asked for data beyond end of file"));
                       } else if (currentblock->StartOffset > currentblock->EndOffset) {
                               throw wxString(wxT("Asked for invalid block (start > end)"));
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 04, 2009, 09:10:23 PM
Hmm...i'm running SVN 9585...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 04, 2009, 10:58:29 PM
Plain or with your client-banning patches?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 04, 2009, 11:18:58 PM
LOL...plain! ;)

Tomorrow i'll do a build with debug and read the log, ok?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 04, 2009, 11:29:11 PM
Just wanted to make sure.  :)
The bug in 2.2.4 only affects the last piece of the last chunk. Clients should still connect, but get rejected when they try to download this. If it doesn't upload at all that's something different.

What wx version ? (No, 2.6 won't be supported.)
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 05, 2009, 02:48:12 PM
wx is 2.8...

Later i'll do a debug build...

Here the details of an client...i see them on the client list...but not on queue...

(http://thumbnails11.imagebam.com/3482/f7190834814673.gif) (http://www.imagebam.com/image/f7190834814673)

I know also from some friends, that my amule sends corrupted data... :/

And in Log (vorbose) i have too much of these:
Code: [Select]
2009-05-05 17:21:04: BaseClient.cpp(1346): ED2k Client: --- Disconnected client "Client maultier-power|[TBRG]|RSVCD-Forum|goldesel.6x.to on IP:Port 87.158.238.***:40507 using eMule v0.49c "; Reason was Timeout

And also some
Code: [Select]
wxSOCKET_LOST event...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 05, 2009, 11:15:20 PM
Now i compiled SVN Tarball 9500 and all works...

...any change regarding this since 9500?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 06, 2009, 01:13:16 PM
Doh, i have the bug with the last chunk...gonne take a newer and test!
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 06, 2009, 02:22:54 PM
I've put on SVN 9585...and last chunk of my release isn't shared :/

In log i see a dude, which i gave FU...

Code: [Select]
2009-05-06 14:13:53: ClientTCPSocket.cpp(665): ED2k Client: *********: Upload session ended due canceled transfer.
But he didn't finish the last chunk...

In shared files i see so:

(http://thumbnails12.imagebam.com/3492/3fcf5234911572.gif) (http://www.imagebam.com/image/3fcf5234911572)

Edit1: The last chunk has 6.65 MB, and only 6.33 MB get transferred...and my friend says he get's the AICH recover logline...

Edit2: I also checked the avi file for errors with ffmpeg...no errors!

Edit3: I'm really shure it's a Bug...i just copied the file to my notebook, and setted up emule, and my friend and others get the file immediatly finished...
If i can help solving this bug in any way, tell me!

Edit4(lol, another): The strange: in eMule in shared files i also saw the last chunk in red...maybe it's only this file? But eMule can handle it...maybe some error in accepting block requests?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Kry on May 06, 2009, 06:58:12 PM
Ohboy. Stu?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 06, 2009, 09:34:21 PM
What means ohboy?

..btw...i speak also german and italian, if someone wants to write me in other languages ;)
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 06, 2009, 11:37:23 PM
Ohboy. Stu?
You get my cojones crawling.  :o

Well, for testing 9576 I set up a transfer between two machines and transfered a short file. With 9575 it failed, with 9576 it worked.

Myth, please
- rebuild 9585 (or anything else >= 9576) in debug mode from a clean source directory
- activate Debugging for "ED2K CLient" (third entry). Yeah, it generates a lot of messages.
- see if you get a message
Code: [Select]
AddDebugLogLineM(false, logClient, wxT("Client '") + GetUserName() + wxT("' caused error while creating packet (") + error + wxT(") - disconnecting client"));

Oh- I see you already had the logging activated, or you would not have got that message. Do you still have the log ? Is there a meesage like above before the message you quoted?
Your log message means you got a OP_CANCELTRANSFER request from the other client. I don't think that can even happen if he had got disconnected.
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 07, 2009, 03:47:42 PM
Well, yesterday i downloaded 9592, clean source, compiled with ./configure --enable-optimize --enable-geoip

And aMule sometimes work with no upload...i send you the log in a PM, because there are lots of IP's...

For the strange thing with the file and the last chunk: i'll release another new file this evening, and i'll se what happens!
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 07, 2009, 09:46:42 PM
Please rebuild first using this file. I have extended (and fixed) a bunch of debug messages (in 9596, but that's probably not up yet).

Nobody has looked at these messages for some time (since addition of large file support  :-X)
Code: [Select]
2009-05-07 15:03:39: UploadClient.cpp(900): ED2k Client: Client requests 0 File block 285798400-0 (285982720 bytes): 89.16.*.*
2009-05-07 15:03:39: UploadClient.cpp(900): ED2k Client: Client requests 1 File block 285982720-0 (286167040 bytes): 89.16.*.*

There are no throws about my change, however there are lots of
Code: [Select]
2009-05-07 14:06:05: UploadClient.cpp(316): ED2k Client: Client 'http://emule-project.net' caused error while creating packet (Asked for incomplete block ) - disconnecting client
which I don't understand.
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 07, 2009, 10:36:03 PM
Ok, i'll try!

Thank you!

EDIT: I have 2 only clients in upload, queue empty...and from the 2 clients i see always in log:
Code: [Select]
2009-05-07 23:04:52: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:52: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:54: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 0 File block 377958400-378142720 (184320 bytes):
2009-05-07 23:04:54: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:54: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:54: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 0 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:54: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:54: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378511360-378695680 (184320 bytes):
2009-05-07 23:04:55: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 0 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:55: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:55: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378511360-378695680 (184320 bytes):
2009-05-07 23:04:56: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 0 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:56: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:56: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378511360-378695680 (184320 bytes):
2009-05-07 23:04:57: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 0 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:57: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:57: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378511360-378695680 (184320 bytes):
2009-05-07 23:04:58: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 0 File block 378142720-378327040 (184320 bytes):
2009-05-07 23:04:58: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 1 File block 378327040-378511360 (184320 bytes):
2009-05-07 23:04:58: UploadClient.cpp(909): ED2k Client: Client 84.61.26.*** requests 2 File block 378511360-378695680 (184320 bytes):

...I must say, this user is using rapcom mod...a really bad mod...maybe for this he's asking like a devil...

But it don't explain why the queue is empty...i see from downloading files a lot of users which i could give data...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 08, 2009, 04:46:39 PM
Now aMule uploads only defect / broken parts...  ???

EDIT: I saw i had also 2.6 wx installed...i uninstalled it..but in log the same...now i try if amule still uploads broken chunks..

EDIT2: Same thing...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 08, 2009, 06:41:14 PM
Myth, do you have any hint that there's still a problem wuth sharing the last part?
How do you know you're uploading broken parts?
Are you uploading a complete file or a file you are downloading?
Can you send me logfiles?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 08, 2009, 06:57:43 PM
For the last chunk...idk...i only upload trash...

I know i'm uploading broken parts because i've uploaded 3 GB of a 350 MB file...and not 1 complete source..and a friend of mine saw it in his emule-log...

This file is a complete file...(avi)...

For log files: i send you some in a few min's...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 08, 2009, 09:40:21 PM
Update: just downloaded the last Part of an UL from Myth, so no problem there. Phew...   :-*
Part was corrupt however. We are trying to figure out what the problem might be.
And the corruption blackbox is not doing what it should either.  :(
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 09, 2009, 12:32:47 AM
And also some
Code: [Select]
wxSOCKET_LOST event...

I think that's ordinary behaviour.

Code: [Select]
switch(event.GetSocketEvent()) {
case wxSOCKET_LOST:
socket->OnError(0xFEFF /* SOCKET_LOST is not an error */);
break;
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 09, 2009, 06:45:38 PM
Now i've tested also festor's build from synaptic, my own, with stu's fix...

...but nothing...it always sends corrupt data :/
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Festor on May 09, 2009, 08:17:20 PM
Now i've tested also festor's build from synaptic, my own, with stu's fix...

Try again, I uploaded 9596 svn build
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 10, 2009, 01:07:48 AM
No change... :/

Maybe my Ubuntu is fucked up?

I ran cryptest v and it sayed no error...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Kry on May 10, 2009, 03:20:52 AM
Did you check the filesystem and your RAM?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 10, 2009, 11:48:29 AM
I just checked the FS...now i gonna try...

...checking ram...hmm...the ram should be ok...but next time i restart i can check it, too...

EDIT: Hmmm...now i have another time the problem with amount of uploaded data...i see 210 MB, but i uploaded 400 KB... :P
I think there's something in the system...

EDIT2: ifconfig output, if it helps...
Code: [Select]
eth0      Link encap:Ethernet  HWaddr 00:17:31:8d:65:fc 
          inet addr:192.168.0.15  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::217:31ff:fe8d:65fc/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:6039078 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4607550 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1720526637 (1.7 GB)  TX bytes:3006893310 (3.0 GB)
          Interrupt:19

But all other traffic works without an error....also FTP transfers.,..
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 10, 2009, 09:46:13 PM
Now really all works!

Stu Redman, you are my hero!

Danke!

Maybe you should explain what it was...
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 10, 2009, 10:53:11 PM
Some hero...  :-[ :-[ :-[

You are the hero here, myth. The only one who used an aMule SVN version since January and actually released something and took care to check if anything useful of it arrived at his downloaders. And kept his teeth right in the issue until truth finally showed its ugly face.

I only restored that one crucial line of code in 9600 that I accidentally dropped in 9377.  :-[ :-[ :-[

There are still some loose ends left:
Now i compiled SVN Tarball 9500 and all works...
Can't be. At least upload was just as broken in 9500.

...the strange thing are also the MB's in shared files windows growing up very fastly...and the upload only being used at about 3/6 KB...
No idea about that one. Is it working correct now?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 10, 2009, 11:05:45 PM
As i know now it didn't work all with 9500...otherwise i had used this until now ;)

For the other thing...nothing like this until now :)
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Kry on May 11, 2009, 01:42:00 AM
I only restored that one crucial line of code in 9600 that I accidentally dropped in 9377.  :-[ :-[ :-[

(http://i86.photobucket.com/albums/k93/chrishorgen/Funnay/facepalm.jpg)
Title: Re: Strange problem with uploaded data amount, and slots
Post by: GonoszTopi on May 13, 2009, 07:25:41 PM
And the corruption blackbox is not doing what it should either.  :(

What do you mean?
Title: Re: Strange problem with uploaded data amount, and slots
Post by: myth on May 13, 2009, 07:39:51 PM
I think now CBB works...or am i hallucinating? I remember to had read something like this!
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Stu Redman on May 13, 2009, 08:46:26 PM
And the corruption blackbox is not doing what it should either.  :(

What do you mean?
That it reported to have the client banned - and kept happily downloading from him. Well, it had banned him from upload, not from download...
That's already fixed (don't know if eMule's Ban() works different or if it has the same problem).

Anyway, I'm doing a total rewrite of the thing right now. It's inefficient as hell as it is. Should have done that in the first place instead of patiently replacing MFC arrays with STL arrays.  :-[
Title: Re: Strange problem with uploaded data amount, and slots
Post by: Kry on May 13, 2009, 09:33:49 PM
Ban always meant for upload, not for download.