aMule Forum
English => aMule Help => Topic started by: errico2 on July 21, 2005, 01:51:05 PM
-
Hi all:
I have working with amuled-2.0.3 without any problem. Usually, I am uploading a lot of traffic to Internet, but I download very few times.
Past week I started to download 5 files about 3.5 Gbytes each one, not all of them at the first time (I started only one, when it finished I started the second and go on). Because these files are very large, it download from a lot of sources at the same time (20-70 sources working).
Well, when I am downloading these files amuled is very unstable. It doesn't work more than 3-5 hours without hang. amulecmd can't connect to amuled (neither amulegui or amuleweb). Only way is kill amuled proccess.
Does anyone know what is happen ?
Regards, errico2.
PD: of course, there is HD avaialable.
-
On which FS is your tmp?
-
ext2fs
-
All is ext2, Linux, /tmp, tmp partition for amule, destination partition....
-
Another time again. It was working for 1 hour. CPU is now 98% idle, HD is available, amulecmd can't connect, there is no connection with another pcs, only this connection:
tcp 70 0 x.x.x.x:35224 195.245.244.243:4661 ESTABLISHED
All other connection are SYN_RECV:
tcp 0 0 x.x.x.x:15870 213.97.33.143:4097 SYN_RECV
tcp 0 0 x.x.x.x:15870 83.33.248.232:4217 SYN_RECV
tcp 0 0 x.x.x.x:15870 83.42.30.66:13340 SYN_RECV
.....
But:
$ ps ax | grep amule
741 ? S 0:00 amuleweb --amule-config-file=/home/xx/.aMule/amule.conf
778 ? S 0:00 amuled
Any idea ?
Regards, errico2.
-
download 5 files about 3.5 Gbytes each one
There's some places in amule's code where filesize is "int". This effectively limits in to 2Gb. IMHO you will have same results with gui amule too. Correct me if I'm wrong
-
lfroen: well wrong I downloaded 4Gb files no problem...but with just aMule, I shoudl try aMuled...
-
There's no 4Gb bug since more than 1 year.
-
Amuled code is ends @ the network level. And it doesn't matter for a socket what kind of files you're down/up loading. I would be very surprized to find a difference
-
Originally posted by Kry
There's no 4Gb bug since more than 1 year.
the bug was about 2Gb but anyways :P
-
I have downloaded a file of 1202274304 bytes (1,2 GB) without problems.
Usually the problems appears with the other files with size about 3,5 GB. I have started to download the last file of 3,5G....
I think it can't be a bug about 'int' usage, because it works sometimes.... and if I try serveral times, the file download 100%. I think that an 'int' bug doesn't work anytime, but.... I don't know amule code....
Regards, errico2.
-
I have seen another problem, perhaps it is ok, but I'm going to explain....
The amule tmp fs has 4 Gbytes. I start to download one file of 3,2 Gb of size. amuled creates a file called 001.part with size 3,2 Gb, but if I do a 'df -h' I see that the tmp fs has 4Gbytes free yet.....
Well, when amuled is downloading the file the free tmp fs is going down... 4G.. 3,9G .... 3,8G ... until 800M. It is ok, 4Gbyes total free - 3,2Gb file size = 800Mbytes.
Then amuled starts to move the file to another filesystem. When it is finished, I can see that the file 001.part doesn't exist, but if I do a 'df -h' I has only 800Mb free.... Eh!! where is the other 3,2Gb....
And it is real, there is only 800Mb free, because if I try to copy a big file to this partition, it crashed due to there is no disk.
If I reboot the Linux, I have got again 4Gb free.....
It's a Red Hat 9, with 2.4.20. Is it a linux problem or amuled problem ?
Regards, errico2.
-
It's a Red Hat 9, with 2.4.20. Is it a linux problem or amuled problem ?
^^^
there is your 2gb file problem...redhat has a lmitation in ext2/3 for 2gb files...
this is even still present in redhat enterprise linux 3.
search a little in google, and you'll find some kernel option for it probably
stefanero
-
And this limitation is the reason of the amuled hang ?
Regards, errico2
-
maybe.....
I just know this because I know some systems with rhel and when you do a wget on a debian dvd for example, it does not work....
so this might be a reason for your problem, since aMule has no probelm with files greater 2gb....
-
But....... ?(
Thinking again, I don't think RH9+ext2 has a 2Gb limitation. Now I have 2 files of 3,2Gb, that amuled could move from tmp filesystem to destination; I can move these files from one directory to another, and I can get them from another box using ftp. If RH9+ext2 had a 2Gb limitation, it shouldn't work.......
Regards, errico2.
-
I'm not sure, but it's possible that connection with amulecmd has any guilt. Amuled has been working for one hour; I start amulecmd (in order to see if it is working) and works perfect; exit from amulecmd, and 1 minute after I start amulecmd again: now it doesn't work.
Fortuitousness, perhaps. But it's very strange.
I send a lot of post in order to put more information, to resolve the problem :))
Regards, errico2.
-
Originally posted by errico2
Hi all:
I have working with amuled-2.0.3 without any problem. Usually, I am uploading a lot of traffic to Internet, but I download very few times.
Past week I started to download 5 files about 3.5 Gbytes each one, not all of them at the first time (I started only one, when it finished I started the second and go on). Because these files are very large, it download from a lot of sources at the same time (20-70 sources working).
Well, when I am downloading these files amuled is very unstable. It doesn't work more than 3-5 hours without hang. amulecmd can't connect to amuled (neither amulegui or amuleweb). Only way is kill amuled proccess.
Does anyone know what is happen ?
Regards, errico2.
PD: of course, there is HD avaialable.
hello
i'm experiencing the same problem...
amuled --version: aMule Daemon 2.0.3 using wxGTK1 v2.6.2 (OS: Linux)
this only happens when downloading files that are larger than 2 GB.... amuled crashes after 1 to 3h
if the files are smaller aMuled runs like a dream (has run longer than a week)...
have you found a solution to this problem?
Edit: by the way my incoming and temp folders are on a fat32 partition
-
Sorry dfme, I didn't find any solution. Only once I had to download five files bigger than 2Gb; with this files, amuled was very unstable and hang after 1-6 hours running.
At the end, I could download these files. I have never donwload again files bigger than 2Gb, so.....
In my case, all my partitions was ext2, no fat32, so it is not the problem.
Regards, errico2.
-
i´ve investigated a little further....
at the end of the day i can say that amuled doesn´t crash when downloading files that are bigger than 2gb. moreover it shuts itself down after a random period (usually between 10secs-10h)!
at least this is what the logs are saying....
i´ve looked at all the logs (/home/user/.aMule/logfile) of over 10 sessions and at the end of each log the following lines always appear:
2005-10-10 12:50:10: AICH Thread: Syncronization thread started.
2005-10-10 12:50:11: AICH Thread: Masterhashes of known files have been loaded.
2005-10-10 12:50:11: AICH Thread: No new files found.
2005-10-10 12:50:11: AICH Thread: Terminated.
2005-10-10 12:52:10: Disconnected
this is what i get when running amuled from console (not as background app.)
amuled: OnInit - starting timer
Initialising aMule
Checking if there is an instance already running...
Loading temp files from /mnt/hdb1/amule/temp.
Loading PartFile 1 of 1
All PartFiles Loaded.
ListenSocket: Ok.
*** TCP socket (ECServer) listening on 0.0.0.0:4712
*** Server UDP socket (TCP+3) at 0.0.0.0:4665
*** TCP socket (TCP) listening on 0.0.0.0:4662
*** Client UDP socket (extended eMule) at 0.0.0.0:4672
Adding file /mnt/hdb1/amule/temp/001.part.met to shares
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Compatible client found with ET_COMPATIBLECLIENT of 0x28
Now, exiting main app...
Killing amuleweb instance...
Killed!
aMule shutdown: Terminating core.
Saving PartFile 1 of 1
All PartFiles Saved.
aMule shutdown completed.
the file i´m trying to download is 2.7gb in size...
-
i´ve noticed that when downloading big files the stats show more data was downloaded than completed (jpg in attachment)... any explanations how this can happen?
-
Quite simple: some client transfers corrupted (broken) data to you. Amule accepts it (since it doesn't know the part is corrupted) until it completes a chunk (9.28 MB). Now it hashes the chunk and sees that it is corrupted -> the chunk is discarded, 9.28 MB are transfered, but not completed. (There is the possibility to recover parts of this corrupted chunk with AICH, but that would go too far.)
-
yes i thought it would be corrupted chunks being downloaded...
the thing is i have this with all the files i try to download that are bigger than 2gb... other files (that are smaller) aren't affected as badly especially in this magnitude