aMule Forum
English => Multiplatform => Mac OSX => Topic started by: dummy00001 on May 11, 2005, 08:09:53 PM
-
Hi!
I'm using Kry's binary for 2.0.0 and experience weird problem.
I've been bringing downloads from mlDonkey - sequence simple: search -> download -> search download -> ... adn so on for 7 files. All downloads have started immeadiately, except two last added ones. I've seen that eMule can sometime postpone search for sources so for some time - limit on new connections is reached or something like that - so new downloads can be stuck for some short time with no sources and no activity.
Well, one day later I have found that those last two downloads are still without sources. Relaunce of aMule have helped - and downloads are actually started.
Yesterday I again searched/added couple of new files to download - and this evening when I came home I have found them still sitting with no sources... Relaunce helped.
It seems to be some serious bug: relaunching aMule is no-no.
-
have you tryed just simple changing server?
but true, its still a bug...
-
Thanks for workaround - I'll try it next time I have problem.
-
I do not see reconnect working :-(
Seven new files sat w/o source for 5 minutes. I have tried (dis+re)connect toether with pausing/resuming downloads in different combinations - it didn't helped.
On relaunch all newly added files got sources - few but still better than no activity... :-(((
-
"few but still better than no activity"
I meant to say this is rare files - so they do not have much sources. not that it has anything to do with aMule.
-
dummy00001, do you have High-ID or Low-ID?
-
High ID.
[Apple iBook + AirPort Extreme Card : 192.168.x.x] -> [LinkSys WRT54G WLAN+Router : Real IP] -> [Motorolla SurfBoard] -> [KabelBW - German cable tv/voip/net provider]
LinkSys has a DMZ setup for my notebook. Mac OS firewall is up with port range for ed2k net open.
Or shorter: both arrows on icon left to server name in status bar are green.
-
[CENSORERD].
Today I have discovered that this bug can hit any new download.
I have search/started yesterday bunch of files (in addition to two quite active and huge downloads). All newly added dls sat with 0 sources for some time. Then I have experimented with server reconnection - to no avail. Then I have relaunched aMule - everything looked Okay. Today I have found that one of the later downloads was half finished and sat w/o sources. [CENSORED]. I have restarted aMule, 7 sources were immediately found and it finished in less than hour. ?(
Today I have search/added two downloads. Both had no sources. Restart - only one of them picks the sources - second still sits with no sources... ;(
Any suggestions?
P.S. I have had strong suspicions that this is global searches which intervene with new download start-up. Could it be the case? I have noticed that two simultaneous global searches seem to not work together - only last one is progressing, while first is sort of aborted.
-
After more observations, I conclude that aMule does never search sources thru server. First time when download added it happens (sometimes), but after that - never.
I have so called "rare download" with 1-3 sources. It always loses sources in about six hours - people disconnect/reboot/whatever. After relaunch - aMule always finds them again- when it is forced to search thru server.
So if source exchange isn't working, download will stuck.
P.S. eMule has a little feature: one of the columns in downloads list, when sources for download are displayed, used to display origin of source: "Source Exchange", "Server", "Kad", etc. aMule doesn't display anything like that - so it is hard to make any conclusion. Hm, I can try to tcpdump on connection to server.
-
Originally posted by dummy00001
LinkSys has a DMZ setup for my notebook. Mac OS firewall is up with port range for ed2k net open.
Hmm. Just to clarify, when you say "port range for ed2k", do you include the UDP ports? There are two: one is at TCP+3, the other is specified in preferences. The TCP+3 one is most important for acquiring sources. See this wiki page (http://www.amule.org/wiki/index.php/FAQ_ed2k#What_does_each_port_do?). When aMule reports "High-ID", it means that the TCP port is open; it doesn't indicate anything about the UDP ports.
I believe that, when you are High-ID, aMule uses UDP to occasionally poll all the servers in your server list for sources. When you are Low-ID, aMule only gets sources over its TCP connection to the server. I don't know what happens when you are High-ID but your UDP port is blocked by a firewall. It may result in what you are seeing. In other words, it may assume that the UDP port is open and try to use that to query servers for sources, but since it's blocked you don't get any responses.
I don't know enough about routers to know if the DMZ implies port forwarding, but if not you have to forward the UDP ports to your notebook as well as opening them in your firewall.
I am behind a firewall that I don't control, so I'm Low-ID. Of course, that means I only ever acquire sources from my server and from other clients. Nevertheless, I don't see a problem like you are seeing. I do have to connect to a server that has sources for the files I download, but I will eventually get those sources even for newly added downloads.
-
My normal practice is to use "random range" - I just prepend standard ip addresses with single digit. So on my firewall currently I have open 4660-4669,24660-24669,54660-54669 and I use 2466* range right now.
I see in "tcpdump host {server}" both UDP and TCP packets - something is going on between aMule and server, but I'm no protocol guru to tell what. and I do not have ethereal here at moment installed - I believe etheral can decode most of the ed2k protocol.
P.S. Most interesting I have option "save 5 sources on rare downloads" activated... It seems to not work at all. Does it have higher rank than check to drop "queue full" sources? -I have that activated too (helps very popular downloads).
-
After an hour with Ethereal, I see that my rare download doesn't receive any sources from server I'm connected to.
I pretty sure that eMule doesn't have this problem, so I can only guess that after failure to get any sources from current server, eMule starts global search for sources for this particular file.
The problem with rare file is you can never be sure that any source are present at all. All I can see that there is no sources retrieved from current server, and aMule in this case didn't started global search. I have tried several popular servers - RazorBack, eDonkeyServer & Devil Bytes - to no avail.
When I perform manually global search - it gives me 2 sources - but they never gets picked up by aMule from manual search... ;(
-
hi dummy00001,
in parts i experience it as you, though a little better, maybe.
i'm on some rare files too, and i can tell, it's a pain in the a**.
but i still blame the rare downloads more on the rare sources.
'save 5 sources on rare files' seems to work for me. at least those files are most times the first to get sources after starting amule.
getting first sources for new files actually can take very long, 10 minutes or longer. and it seems to me that amule only gets sources for one file, then sits around for another 10 minutes until it asks for sources for the next file.
It seems that this is the same for more sources from other peers (dl'ing or ul'ing). And it seems that peers i am ul'ing to are not considered potential sources for data and sources for other sources at all. :-(
getting first sources for a file which is not present on the currently connected server does not work. i do not assume that it's expected to work. amule would have to connect to random other servers for that.
but at least it could querry all sources it already had found in a 'global search'.
a suggestion: try to compare your sources against Razorback 2's stats for this file.
connect to different servers which show sources for your files according to razorback 2's stats.
... m2kio !
-
m2kio:
getting first sources for new files actually can take very long, 10 minutes or longer. and it seems to me that amule only gets sources for one file, then sits around for another 10 minutes until it asks for sources for the next file.
I found this out after I have found that half newly added downloads after about _*20hours*_ were still sitting without sources. Relaunch - and every got 50-70 sources.
As I stated by first post in thread I know from my eMule experience that it could take time - I have seen situations when it took about half of an hour to get first sources by eMule. But nothing like a whole day...
m2kio:
in parts i experience it as you, though a little better, maybe.
i'm on some rare files too, and i can tell, it's a pain in the a**.
but i still blame the rare downloads more on the rare sources.
'save 5 sources on rare files' seems to work for me. at least those files are most times the first to get sources after starting amule.
I have had small rare download (0.75MB text file). I didn't wanted to relaunch aMule since I knew it was rare file and I didn't wanted to interrupt couple other downloads. Then after some time I had to restart my machine and relaunch aMule, the same server was picked up - and wonders - rare download got N sources and was finished even before I came across transfers tab. Miracles.
Rare downloads w/o sources vs. first downloads w/o first sources are different issues. But they combination is just killing me.
m2kio:
connect to different servers which show sources for your files according to razorback 2's stats.
I'll try that, thanks for idea.
P.S. Rare Files topic. "Get Sources" eDonkey client request to server - is it incremental? it doesn't seem like server sending all sources it does know about every time. Then it could be that server thinks that we have N sources and doesn't send them. but aMule already lost (or dropped) sources server had send us before - so we are stuck.
-
The questions I still have:
[list=1]- When you opened the ports in your firewall, are you sure you opened them for UDP as well as TCP?
- Is your LinkSys performing Network Address Translation? Is it forwarding the UDP ports as well as the TCP ports to the iBook?
- Using Ethereal, have you been able to see any UDP ed2k traffic from your iBook to any of the servers other than the one to which you are connected? Have you seen any responses from those servers back to your iBook?
[/list=1]
Thanks for your efforts in tracking this down. :)
-
When you opened the ports in your firewall, are you sure you opened them for UDP as well as TCP?
Yes. Actually Mac OS X doesn't provide an option to open only TCP or UDP. It always opens both TCP and UDP ports for any given range.
Is your LinkSys performing Network Address Translation? Is it forwarding the UDP ports as well as the TCP ports to the iBook?
Yes. I have DMZ, so everything sent to router - and not prohibited by router's firewall - is automatically redirected to my iBook. (Prohibited is only SMB/CIFS/NetBIOS - I have had Windoz clients connected to router some time ago). And vice versa, everything originating from my IP to Internet address is sent over inet interface.
Using Ethereal, have you been able to see any UDP ed2k traffic from your iBook to any of the servers other than the one to which you are connected? Have you seen any responses from those servers back to your iBook?
From a sample of 10k packets (4+ minutes of capture), I got about 180 UDP packets.
Split is about 50/50: half of them seems to be p2p communication ("emule extension reask file ping" as ethereal identify them) and half for server status request/status (plus server info responses). IPs are all different. I assume that that this is to/from different servers.
So yes, I'm seeing responses from other clients/servers.
Shall I make longer traces? - I believe aMule has five minute delay between searches. I understood your question more as a question do I really have High ID.
P.S. I'm finished with rare files for now. I have only left in queue quite popular ones. Does it make any difference?
-
OK, thanks for all those answers. I'm sure I was just being dense in not understanding your previous answers (e.g. not fully understanding what DMZ implies), so I appreciate your very clear answers here. :)
Unfortunately, we haven't found any explanation for why you were having such a hard time with your rare files before. Of course, ideally we would like to identify and eliminate such problems. On the other hand, if you're no longer experiencing them, then there's no point in troubling you further. Thanks, anyway.
-
It seems that problem has cured by connecting from server with 10k users to one with 100k (RazorBack2).
Well, at least I hope it is cured. In my latest experiments I have seen no problems - but recently I was downloading relatively popular files.
As soon as I will find some files which will turn out to be rare - watch me whining on forums again ;)
P.S. Is Kad support planned? if yes when? is there any aMule betas with Kad?
-
Hm. Having said that, I hope that better solution can be found - network-wise.
If performance of download depends so much on server we are connected to, then network would split, if the big servers will go off line.
That's why asked about Kademlia - server-less network.
-
Originally posted by dummy00001
P.S. Is Kad support planned? if yes when? is there any aMule betas with Kad?
Yes. "Soon". Not yet. :)
-
Seems I'm getting closer to the problem.
Server, replying to GetSources, never sends A4AF sources: same source will never be listed twice in reply. This was my observation. And it happens that I'm downloading lots of rare files which are hosted by few peoples. Say, 5 files by 5 people. aMule sends jumbo request for sources for 5 files and receives only 5 sources, but server associates them only to one of the files. So one file gets five sources, other four files sits in red without sources.
I have just added five new downloads: BBC's Radio 3 put out Beethoven's symphonies for free download, but only over unrestartable HTTP. I guessed that it wouldn't take long for files to appear on eDonkey network and yes here they are. I have found them by name and added them: only got sources for one file - about 80 - and it was downloaded in one hour or so. Others remained in red. After first one was finished, another download got again almost all of the 80 sources. Few sources get dispersed to remaining three files.
Such behavior (observed in many other similar situations) seems to be some sort of confirmation for my theory.
Is it possible to activate some sort of randomization for GetSources request sent to server? Or ask sources about the possibility that they have some other files I'm interested in?
Anyway, I'd rather have files with bulk of A4AF sources and no progress rather than file with no sources at all and no progress.
-
I think it is by design that the server only provides a given source once. In theory, source sharing with those sources will reveal that they are sources for your other files, too. Do you have the extended eMule protocol UDP port enabled?
Also, what are your source dropping settings?
-
High ID.
UDP is enabled.
Source dropping is disabled.