Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[Vollstrecker]

While we are on teaching compiling in general, just some points:

Do this before you execute "make". (Oh, "make -j2" is for a dual core processor.)

More correct, it just tells make how many jobs it should start in parallel. I use -j3 on my single-core. -j2 speeds up up compile ~5%, and you get another 2-3% with -j3. On my setup intresstingly -j4 slows it a bit down again, so just try the right params for your setup with "time make -j<x>"

You can even run it without install from the place where you've built it with src/amule, that's probably the easiest way for test versions.

This is not always good. without install, the .mo's are not where amule expects them, so you'll get a not localized version. aMule writes this into his config, and you have to change it back if you run a normal installation. A temporary install-dir is a better choice. If this temp-dir is in your home, you can just do "make -j<x> install" right after your configure call and everything is fine.

@RRM if you try to compile another app, and your in the lucky situation that it contains a debian-dir like aMule, you can just do "grep Build debian/control" and get a list of packages it needs to be installed.

[btkaos]

But why then, do i type: "gdb amule" and "run" to normally run it?

If you run it under gdb you will get a backtrace easily. STU forgot that.

Ah, ok, so to run the 2 other versions,
i need to write in a terminal:

tmp/amule-stu/src/amule
or
tmp/amule-upstream/src/amule

?
But i also found those executables here...
so maybe i need to type this:

/usr/local/stow/amule-opt/bin/amule
or
/usr/local/stow/amule-stu-opt-debug/bin/amule
?

Better always run the versions in /usr/local [as explained by Vollstrecker]

[btkaos]

Umm, summaring the long history of this crash, I got and idea.

Run

Code: [Select]

$ sudo bash -c "ulimit -n 65536; ulimit -n; su -m -c 'ulimit -n; id -nu' \"`id -un`\""
Check that it outputs 65536 two times.
Then run amule using this

Code: [Select]

$ sudo bash -c "ulimit -n 65536; ulimit -n; su -m -c 'ulimit -n; gdb amule' \"`id -un`\""


Rev 9901 still runs smoothly,
shouldnt i wait till it crashes?

Yes of course, wait to see if your current build crashes. I recommend you to push it hard, that is to say, feed the mule some really popular files.

 Yesterday I had a little bit of time and had a deeper look into your low VZS crashes.

It seems you may be running out of file descriptors in the socket code. Keep in mind that in Ubuntu, by default just 1024 connections per user and application are allowed. And the [not so] wonderful gio code crashes in that event. As I noticed you like to run with 2000 max connections this indeed could be the cause.

[btkaos]

Thank you very much for that detailed information!!!
That helped a lot, indeed.

I hope so, good testers like you are not easy to find!

When compiling and installing some software, the default prefix will be /usr/local,
so you once you finish the build you'll get a binary like /usr/local/bin/amule

So, i cannot simply run these executables by using a terminal?
/usr/local/stow/amule-opt/bin/amule
/usr/local/stow/amule-stu-opt-debug/bin/amule

Yes you can, stow just creates a virtual amule pointing to the location you specified.

Now imagine you want to change some build options or the actual source code.
You build aMule again and you get a new /usr/local/bin/amule.

So, the executable file over there (/usr/local/bin/amule) with the arrow
is the actual and only amule executable that i run when typing "amule"?

Yes, when you just type amule [and don't specify the path] Ubuntu searchs several default locations, one of them is /usr/local/bin

Stow allows you to install software in /usr/local/stow/ and select which version should be made the default, that is to say, the one present in /usr/local/bin
This way, using stow you build aMule and set the prefix to install it in /usr/local/stow/amule-myowncoolversion.

You mean:
/usr/local/stow/amule-opt
and
/usr/local/stow/amule-stu-opt-debug
right?

You may use whatever name you like for your builds.

but as this location is not in the default path you may encounter some problems. So you change the current directory to /usr/local/stow and do
$ stow amule-myowncoolversion. Now that version is the default one.

You mean i should change "/usr/local/stow/amule-opt" (or  "/usr/local/stow/amule-stu-opt-debug") into "/usr/local/stow" ?
How do i change that?

Well I'm not sure I understand your question. Once you do make install, you'll have a new aMule in the directory you specified in prefix when calling configure. That directory is not included in the default search for programs, so you use stow to link your build to the standard location /usr/local/bin

Now you have some changes in aMule,  so you call configure again and tell it to install this new build

Do you mean that i first type:

Code: [Select]

$ git pull git://repo.or.cz/amule.gitand then:

Code: [Select]

$ ./configure --prefix=/usr/local/stow/amule-opt/ --enable-geoip --enable-optimize --disable-debug --mandir=/share/bin
or:
$ ./configure --prefix=/usr/local/stow/amule-stu-opt-debug/ --enable-geoip --enable-optimize --enable-debug --with-wxdebug --mandir=/share/bin
and then:

Code: [Select]

$ make -j 2 && sudo make install
$ cd /usr/local/stow
$ sudo stow amule-opt
or:
$ make -j 2 && sudo make install
$ cd /usr/local/stow
$ sudo stow amule-stu-opt-debug

right?

Right, almost perfect. You created to builds, [one with debug information and other without] and installed them under /usr/loca/stow/.... The only problem you have is that you call stow two times without unstowing the first one. You can only have a "default amule", so if you want to stow the second one [stu-opt-debug] first unstow the previous.

You may go to /usr/local/stow, unstow the previous one and stow the new one. Do you need to try the old one? Just unstow/stow again and you are set.

?Huh?
I dont understand; how do i do this?

unstow is done with stow -D

So for instance, imagine you made the build in /usr/local/stow/amule-btk the default, but want to switch to another one living in /usr/local/stow/amule-kkaos, then you do

Code: [Select]

$ cd /usr/local/stow
$ sudo stow -D amule-btk
$ sudo stow amule-kkaos


[RRM]

I recommend you to push it hard, that is to say, feed the mule some really popular files.

Ok, will do.  

Yesterday I had a little bit of time and had a deeper look into your low VZS crashes.

It seems you may be running out of file descriptors in the socket code.

So, i better not feed it too much...
Let me try to strike a balance then.

so you use stow to link your build to the standard location /usr/local/bin
....
imagine you made the build in /usr/local/stow/amule-btk the default, but want to switch to another one living in /usr/local/stow/amule-kkaos, then you do

Code: [Select]

$ cd /usr/local/stow
$ sudo stow -D amule-btk
$ sudo stow amule-kkaos


Aaaaaaaaaaahhh.... OK, wow... How elegant!  thank you!!

[RRM]

How do you guys know when a change to the source code has been made?
I mean: how do you know that its time to do

Code: [Select]

$ git pull git://repo.or.cz/amule.git
Is there an announcement board for this?

Code: [Select]

$ sudo bash -c "ulimit -n 65536; ulimit -n; su -m -c 'ulimit -n; id -nu' \"`id -un`\""
What does that do?
limit the VSZ that aMule can use?

[Vollstrecker]

As I don't know if the git repo has an webinterface, I think it's the easiest way to check the sites that offer tarballs. On gonosztopis site or my site you'll see when a new rev arrives. Sometimes one is more uptodate than the other. My is updated with every changeset, gonos one is updated when something intressting is changed.

[RRM]

Thank you Vollstrecker!
Stu supplied me with an amule.cpp file to replace the original git version amule.cpp.
Will Stu normally eventually apply that change to the git version,
or will that replacement be undone when i do a new git pull?
(as git pull will level any difference, right?)
Or maybe its just a test-amule.cpp, and time (testing it) will tell if it is for keepers?

[Vollstrecker]

I don't know git, but svn will just report that the file has local changes and therefor don't touch it. I would just backup the file, so you can view the diff if it is changed (google will tell you how to do with git) and see if the modified section is touched or not.

[btkaos]

Stu supplied me with an amule.cpp file to replace the original git version amule.cpp.
Will Stu normally eventually apply that change to the git version,
or will that replacement be undone when i do a new git pull?
(as git pull will level any difference, right?)
Or maybe its just a test-amule.cpp, and time (testing it) will tell if it is for keepers?

The change STU sent is not likely to be applied in the git version. So your last line is spot on.

git pull will try to respect your local changes. Anyways, you can see what's changed with git status

If you are in doubt you can delete the directory and do a git clone again :p

[btkaos]

How do you guys know when a change to the source code has been made?
I mean: how do you know that its time to do

Code: [Select]

$ git pull git://repo.or.cz/amule.git

Just git pull is enough. Git remebers where did you pull last time from.

Is there an announcement board for this?

No, but git pull is very fast, so no harm pulling when you feel like it. You may use gitk to see amule's history.

Code: [Select]

$ sudo bash -c "ulimit -n 65536; ulimit -n; su -m -c 'ulimit -n; id -nu' \"`id -un`\""
What does that do?
limit the VSZ that aMule can use?

No. It raises the limit of files [and sockets with fd] aMule can open. The code looks so complicated as one root can raise such limit, but we want amule running as your actual user.

So, push aMule [with STU patch]. If your aMule doesn't crash, we are on the right path.

If aMule crashes, run with the limit raised and push amule again.

Regards,BTK

[RRM]

Thank you Bill, thats great.

I would just backup the file, so you can view the diff if it is changed

Of course... Excellent idea...
I should have thought of that myself.
Thank you.

[btkaos]

To some of the forum admins: Could you rename/split the thread so its title better reflects what it is about?

[wuischke]

To some of the forum admins: Could you rename/split the thread so its title better reflects what it is about?

Sure.

[RRM]

I stepped on the gas.
Everything seemed fine (doubled connections, upload speed remained the same,
a steady 1.9 MB/s currently, increased downloads from 1 to 8; 300 kB/s),
but now aMule is frozen (the page is empty, except for the header, which is frozen
in the sense that upload and download speed dont change anymore).
However, according to the terminal, aMule has not crashed yet...
ah, but now it has...
Its...
Its a boy!
or, is it a girl?...
No! ... Its a high VSZ crash!!!

$ ps axl | grep amule

Code: [Select]

0  1000 14695 14665  20   0   3036   796 pipe_w S+   pts/0      0:00 grep amule
0  1000 23813 23784  20   0  38008  4396 poll_s S+   pts/1      0:00 gdb amule
0  1000 23815 23813  20   0 3145724 2721812 ptrace Tl pts/1   699:16 /usr/local/bin/amule


Code: [Select]

Terminated after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
Error while getting symbol table : Memory exhausted backtrace:
[2] ?? in /usr/lib/libstdc++.so.6 [0x109f415]
[3] ?? in /usr/lib/libstdc++.so.6 [0x109f452]
[4] ?? in /usr/lib/libstdc++.so.6 [0x109f591]
[5] operator new(unsigned int) in /usr/lib/libstdc++.so.6[0x109fc0f]
[6] wxObjectList::CreateNode(wxNodeBase*, wxNodeBase*, void*, wxListKey const&) in /usr/lib/libwx_baseu-2.8.so.0[0x96a463]
[7] wxListBase::Append(void*) in /usr/lib/libwx_baseu-2.8.so.0[0x97cd4b]
[8] wxEvtHandler::AddPendingEvent(wxEvent&) in /usr/lib/libwx_baseu-2.8.so.0[0x9d68b2]
[9] wxSocketBase::OnRequest(wxSocketNotify) in /usr/lib/libwx_baseu_net-2.8.so.0[0x6cf920]
[10] wx_socket_callback in /usr/lib/libwx_baseu_net-2.8.so.0[0x6cfa14]
[11] GSocket::Detected_Write() in /usr/lib/libwx_baseu_net-2.8.so.0[0x6d4a8b]
[12] ?? in /usr/lib/libwx_gtk2u_core-2.8.so.0 [0xc0b427]
[13] ?? in /usr/lib/libgdk-x11-2.0.so.0 [0x79ef7c]
[14] ?? in /lib/libglib-2.0.so.0 [0x3b0ad5b]
[15] g_main_context_dispatch in /lib/libglib-2.0.so.0[0x3ad3e78]
[16] ?? in /lib/libglib-2.0.so.0 [0x3ad7720]
[17] g_main_loop_run in /lib/libglib-2.0.so.0[0x3ad7b8f]
[18] gtk_main in /usr/lib/libgtk-x11-2.0.so.0[0x36b5419]
[19] wxEventLoop::Run() in /usr/lib/libwx_gtk2u_core-2.8.so.0[0xc09c78]
[20] wxAppBase::MainLoop() in /usr/lib/libwx_gtk2u_core-2.8.so.0[0xc9ce3e]
[21] wxAppBase::OnRun() in /usr/lib/libwx_gtk2u_core-2.8.so.0[0xc9ca31]
[22] wxEntry(int&, wchar_t**) in /usr/lib/libwx_baseu-2.8.so.0[0x9717aa]
[23] wxEntry(int&, char**) in /usr/lib/libwx_baseu-2.8.so.0[0x971987]
[24] ?? in /usr/local/bin/amule [0x817e3eb]
[25] __libc_start_main in /lib/tls/i686/cmov/libc.so.6[0x75ecb56]
[26]  in start.S:122

Program received signal SIGABRT, Aborted.
0x00ad2422 in __kernel_vsyscall ()
(gdb) bt full

Code: [Select]

#0  0x00ad2422 in __kernel_vsyscall ()
No symbol table info available.
#1  0x076004d1 in raise () from /lib/tls/i686/cmov/libc.so.6
No symbol table info available.
#2  0x07603932 in abort () from /lib/tls/i686/cmov/libc.so.6
No symbol table info available.
#3  0x08278df5 in OnUnhandledException() ()
No symbol table info available.
#4  0x0109f415 in ?? () from /usr/lib/libstdc++.so.6
No symbol table info available.
#5  0x0109f452 in std::terminate() () from /usr/lib/libstdc++.so.6
No symbol table info available.
#6  0x0109f591 in __cxa_throw () from /usr/lib/libstdc++.so.6
No symbol table info available.
#7  0x0109fc0f in operator new(unsigned int) () from /usr/lib/libstdc++.so.6
No symbol table info available.
#8  0x0096a463 in wxObjectList::CreateNode(wxNodeBase*, wxNodeBase*, void*, wxListKey const&) () from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#9  0x0097cd4b in wxListBase::Append(void*) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#10 0x009d68b2 in wxEvtHandler::AddPendingEvent(wxEvent&) ()
---Type <return> to continue, or q <return> to quit---
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#11 0x006cf920 in wxSocketBase::OnRequest(wxSocketNotify) ()
   from /usr/lib/libwx_baseu_net-2.8.so.0
No symbol table info available.
#12 0x006cfa14 in wx_socket_callback () from /usr/lib/libwx_baseu_net-2.8.so.0
No symbol table info available.
#13 0x006d4a8b in GSocket::Detected_Write() ()
   from /usr/lib/libwx_baseu_net-2.8.so.0
No symbol table info available.
#14 0x00c0b427 in ?? () from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#15 0x0079ef7c in ?? () from /usr/lib/libgdk-x11-2.0.so.0
No symbol table info available.
#16 0x03b0ad5b in ?? () from /lib/libglib-2.0.so.0
No symbol table info available.
#17 0x03ad3e78 in g_main_context_dispatch () from /lib/libglib-2.0.so.0
No symbol table info available.
#18 0x03ad7720 in ?? () from /lib/libglib-2.0.so.0
No symbol table info available.
#19 0x03ad7b8f in g_main_loop_run () from /lib/libglib-2.0.so.0
No symbol table info available.
#20 0x036b5419 in gtk_main () from /usr/lib/libgtk-x11-2.0.so.0
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#21 0x00c09c78 in wxEventLoop::Run() () from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#22 0x00c9ce3e in wxAppBase::MainLoop() ()
   from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#23 0x00c9ca31 in wxAppBase::OnRun() () from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#24 0x009717aa in wxEntry(int&, wchar_t**) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#25 0x00971987 in wxEntry(int&, char**) () from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#26 0x0817e3eb in main ()
No symbol table info available.
(gdb) thread apply all bt full

Code: [Select]


Thread 5 (Thread 0xb63e5b70 (LWP 23831)):
#0  0x00ad2422 in __kernel_vsyscall ()
No symbol table info available.
#1  0x00773142 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
   from /lib/tls/i686/cmov/libpthread.so.0
No symbol table info available.
#2  0x009d3854 in wxConditionInternal::WaitTimeout(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#3  0x009d38af in wxCondition::WaitTimeout(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#4  0x009d4aa4 in wxSemaphoreInternal::WaitTimeout(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#5  0x009d4b2f in wxSemaphore::WaitTimeout(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#6  0x082751c2 in CTimerThread::Entry() ()
No symbol table info available.
#7  0x009d5a98 in wxThreadInternal::PthreadStart(wxThread*) ()
   from /usr/lib/libwx_baseu-2.8.so.0
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#8  0x009d5afd in wxPthreadStart () from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#9  0x0076e80e in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
No symbol table info available.
#10 0x076a27ee in clone () from /lib/tls/i686/cmov/libc.so.6
No symbol table info available.

Thread 3 (Thread 0xb73e8b70 (LWP 23829)):
#0  0x00ad2422 in __kernel_vsyscall ()
No symbol table info available.
#1  0x00776466 in nanosleep () from /lib/tls/i686/cmov/libpthread.so.0
No symbol table info available.
#2  0x009db3b8 in wxMicroSleep(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#3  0x009db3e1 in wxMilliSleep(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#4  0x009d369d in wxThread::Sleep(unsigned long) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#5  0x0813fe88 in UploadBandwidthThrottler::Entry() ()
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#6  0x009d5a98 in wxThreadInternal::PthreadStart(wxThread*) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#7  0x009d5afd in wxPthreadStart () from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#8  0x0076e80e in start_thread () from /lib/tls/i686/cmov/libpthread.so.0
No symbol table info available.
#9  0x076a27ee in clone () from /lib/tls/i686/cmov/libc.so.6
No symbol table info available.

Thread 1 (Thread 0xb7fdd760 (LWP 23815)):
#0  0x00ad2422 in __kernel_vsyscall ()
No symbol table info available.
#1  0x076004d1 in raise () from /lib/tls/i686/cmov/libc.so.6
No symbol table info available.
#2  0x07603932 in abort () from /lib/tls/i686/cmov/libc.so.6
No symbol table info available.
#3  0x08278df5 in OnUnhandledException() ()
No symbol table info available.
#4  0x0109f415 in ?? () from /usr/lib/libstdc++.so.6
No symbol table info available.
#5  0x0109f452 in std::terminate() () from /usr/lib/libstdc++.so.6
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#6  0x0109f591 in __cxa_throw () from /usr/lib/libstdc++.so.6
No symbol table info available.
#7  0x0109fc0f in operator new(unsigned int) () from /usr/lib/libstdc++.so.6
No symbol table info available.
#8  0x0096a463 in wxObjectList::CreateNode(wxNodeBase*, wxNodeBase*, void*, wxListKey const&) () from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#9  0x0097cd4b in wxListBase::Append(void*) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#10 0x009d68b2 in wxEvtHandler::AddPendingEvent(wxEvent&) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#11 0x006cf920 in wxSocketBase::OnRequest(wxSocketNotify) ()
   from /usr/lib/libwx_baseu_net-2.8.so.0
No symbol table info available.
#12 0x006cfa14 in wx_socket_callback () from /usr/lib/libwx_baseu_net-2.8.so.0
No symbol table info available.
#13 0x006d4a8b in GSocket::Detected_Write() ()
   from /usr/lib/libwx_baseu_net-2.8.so.0
No symbol table info available.
#14 0x00c0b427 in ?? () from /usr/lib/libwx_gtk2u_core-2.8.so.0
---Type <return> to continue, or q <return> to quit---
No symbol table info available.
#15 0x0079ef7c in ?? () from /usr/lib/libgdk-x11-2.0.so.0
No symbol table info available.
#16 0x03b0ad5b in ?? () from /lib/libglib-2.0.so.0
No symbol table info available.
#17 0x03ad3e78 in g_main_context_dispatch () from /lib/libglib-2.0.so.0
No symbol table info available.
#18 0x03ad7720 in ?? () from /lib/libglib-2.0.so.0
No symbol table info available.
#19 0x03ad7b8f in g_main_loop_run () from /lib/libglib-2.0.so.0
No symbol table info available.
#20 0x036b5419 in gtk_main () from /usr/lib/libgtk-x11-2.0.so.0
No symbol table info available.
#21 0x00c09c78 in wxEventLoop::Run() () from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#22 0x00c9ce3e in wxAppBase::MainLoop() ()
   from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#23 0x00c9ca31 in wxAppBase::OnRun() () from /usr/lib/libwx_gtk2u_core-2.8.so.0
No symbol table info available.
#24 0x009717aa in wxEntry(int&, wchar_t**) ()
   from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#25 0x00971987 in wxEntry(int&, char**) () from /usr/lib/libwx_baseu-2.8.so.0
No symbol table info available.
#26 0x0817e3eb in main ()
No symbol table info available.