Home
My Page
Projects
OpenVAS

[#941] Multithreaded compilation doesn't work on Mandriva

Date:
2009-04-03 18:32
Priority:
3
State:
Open
Submitted by:
Stephan Kleine (bitshuffler)
Assigned to:
Nobody (None)
Architecture:
None
Product:
None
Operating System:
None
Component:
openvas-client
Version:
None
Severity:
None
Resolution:
None
Hardware:
None
URL:
 
Summary:
Multithreaded compilation doesn't work on Mandriva

Detailed description
If one tries to compile openvas-client with multiple threads ("make -jX" with X>1) it fails on



Mandriva 2009 x86_64

SLE 10 x86_64

openSUSE 10.2 x86_64

openSUSE 11.1 i586

openSUSE Factory i586



with the following error:





gcc -march=i586 -mtune=i686 -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall `sh ./cflags` -c pdf_output.c

pdf_output.c: In function 'arglist_to_pdf':

pdf_output.c:276: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result

pdf_output.c:318: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result

gcc -march=i586 -mtune=i686 -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall `sh ./cflags` -c prefs_dialog/readonly.c

/usr/bin/make -C ../src/util

make[2]: Entering directory `/usr/src/packages/BUILD/openvas-client-2.0.3/src/util'

gcc -march=i586 -mtune=i686 -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall `sh ./cflags` -c openvas_ssh_key_create.c

sh: ./cflags: No such file or directory

openvas_ssh_key_create.c:37:31: error: openvas_ssh_login.h: No such file or directory

In file included from openvas_ssh_key_create.c:38:

openvas_ssh_key_create.h:39:18: error: glib.h: No such file or directory

In file included from openvas_ssh_key_create.c:38:

openvas_ssh_key_create.h:42: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'openvas_ssh_key_create'

openvas_ssh_key_create.h:43: error: expected ')' before '*' token

openvas_ssh_key_create.h:44: error: expected ')' before '*' token

openvas_ssh_key_create.h:45: error: expected ')' before '*' token

openvas_ssh_key_create.h:46: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'ensure_dir'

openvas_ssh_key_create.c:39:25: error: nessus_i18n.h: No such file or directory

openvas_ssh_key_create.c:40:23: error: error_dlg.h: No such file or directory

openvas_ssh_key_create.c:41:25: error: glib/gstdio.h: No such file or directory

openvas_ssh_key_create.c:42:21: error: context.h: No such file or directory

openvas_ssh_key_create.c:55: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'ensure_single_dir'

openvas_ssh_key_create.c:79: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'ensure_dir'

openvas_ssh_key_create.c:124: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'openvas_ssh_privkey_create'

openvas_ssh_key_create.c:204: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'openvas_ssh_pubkey_create'

openvas_ssh_key_create.c:274: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'openvas_ssh_key_create'

openvas_ssh_key_create.c:299: error: expected ')' before '*' token

openvas_ssh_key_create.c:335: error: expected ')' before '*' token

openvas_ssh_key_create.c:352: error: expected '=', ',', ';', 'asm' or '__attribute__' before '*' token

make[2]: *** [openvas_ssh_key_create.o] Error 1

make[2]: *** Waiting for unfinished jobs....

make[2]: Leaving directory `/usr/src/packages/BUILD/openvas-client-2.0.3/src/util'

make[1]: *** [util] Error 2

make[1]: Leaving directory `/usr/src/packages/BUILD/openvas-client-2.0.3/nessus'

make: *** [client] Error





It would be great if that could be fixed because multithreaded compilation speeds up the compilation process quite noticeable.

Followup

Message
Date: 2009-11-02 23:49
Sender: Geoff Galitz

Is this still a problem?
Date: 2009-07-21 15:12
Sender: Stephan Kleine

Please reopen since it didn't magically fix itself ...

Status is that it works sometimes and sometimes it doesn't which makes the compilation non deterministic which shouldn't happen if the make file were correct.
Date: 2009-07-21 11:49
Sender: Felix Wolfsteller

Is the bug still reproducable?

I will close it otherwise, soon.

It will be looked at osc.
Date: 2009-04-07 09:13
Sender: Stephan Kleine

> 1) Getting osc to do its job was (is) not as easy as it should be (was reported by Michael).

I set it up on Debian to try it myself and wrote Michael an email how to do it but never received an response, so I don't know if he succeeded.

> 2) "Direct" (non-osc) multithreaded compilation works.

Sorry, but I see no reason how a direct "make -j3" call should / could be different from any "make -j3" call osc does on an affected system.

> 3) Non-multithreaded compilation is reasonably fast.

While that's certainly arguable it simply shouldn't happen and might cover some other flaws in the long run.

However, regarding osc: if you want please ping me on IRC (bitshuffler in #suse on irc.freenode.org) and I'll help you to get osc working on Debian.
Date: 2009-04-07 06:44
Sender: Felix Wolfsteller

Thank you Stephan.

Running debian the situation is:
1) Getting osc to do its job was (is) not as easy as it should be (was reported by Michael).
2) "Direct" (non-osc) multithreaded compilation works.
3) Non-multithreaded compilation is reasonably fast.

Sorry, I did not had your other posts regarding multithreaded compilation in mind.
I hope the log will help.

The thread with Michaels osc logs:
http://marc.info/?l=openvas-development&m=122959440003525&w=2
http://marc.info/?l=openvas-development&m=122959440003525&w=2
Date: 2009-04-06 17:06
Sender: Stephan Kleine

Attached build.log for openSUSE 11.1 i586.

I lack the time to reproduce them all locally and don't want to pester the server but you can do it quite easily with "osc" as explained a couple of times.

1. osc co security:openvas:STABLE openvas-client
2. append -j3 to the make call in openvas-client.spec
3. run osc build ...

And no, iirc it never worked (which I told you a few times on the ML).
Date: 2009-04-06 07:04
Sender: Felix Wolfsteller

Thanks for testing on so many systems.
Do you know if it worked pre-2.0.3?
And could you attach a full log?

Attached Files:

Attachments:
build.log

Changes:

Field Old Value Date By
status_idClosed2009-07-22 06:39felix
close_date2009-07-21 11:492009-07-21 11:49felix
summaryMultithreaded compilation doesn\'t work.2009-07-21 11:49felix
status_idOpen2009-07-21 11:49felix
File Added318: build.log2009-04-06 17:06bitshuffler

This site is hosted by Intevation GmbH