restarting after 40 hours - several times

Everything about the project RNA World
Nachricht
Autor
ftpd

restarting after 40 hours - several times

#1 Ungelesener Beitrag von ftpd » 12.09.2012 06:39

I have no idea.
Can you post it in the forum?
Maybe someone else has an idea.

yoyo
Ton schrieb:
Hi Uwe,

My machine hostid = 4208 with windows xp-pro 32bits have some problems ?

I have already resetted the rnaworld-programs including wu?s several times but still after about 40 hours of processing, this happens ?

11-9-2012 7:08:42 | GPUGRID | Computation for task I1R73-NATHAN_RPS1120528-75-166-RND5601_0 finished
11-9-2012 7:08:58 | GPUGRID | Started upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_0
11-9-2012 7:08:58 | GPUGRID | Started upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_1
11-9-2012 7:09:01 | GPUGRID | Finished upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_0
11-9-2012 7:09:01 | GPUGRID | Started upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_2
11-9-2012 7:09:06 | GPUGRID | Finished upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_1
11-9-2012 7:09:06 | GPUGRID | Started upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_3
11-9-2012 7:09:09 | GPUGRID | Finished upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_2
11-9-2012 7:09:09 | GPUGRID | Started upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_4
11-9-2012 7:09:10 | GPUGRID | Finished upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_3
11-9-2012 7:09:10 | GPUGRID | Started upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_7
11-9-2012 7:09:11 | GPUGRID | Finished upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_7
11-9-2012 7:11:26 | GPUGRID | Finished upload of I1R73-NATHAN_RPS1120528-75-166-RND5601_0_4
11-9-2012 7:11:29 | GPUGRID | Sending scheduler request: To report completed tasks.
11-9-2012 7:11:29 | GPUGRID | Reporting 1 completed tasks, not requesting new tasks
11-9-2012 7:11:36 | GPUGRID | Scheduler request completed
11-9-2012 7:26:44 | RNA World | Restarting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00853_mir-304_1330438623_50214_0 using cmsearch version 31 in slot 0
11-9-2012 7:27:19 | RNA World | Task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00452_mir-172_1330438623_49828_0 exited with zero status but no 'finished' file
11-9-2012 7:27:19 | RNA World | If this happens repeatedly you may need to reset the project.
11-9-2012 7:27:19 | RNA World | Task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF01043_MIR1023_1330438623_50396_0 exited with zero status but no 'finished' file
11-9-2012 7:27:19 | RNA World | If this happens repeatedly you may need to reset the project.
11-9-2012 7:27:19 | RNA World | Task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF01265_snR42_1330438623_50617_0 exited with zero status but no 'finished' file
11-9-2012 7:27:19 | RNA World | If this happens repeatedly you may need to reset the project.
11-9-2012 7:27:19 | RNA World | Task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00849_mir-60_1330438623_50210_0 exited with zero status but no 'finished' file
11-9-2012 7:27:19 | RNA World | If this happens repeatedly you may need to reset the project.
11-9-2012 7:27:19 | RNA World | Task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00972_mir-651_1330438623_50325_0 exited with zero status but no 'finished' file
11-9-2012 7:27:19 | RNA World | If this happens repeatedly you may need to reset the project.
11-9-2012 7:27:19 | RNA World | Computation for task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00854_mir-5_1330438623_50215_0 finished
11-9-2012 7:27:19 | RNA World | Restarting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00452_mir-172_1330438623_49828_0 using cmsearch version 31 in slot 5
11-9-2012 7:27:30 | RNA World | Restarting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF01043_MIR1023_1330438623_50396_0 using cmsearch version 31 in slot 3
11-9-2012 7:27:30 | RNA World | Restarting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF01265_snR42_1330438623_50617_0 using cmsearch version 31 in slot 4
11-9-2012 7:27:48 | RNA World | Started upload of cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00854_mir-5_1330438623_50215_0_0
11-9-2012 7:27:48 | RNA World | Started upload of cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00854_mir-5_1330438623_50215_0_1
11-9-2012 7:27:48 | RNA World | Restarting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00849_mir-60_1330438623_50210_0 using cmsearch version 31 in slot 2
11-9-2012 7:27:48 | RNA World | Restarting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00972_mir-651_1330438623_50325_0 using cmsearch version 31 in slot 1
11-9-2012 7:28:06 | RNA World | Starting task cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00833_mir-70_1330438623_50194_0 using cmsearch version 31 in slot 6
11-9-2012 7:28:19 | RNA World | Finished upload of cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00854_mir-5_1330438623_50215_0_1
11-9-2012 7:28:34 | RNA World | Finished upload of cms_GA-p[e30-50MB_Lin64f]_1_Equus-caballus-(horse)_CM000404.lin.EMBL_RF00854_mir-5_1330438623_50215_0_0
11-9-2012 7:28:34 | RNA World | Sending scheduler request: To report completed tasks.
11-9-2012 7:28:34 | RNA World | Reporting 1 completed tasks, not requesting new tasks
11-9-2012 7:28:35 | RNA World | Scheduler request completed

Any ideas???


Hope that anyone has some ideas!!

ChristianB
Admin
Admin
Beiträge: 1920
Registriert: 23.02.2010 22:12

Re: restarting after 40 hours - several times

#2 Ungelesener Beitrag von ChristianB » 12.09.2012 08:13

It seems to me that if one task finishes ok the Client thinks all tasks have finished and checks for the result files. Could you check if this is a common scenario?

Maybe the client can't distinguish between the started instances of cmsearch and if one process calls boinc_finish() it tries all currently running instances. I can't say for sure with this short log.

ftpd

Re: restarting after 40 hours - several times

#3 Ungelesener Beitrag von ftpd » 12.09.2012 09:55

This was not the situation. Only GPUGRID was always just finished and uploaded. GPUGRID uses GTX480.

Ton van Born

ChristianB
Admin
Admin
Beiträge: 1920
Registriert: 23.02.2010 22:12

Re: restarting after 40 hours - several times

#4 Ungelesener Beitrag von ChristianB » 12.09.2012 10:20

Is it that all RNAworld tasks are restarting or is it a random number of tasks restarting? I don't know what information the cmsearch app is writing into stderr that could be helpfull to identify the source of this. Maybe Michael or Ananas have a clue.

Edit: Here is the solution. Your application terminated itself because of
stderr out from task 14252132 hat geschrieben:07:27:14 (5788): No heartbeat from core client for 30 sec - exiting
This means that either your PC was doing some heavy disk I/O or other operation that prevented communication between science application and core client. This is most probably caused by a finished RNAWorld task that is zipping up the results, like you can see in your log snippet above.

Benutzeravatar
Michael H.W. Weber
Vereinsvorstand
Vereinsvorstand
Beiträge: 23174
Registriert: 07.01.2002 01:00
Wohnort: Marpurk

Re: restarting after 40 hours - several times

#5 Ungelesener Beitrag von Michael H.W. Weber » 12.09.2012 15:19

We have a solution to the BOINC-caused heart beat bug which should be distributed with the RNA World project files, soon.

Michael.
Fördern, kooperieren und konstruieren statt fordern, konkurrieren und konsumieren.

Bild Bild

Benutzeravatar
skgiven
Mikrocruncher
Mikrocruncher
Beiträge: 17
Registriert: 23.10.2010 08:49

Re: restarting after 40 hours - several times

#6 Ungelesener Beitrag von skgiven » 14.09.2012 23:19

What was the solution you found?

Benutzeravatar
Michael H.W. Weber
Vereinsvorstand
Vereinsvorstand
Beiträge: 23174
Registriert: 07.01.2002 01:00
Wohnort: Marpurk

Re: restarting after 40 hours - several times

#7 Ungelesener Beitrag von Michael H.W. Weber » 17.09.2012 09:18

On the basis of Volkers suggestions, we simply disabled the heart beat mechanism and it is planned that Christian Beer will present the solution in the name of the RNA World team on the upcoming BOINC workshop in London.

Michael.
Fördern, kooperieren und konstruieren statt fordern, konkurrieren und konsumieren.

Bild Bild

Zurück zu „RNA World Discussions (english)“