Checkpointing?

Everything about the project RNA World
Nachricht
Autor
ftpd

Checkpointing?

#1 Ungelesener Beitrag von ftpd » 31.03.2011 16:54

31-3-2011 17:48:21 RNA World Restarting task cms_GA-p[EZ-Lin64s]_1_Enterobacter-sp.-638_CP000653.cir.EMBL_1301033223_12378_0 using cmsearch2 version 31

I have read somewhere that there is checkpointing when using the new application.
Is this also for this wu? It was processing alsmost 40 hours and start all over now after reboot.

Correct?

Ton (ftpd)

Torbjörn Klatt
Vereinsmitglied
Vereinsmitglied
Beiträge: 1333
Registriert: 23.04.2007 21:18
Wohnort: Bad Homburg, HR, D, Earth, Sol, Milkyway

Re: Checkpointing?

#2 Ungelesener Beitrag von Torbjörn Klatt » 31.03.2011 17:07

Unfortunately, the check-pointing is only available for some few work units of the new app yet. As soon as the older work units are finished, the new will all have check-pointing.

Cheers,
Torbjörn
alias Bohne2k7
bevorzugte Projekte: WCG, RNA World, Yoyo
Profil (RKN-Wiki) | www: torbjoern-klatt.de | Twitter: @torbjoernklatt | Diaspora*: torbjoernk@diasp.de
Bild

Benutzeravatar
mxplm
Partikel-Strecker
Partikel-Strecker
Beiträge: 966
Registriert: 14.09.2009 13:56
Wohnort: Bielefeld

Re: Checkpointing?

#3 Ungelesener Beitrag von mxplm » 31.03.2011 17:15

Right, you do not have checkpointing in every WU. This is because the checkpointing we do is only achieved by grouping several very short tasks into one. This means that all longer tasks are still without checkpoints.

But as far as I know, this will also be the case in the near future, so long running will still reset when rebooting.
:Wiki-Benutzerseite: (Über mich)
:fold.it: (Helfen durch Zocken)

Benutzeravatar
Michael H.W. Weber
Vereinsvorstand
Vereinsvorstand
Beiträge: 23157
Registriert: 07.01.2002 01:00
Wohnort: Marpurk

Re: Checkpointing?

#4 Ungelesener Beitrag von Michael H.W. Weber » 31.03.2011 17:28

To say it clearly: Except for Linux 32 bit machines for which memory randomization is deactivated in the kernel, RNA World still does not offer a true checkpointing mechanism. What we will have available is a simple bundling of small sub-tasks in a single WU. After finishing each of the bundled taks, RNA World will continue with the next task in that bundle once the machine is shut down, crashes, halts or whatever - so it does not restarte from the very beginning of that task as it was before. Looking at this from the outside appears as if these WUs have checkpointing and indeed they do continue exactly with the next sub-task in that bundle. Nothng more, nothing less.

So, do not come to the false conclusion that now it is safe to restart your machine at any time for any WU we have in the system, because only for the CMSEARCH S application, this bundling applies and evenhere it won't for all of the WUs. :attention: You can make out the difference by checking whether the WU name contains an indication ofthe Rfam family or not. Those WUs that do not show this Rfam family name, are the bundled ones containing "pseudo-checkpointing". All the others will restart from the very beginning once the machine is shut down.

Michael.
Fördern, kooperieren und konstruieren statt fordern, konkurrieren und konsumieren.

Bild Bild

ftpd

Re: Checkpointing?

#5 Ungelesener Beitrag von ftpd » 31.03.2011 21:44

Dear all,

Thanks for exploination!

I will not reboot anymore!

Keep on crunching!

Ton (ftpd)

Benutzeravatar
Norman
Klimawolke
Klimawolke
Beiträge: 2188
Registriert: 20.03.2003 14:34
Wohnort: Saarland

Re: Checkpointing?

#6 Ungelesener Beitrag von Norman » 31.03.2011 21:50

cms_GA-p[EZ-Lin64s]_1_Enterobacter-sp.-638_CP000653.cir.EMBL_1301033223_12378_0

the first numer ( here 1 ) is the number of the wu in a archive ;)

Zurück zu „RNA World Discussions (english)“