error - exit code 195 (0xc3) on CMSearch

Everything about the project RNA World
Nachricht
Autor
Benutzeravatar
yoyo
Vereinsvorstand
Vereinsvorstand
Beiträge: 8170
Registriert: 17.12.2002 14:09
Wohnort: Berlin

Re: error - exit code 195 (0xc3) on CMSearch

#13 Ungelesener Beitrag von yoyo » 08.03.2010 23:17

Hi Rilian,
this http://www.rnaworld.de/rnaworld/downloa ... c3/513055/ is basically your aborting wu. Can you make a test on your windows system (any other can do it also). Download the zip, extract it somewhere and run

Code: Alles auswählen

cmsearch cmfile in
Afterwards I'm interested in the output.

thx,
yoyo
HILF mit im Rechenkraft-WiKi, dies gibts zu tun.
Wiki - FAQ - Verein - Chat

Bild Bild

Benutzeravatar
rilian
PDA-Benutzer
PDA-Benutzer
Beiträge: 47
Registriert: 08.02.2010 15:38

Re: error - exit code 195 (0xc3) on CMSearch

#14 Ungelesener Beitrag von rilian » 08.03.2010 23:34

i had to rename file "cmsearch" into "cmsearch.exe"

running now ... (process eating 40MB)

Code: Alles auswählen

# Copyright (C) 2009 HHMI Janelia Farm Research Campus
# Freely distributed under the GNU General Public License (GPLv3)
# - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
# command:    cmsearch cmfile in
# date:       Tue Mar 09 00:31:29 2010
# compiler: 4.4.0, -O2 -fomit-frame-pointer -malign-double -fstrict-aliasing -sp
ecs=cm_gccspecs -mfpmath=387
# num seqs:   1
# dbsize(Mb): 188.115346
#
# Pre-search info for CM 1: 6S
#
#                                  cutoffs            predictions
#                            -------------------  --------------------
# rnd  mod  alg  cfg   beta     E value   bit sc     surv     run time
# ---  ---  ---  ---  -----  ----------  -------  -------  -----------
    1  hmm  fwd  loc      -   27871.922     5.57   0.0491  04:19:31.44
    2   cm  cyk  loc  1e-010     702.737     6.78   0.0012  15:49:10.36
    3   cm  ins  loc  1e-015       1.000    20.41  9.1e-007  00:57:27.93
# ---  ---  ---  ---  -----  ----------  -------  -------  -----------
  all    -    -    -      -           -        -        -  21:06:09.73
#

CM: 6S
EDIT: does this initial output mean WU will run 21 hour and survival chance on 1st round is 4% ? :D
I crunch for Ukraine

Benutzeravatar
rilian
PDA-Benutzer
PDA-Benutzer
Beiträge: 47
Registriert: 08.02.2010 15:38

Re: error - exit code 195 (0xc3) on CMSearch

#15 Ungelesener Beitrag von rilian » 09.03.2010 00:54

Yoyo,

Code: Alles auswählen

Fatal exception (source file cp9_dp.c, line 841):
malloc of size 376230696 failed

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.
i did not look how much memory it ate when failed

it ate 40mb in the beginning and 130mb after 25 mins
I crunch for Ukraine

Ananas
WU-Schieber
WU-Schieber
Beiträge: 1184
Registriert: 27.04.2008 18:37
Wohnort: Nordlichter Köln

Re: error - exit code 195 (0xc3) on CMSearch

#16 Ungelesener Beitrag von Ananas » 09.03.2010 01:13

Wuerde ich an die Entwickler von Infernal weitergeben.

Die Quellcode-Zeile ist zwar kommentiert - aber ... aehm ... tja, ich weiss trotzdem nicht, was da passiert und ob man den Verbrauch einschraenken koennte :

Code: Alles auswählen

  /* scA will hold P(seq up to j | Model) in int log odds form */
  ESL_ALLOC(scA, sizeof(int) * (j0-i0+2));
in Funktion cp9_Forward(). j0 und i0 sind Uebergabeparameter der Funktion :

Code: Alles auswählen

 *           i0        - start of target subsequence (1 for beginning of dsq)
 *           j0        - end of target subsequence (L for end of dsq)
und werden mit 1 bzw. L belegt, also vermutlich die Gesamtlaenge der Sequenz. "Vernutlich" deshalb, weil L auch schon wieder in einer anderen Funktion berechnet als verwendet wird : get_cmemit_dsq(), die sie wiederum einer anderen (diesmal iterativen) Funktion zur Berechnung uebergibt, so huepft man im Quellcode permanent zwischen Funktionen 'rum.

Ohne den Quellcode laengere Zeit intensiv studiert (oder auswendig gelernt?) zu haben, gibt es kaum eine Chance, dahinterzukommen.


p.s.: ich komme auf 47028834 Integers, die es da allocieren wollte - muss was anderes sein als eine simple Sequenzlaenge. In der Gegend steht auch irgendwas von "tree", also wohl eine Struktur, die das Programm sich selbst aufgebaut hat.

p.p.s.: Korrektur, das passt doch mit der Sequenzlaenge, sind wohl eher 94.057.674 Integers (also eher das Doppelte) ergaebe ein L von 94.057.673 und die Datei enthaelt 94.057.673 Buchstaben (Titelzeile und Zeilenvorschuebe bereits abgezogen). In dem Fall werden wir wohl kaum an dieser Stelle sparen koennen.
vi BOINC/checkin_notes
:1,$s/bug/feature/g
:wq!

Erzaehlen sich Biologen eigentlich Klein-RNA-Witze?

Benutzeravatar
yoyo
Vereinsvorstand
Vereinsvorstand
Beiträge: 8170
Registriert: 17.12.2002 14:09
Wohnort: Berlin

Re: error - exit code 195 (0xc3) on CMSearch

#17 Ungelesener Beitrag von yoyo » 09.03.2010 06:18

Does it mean the system who aborted this wu has just to less memory?
I checked all hosts who aborted this WU. They do not have more than 3GB, mostly only 2GB.
yoyo
HILF mit im Rechenkraft-WiKi, dies gibts zu tun.
Wiki - FAQ - Verein - Chat

Bild Bild

Ananas
WU-Schieber
WU-Schieber
Beiträge: 1184
Registriert: 27.04.2008 18:37
Wohnort: Nordlichter Köln

Re: error - exit code 195 (0xc3) on CMSearch

#18 Ungelesener Beitrag von Ananas » 09.03.2010 08:03

yoyo hat geschrieben:Does it mean the system who aborted this wu has just to less memory?
...
At least you can say that it didn't have enough free memory when it crashed. With a single task and nothing else running, it might have worked - but then ... I saw a report somewhere else in the forum about one result giving up when it used 2.9GB RAM, I think it was this rat

Rilian's runtime error is not one that has been controlled by any limits that the program itself checks. That means, we do not have much of a chance to raise it with --mxsize or any other parameter.

It might be possible though to use a short integer (DWORD value) there, but I cannot decide how that influences the calculation. Michael could probably contact the developers and ask, they sure know what the program planned to do with this array.


p.s.: I'm really curious how this rat result will come out, the host has a really high amount of RAM installed (8GB for only two tasks). Only one of my hosts has more RAM, but that's for 16 tasks so there is actually less available per task.
vi BOINC/checkin_notes
:1,$s/bug/feature/g
:wq!

Erzaehlen sich Biologen eigentlich Klein-RNA-Witze?

Benutzeravatar
yoyo
Vereinsvorstand
Vereinsvorstand
Beiträge: 8170
Registriert: 17.12.2002 14:09
Wohnort: Berlin

Re: error - exit code 195 (0xc3) on CMSearch

#19 Ungelesener Beitrag von yoyo » 09.03.2010 08:38

Is there anybody here who can run the above WU, which crashed on the system of rilian on a system with much RAM, 8GB or more? Also win64 and Linux are fine, but than a different binary must be used. Would be also good to watch the memory consumption during this run.

Otherwise I will run it on the server, which has 12GB. But the server is still busy with 2 long running cmaclibrate.
yoyo
HILF mit im Rechenkraft-WiKi, dies gibts zu tun.
Wiki - FAQ - Verein - Chat

Bild Bild

cisf
Mikrocruncher
Mikrocruncher
Beiträge: 20
Registriert: 07.03.2010 21:55

Re: error - exit code 195 (0xc3) on CMSearch

#20 Ungelesener Beitrag von cisf » 09.03.2010 10:03

yoyo hat geschrieben:Is there anybody here who can run the above WU, which crashed on the system of rilian on a system with much RAM, 8GB or more? Also win64 and Linux are fine, but than a different binary must be used. Would be also good to watch the memory consumption during this run.

Otherwise I will run it on the server, which has 12GB. But the server is still busy with 2 long running cmaclibrate.
yoyo



Linux 2.6.31-20-generic x86_64 GNU/Linux

AMD Athlon(tm) 64 X2 Dual Core Processor 6000+
memory 1754.58 (+250 video shared) MB
Swap space 10126.86 MB

(the lack of fizical memory should not impact drasticaly the aplication, becouse i've noticed that the speed it rights into the memory with, is about 1M/s so any harddrive can cope)

i used the sse2 cmsearch, from my rna boinc folder


cisf@elisa:~/Desktop/test linux RNA_Boinc $ ./cmsearch cmfile in
# cmsearch :: search a sequence database with an RNA CM
# INFERNAL 1.0.2 (October 2009)
# Copyright (C) 2009 HHMI Janelia Farm Research Campus
# Freely distributed under the GNU General Public License (GPLv3)
# - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
# command: ./cmsearch cmfile in
# date: Tue Mar 9 10:18:51 2010
# compiler: 4.3.3, O2staticm64msse2
# num seqs: 1
# dbsize(Mb): 188.115346
#
# Pre-search info for CM 1: 6S
#
# cutoffs predictions
# ------------------- --------------------
# rnd mod alg cfg beta E value bit sc surv run time
# --- --- --- --- ----- ---------- ------- ------- -----------
1 hmm fwd loc - 27871.922 5.57 0.0491 01:30:59.49
2 cm cyk loc 1e-10 702.737 6.78 0.0012 02:22:19.26
3 cm ins loc 1e-15 1.000 20.41 9.1e-07 00:13:54.40
# --- --- --- --- ----- ---------- ------- ------- -----------
all - - - - - - - 04:07:13.17
#

CM: 6S

_________________________
memory usage at different time stamps:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
------------------------------------------------------------------------
9053 cisf 20 0 1983m 254m 800 R 98 14.5 1:44.69 cmsearch
9053 cisf 20 0 1983m 328m 800 R 99 18.7 3:38.53 cmsearch
9053 cisf 20 0 1983m 783m 800 R 100 44.7 15:10.70 cmsearch
9053 cisf 20 0 1983m 1.0g 764 R 100 57.7 20:58.08 cmsearch - at this point the swap is used, but is not afecting the system (write speed of about 1M/s)
9053 cisf 20 0 1983m 1.3g 112 R 98 73.4 31:10.51 cmsearch
the memory usage stays between 1.2 and 1.3 G

the aplication still runs, i'll add info if it errors or are important memory changes (unless my test is usseles and then please say so)

Matthias Lehmkuhl
Prozessor-Polier
Prozessor-Polier
Beiträge: 125
Registriert: 12.03.2008 20:42

Re: error - exit code 195 (0xc3) on CMSearch

#21 Ungelesener Beitrag von Matthias Lehmkuhl » 09.03.2010 11:20

do a run on XP with 3GB with the wintest.zip file and the cmsearch/sse3 of my Boincfolder.
I don't find a similar cmsearch that is in the wintest.zip file im my boinc project folder.

# cmsearchsse3 :: search a sequence database with an RNA CM
# INFERNAL 1.0.2 (October 2009)
# Copyright (C) 2009 HHMI Janelia Farm Research Campus
# Freely distributed under the GNU General Public License (GPLv3)
# - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
# command: cmsearchsse3 cmfile in
# date: Tue Mar 09 11:03:23 2010
# compiler: 4.4.0, -O2 -msse3 -fomit-frame-pointer -malign-double -fstrict-alias
ing -specs=cm_gccspecs -mfpmath=sse
# num seqs: 1
# dbsize(Mb): 188.115346
#
# Pre-search info for CM 1: 6S
#
# cutoffs predictions
# ------------------- --------------------
# rnd mod alg cfg beta E value bit sc surv run time
# --- --- --- --- ----- ---------- ------- ------- -----------
1 hmm fwd loc - 27871.922 5.57 0.0491 00:55:46.91
2 cm cyk loc 1e-010 702.737 6.78 0.0012 02:59:32.61
3 cm ins loc 1e-015 1.000 20.41 9.1e-007 00:15:41.94
# --- --- --- --- ----- ---------- ------- ------- -----------
all - - - - - - - 04:11:01.47
#

CM: 6S

memory usage after 15 mins working set 104MB to 160MV Virtual size 207MB from Process Explorer
Matthias

Bild - Bild

Benutzeravatar
Michael H.W. Weber
Vereinsvorstand
Vereinsvorstand
Beiträge: 23174
Registriert: 07.01.2002 01:00
Wohnort: Marpurk

Re: error - exit code 195 (0xc3) on CMSearch

#22 Ungelesener Beitrag von Michael H.W. Weber » 09.03.2010 11:27

I could also run it on a Win XP Pro x64 AMD 955 BE with 8 GB of RAM or on the same machine with Ubuntu 9.04 x64.

Michael.
Fördern, kooperieren und konstruieren statt fordern, konkurrieren und konsumieren.

Bild Bild

cisf
Mikrocruncher
Mikrocruncher
Beiträge: 20
Registriert: 07.03.2010 21:55

Re: error - exit code 195 (0xc3) on CMSearch

#23 Ungelesener Beitrag von cisf » 09.03.2010 11:39

Code: Alles auswählen

 PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND            
------------------------------------------------------------------------
  after stabilizing at 1.2-1.3 G memory usage, the swap got very active and cpu droped to 1 - 67% (should i understand, that the aplication first generates all the data and then processes it ?)
  this only lasted for under 2 minutes.
  9053 cisf      20   0  189m  55m  260 R   99  3.2  46:57.53 cmsearch 
  9053 cisf      20   0  189m  55m  260 R  100  3.2  53:36.18 cmsearch 
  9053 cisf      20   0  190m  56m  324 R  100  3.2  62:20.76 cmsearch      
  9053 cisf      20   0 1984m  86m  400 R   96  4.9  63:55.79 cmsearch   
  9053 cisf      20   0 1984m 359m  400 R   99 20.5  70:30.20 cmsearch 
  9053 cisf      20   0 1984m 854m  400 R   98 48.7  82:23.42 cmsearch
  9053 cisf      20   0 1984m 1.0g  400 R   98 58.6  86:34.05 cmsearch 
  9053 cisf      20   0 1984m 1.2g  400 R  100 68.6  90:49.58 cmsearch 
  9053 cisf      20   0 1984m 1.3g  360 R   98 74.3  93:39.69 cmsearch 
  9053 cisf      20   0 1984m 1.1g  112 R   99 65.4  97:05.96 cmsearch 
  9053 cisf      20   0 1984m 1.3g  112 R  100 73.2 100:28.73 cmsearch
  9053 cisf      20   0 1984m 1.3g  112 R  100 76.2 107:08.62 cmsearch
  9053 cisf      20   0 1984m 1.2g  136 D    1 69.7 108:35.91 cmsearch - swaping hard again
  9053 cisf      20   0  190m  90m  192 R   99  5.2 108:47.26 cmsearch
  9053 cisf      20   0  190m  95m  336 R  100  5.4 120:08.30 cmsearch 
  the job ended


cisf@elisa:~/Desktop/test linux RNA_Boinc $ ./cmsearch cmfile in
# cmsearch :: search a sequence database with an RNA CM
# INFERNAL 1.0.2 (October 2009)
# Copyright (C) 2009 HHMI Janelia Farm Research Campus
# Freely distributed under the GNU General Public License (GPLv3)
# - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
# command:    ./cmsearch cmfile in
# date:       Tue Mar  9 10:18:51 2010
# compiler: 4.3.3, O2staticm64msse2
# num seqs:   1
# dbsize(Mb): 188.115346
#
# Pre-search info for CM 1: 6S
#
#                                  cutoffs            predictions     
#                            -------------------  --------------------
# rnd  mod  alg  cfg   beta     E value   bit sc     surv     run time
# ---  ---  ---  ---  -----  ----------  -------  -------  -----------
    1  hmm  fwd  loc      -   27871.922     5.57   0.0491  01:30:59.49
    2   cm  cyk  loc  1e-10     702.737     6.78   0.0012  02:22:19.26
    3   cm  ins  loc  1e-15       1.000    20.41  9.1e-07  00:13:54.40
# ---  ---  ---  ---  -----  ----------  -------  -------  -----------
  all    -    -    -      -           -        -        -  04:07:13.17
#

CM: 6S
>Equus

  Plus strand results:

 Query = 1 - 184, Target = 5948716 - 5948869
 Score = 21.67, E = 0.4846, P = 9.696e-09, GC =  52

           :<<<<<<<<<<<<<<-<<<------------..<<<<-<<<<<<---------------.
         1 ugggccCUGcgguGUUCGucAGugguuuaaa..ucCcuuGAgCCgAuAauuuuuccaaa. 57      
             : C  U: :G GUUCG:+AGU+++ U+++        G:GCC A+ + UU+ +  A  
   5948716 AAUACUCUAUGGGGUUCGAGAGUUUCCUUUUua------GGGCCAAAGCAUUACUGGAGg 5948769 

           .<<<-<<<<<----<<<<<<<-----<<---<<<<<_____......._>>>>>-->>--
        58 .GGGAgcugucucUggccgguGGUGUGcAuGCCcgcCuuGu.......AgcgGGAAgCCa 109     
            GGG  ::::CU  : C              :C ::CUU U       A:: G:      
   5948770 uGGGCAAUUCCUACUGC--------------UCUCACUUAUuucugccAUGGGA------ 5948809 

           -->>>>>>>-->>>>>->>>------------->>>>>>->>>>------------.>>>
       110 AAgccggccauacggcgCCCACCUGgAAcugCaGGuUCaAgGgauuaaaaacgaCa.aCG 168     
                 G :  ::::  CCC CCUG  AC+ CAGGU:C          A+ C++CA :CG
   5948810 ------GAA-AGGAUCUCCCGCCUGUCACCACAGGUCC---------CAGGCAUCAcUCG 5948853 

           >>>>>>>>>>>>>>::
       169 GCacugCGGggcccuc 184     
           GC C: :G  G : ++
   5948854 GCACCUUGAGGCAGCU 5948869 


  Minus strand results:

 Query = 1 - 184, Target = 11975240 - 11975122
 Score = 21.76, E = 0.4608, P = 9.22e-09, GC =  46

           :<<<<<<<<<<<<<<-<<<------------<<<<-<~~~~~~~>->>>>----------
         1 ugggccCUGcgguGUUCGucAGugguuuaaaucCcuu*[110]*aAgGgauuaaaaacga 163     
           U::  :C:::G:UGU  GU+A  +G  U++  CCCUU       AAGGG U A+A+    
  11975240 UGUGUGCUGUGCUGUCAGUGACCUGGGUUU-UCCCUU*[ 45]*AAGGGCUCAUAGCACG 11975144

           -->>>>>>>.>>>>>>>>>>::
       164 CaaCGGCac.ugCGGggcccuc 184     
            AAC GCA: U:::G:  ::U+
  11975143 AAACUGCAGcUAUAGCCAAGUU 11975122


#
# Post-search info for CM 1: 6S
#
#                              number of hits       surv fraction  
#                            -------------------  -----------------
# rnd  mod  alg  cfg   beta    expected   actual  expected   actual
# ---  ---  ---  ---  -----  ----------  -------  --------  -------
    1  hmm  fwd  loc      -   27871.922     7068    0.0491   0.0157
    2   cm  cyk  loc  1e-10     702.737       36    0.0012  7.7e-05
    3   cm  ins  loc  1e-15       1.000        2   9.1e-07  1.5e-06
#
# expected time    actual time
# -------------  -------------
    04:07:13.17    02:16:34.00
//
#
# CPU time: 7589.03u 10.58s 02:06:39.61 Elapsed: 02:16:40

Benutzeravatar
rilian
PDA-Benutzer
PDA-Benutzer
Beiträge: 47
Registriert: 08.02.2010 15:38

Re: error - exit code 195 (0xc3) on CMSearch

#24 Ungelesener Beitrag von rilian » 09.03.2010 13:04

yoyo hat geschrieben:Does it mean the system who aborted this wu has just to less memory?
I checked all hosts who aborted this WU. They do not have more than 3GB, mostly only 2GB.
yoyo
p.s.: I'm really curious how this rat result will come out, the host has a really high amount of RAM installed (8GB for only two tasks). Only one of my hosts has more RAM, but that's for 16 tasks so there is actually less available per task.
there are some interesting WUs:

1) it is completed at computer from topic head (4 cores, 2GB) and in the same time exited with 195 code on another 2GB machine
http://www.rnaworld.de/rnaworld/workuni ... uid=512154

2)
another completed on 8GB machine and exited with 195 code on 2GB machine
http://www.rnaworld.de/rnaworld/workuni ... uid=514400
I crunch for Ukraine

Zurück zu „RNA World Discussions (english)“