Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • gwilymh
    Member
    • Dec 2011
    • 72

    #1

    Problem with SSPACE, multi-threading and memory restrictions

    Hi,
    I am attempting to use SSPACE version 3 to re-scaffold some mRNA contigs using paired-end RNA-Seq data. While SSPACe was designed for rescaffolding genomes, I see no reason why it should not work in similar fashion for re-scaffolding de novo assembled RNA contigs.

    SSPACE is discussed in seqanswers here:
    Discussion of next-gen sequencing related bioinformatics: resources, algorithms, open source efforts, etc


    The SSPACE webpage can be reached from here:


    I consistently get the following error message:
    =>date: Mapping reads to contigs with Bowtie
    Thread 8 terminated abnormally: Can't open bwa output -- fatal
    Out of memory!
    Process 'extend/format contigs' failed on date

    with:
    resources_used.mem=47,424,992kb
    resources_used.vmem=64,093,240kb
    resources_used.walltime=00:34:33

    It seems to me that SSPACE is running out of physical memory while trying to open the bwa output.

    The "Thread 8 terminated abnormally" is especially cryptic, as the program was set to only run with 6 threads (-T 6).

    My run parameters are:
    Code:
    #PBS -l nodes=1:ppn=6,mem=47gb,walltime=72:00:00
    SSPACE_FILE=${HOME}/src/SSPACE-STANDARD-3.0_linux-x86_64/SSPACE_Standard_v3.0.pl 
    LIBRARY_FILE=/[I]filepath[/I]/library_file_2.txt
    CONTIG_FILE=/[I]filepath[/I]/A_planci_pcg_transdec_MePath2Renam_echinoHomology.fasta		#-s option, contigs that we are scaffolding
    MIN_LINKS=10		   	# -k 10
    THREADS=6			    # -T, threads
    SKIP=0				    #-S 0=no, -S 1=yes, skip processing of reads
    EXTEND_CONTIGS=1		#-x, extend contigs using sequence data, 0=no, 1=yes, default 0
    VERBOSE=1			    #-v  Runs the scaffolding process in verbose mode (-v 1=yes, -v 0=no, default -v 0, optional)
    $SSPACE_FILE -l $LIBRARY_FILE -s $CONTIG_FILE -k $MIN_LINKS -T $THREADS -S $SKIP -x $EXTEND_CONTIGS -v $VERBOSE
    The supporting library file is attached.

    I previously tried to run SSPACE over multiple nodes, but it seemed to use the cores on only one of the nodes.

    Does anyone know of a way to get SSPACE to run across multiple nodes? Can it be run with mpi multi-threading? If not, does anyone have any suggestions for reducing memory requirements?
    Attached Files
    Last edited by GenoMax; 10-06-2015, 07:50 AM. Reason: added CODE tags to improve display
  • AnnabelleVH
    Junior Member
    • Oct 2015
    • 1

    #2
    Hi gwilymh,

    Did you solve your problem?
    I encounter the same error, i would love to beneficit from your help if you found a solution.

    cheers,

    Comment

    • sunnycqcn
      Member
      • Apr 2013
      • 17

      #3
      Did you solve your problem?

      Originally posted by gwilymh View Post
      Hi,
      I am attempting to use SSPACE version 3 to re-scaffold some mRNA contigs using paired-end RNA-Seq data. While SSPACe was designed for rescaffolding genomes, I see no reason why it should not work in similar fashion for re-scaffolding de novo assembled RNA contigs.

      SSPACE is discussed in seqanswers here:
      Discussion of next-gen sequencing related bioinformatics: resources, algorithms, open source efforts, etc


      The SSPACE webpage can be reached from here:


      I consistently get the following error message:
      =>date: Mapping reads to contigs with Bowtie
      Thread 8 terminated abnormally: Can't open bwa output -- fatal
      Out of memory!
      Process 'extend/format contigs' failed on date

      with:
      resources_used.mem=47,424,992kb
      resources_used.vmem=64,093,240kb
      resources_used.walltime=00:34:33

      It seems to me that SSPACE is running out of physical memory while trying to open the bwa output.

      The "Thread 8 terminated abnormally" is especially cryptic, as the program was set to only run with 6 threads (-T 6).

      My run parameters are:
      Code:
      #PBS -l nodes=1:ppn=6,mem=47gb,walltime=72:00:00
      SSPACE_FILE=${HOME}/src/SSPACE-STANDARD-3.0_linux-x86_64/SSPACE_Standard_v3.0.pl 
      LIBRARY_FILE=/[I]filepath[/I]/library_file_2.txt
      CONTIG_FILE=/[I]filepath[/I]/A_planci_pcg_transdec_MePath2Renam_echinoHomology.fasta		#-s option, contigs that we are scaffolding
      MIN_LINKS=10		   	# -k 10
      THREADS=6			    # -T, threads
      SKIP=0				    #-S 0=no, -S 1=yes, skip processing of reads
      EXTEND_CONTIGS=1		#-x, extend contigs using sequence data, 0=no, 1=yes, default 0
      VERBOSE=1			    #-v  Runs the scaffolding process in verbose mode (-v 1=yes, -v 0=no, default -v 0, optional)
      $SSPACE_FILE -l $LIBRARY_FILE -s $CONTIG_FILE -k $MIN_LINKS -T $THREADS -S $SKIP -x $EXTEND_CONTIGS -v $VERBOSE
      The supporting library file is attached.

      I previously tried to run SSPACE over multiple nodes, but it seemed to use the cores on only one of the nodes.

      Does anyone know of a way to get SSPACE to run across multiple nodes? Can it be run with mpi multi-threading? If not, does anyone have any suggestions for reducing memory requirements?
      I met the same problem. Did you solve your problem?
      If you have, could you share your experiences?
      Thanks

      Comment

      Latest Articles

      Collapse

      • SEQadmin2
        Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
        by SEQadmin2



        Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

        Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
        ...
        10-14-2026, 09:55 AM
      • SEQadmin2
        New Genomics Technologies Take Aim at Long-Standing Limits
        by SEQadmin2


        Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

        We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
        ...
        09-28-2026, 10:25 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by SEQadmin2, 10-22-2026, 11:13 AM
      0 responses
      29 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 10-22-2026, 10:48 AM
      0 responses
      22 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 10-15-2026, 10:52 AM
      0 responses
      39 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 10-14-2026, 05:39 AM
      0 responses
      45 views
      0 reactions
      Last Post SEQadmin2  
      Working...