Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Speeding Up Soapdenovo2

    Hi,
    I am working on some de novo assemblies with Soapdenovo2 with the multi-mer option, and wanted to know if anyone has experience with getting these crunched quickly-ish.
    Specifically, can Soap split itself over multiple nodes on a cluster (via SLURM)? All examples sbatch scripts I see have it use only one node and 8 cpus. I have access to more if it can use it.

    Details on what I'm running currently:

    My data: 33M (x2) reads of paired end Illumina, 150b read length on fragments in the 300-400bp range. Interleaved in a *.fa. Animal genome, estimating ~100-300Mb.

    Relevant SBATCH info:
    Code:
    #SBATCH --nodes=1
    #SBATCH --ntasks-per-node=8
    #SBATCH --time=40:00:00
    #SBATCH --mem-per-cpu=4000
    SOAPdenovo-63mer all -s MYCONFIG -K 63 -m 57 -R -o TESTRUN 1>TEST_ass.log 2>TEST_ass.err
    MYCONFIG:
    Code:
    max_rd_len=150
    [LIB]
    # most options just commented out, assuming defaults are fine for my short paired data
    avg_ins=350
    asm_flags=3
    rank=1
    p=TESTDATA.fa
    For Soapdenovo2, what's the best combination of resources to crank up? Nodes? ntasks (and correspondingly the -p parameter for my run command)? mem-per-cpu?

    Thank you!

  • #2
    Just for anyone wandering in later with a similar question, after getting some more info, we are trying this:


    #SBATCH --nodes=4
    #SBATCH --ntasks-per-node=8
    #SBATCH –-mem=128000
    #SBATCH --time=168:00:00


    Should be plenty to let SOAP do it's thing as quickly as it can, hopefully.

    Comment

    Latest Articles

    Collapse

    • seqadmin
      New Genomics Tools and Methods Shared at AGBT 2025
      by seqadmin






      This year’s Advances in Genome Biology and Technology (AGBT) General Meeting commemorated the 25th anniversary of the event at its original venue on Marco Island, Florida. While this year’s event didn’t include high-profile musical performances, the industry announcements and cutting-edge research still drew the attention of leading scientists.

      The Headliner
      The biggest announcement was Roche stepping back into the sequencing platform...
      03-03-2025, 01:39 PM
    • seqadmin
      Investigating the Gut Microbiome Through Diet and Spatial Biology
      by seqadmin




      The human gut contains trillions of microorganisms that impact digestion, immune functions, and overall health1. Despite major breakthroughs, we’re only beginning to understand the full extent of the microbiome’s influence on health and disease. Advances in next-generation sequencing and spatial biology have opened new windows into this complex environment, yet many questions remain. This article highlights two recent studies exploring how diet influences microbial...
      02-24-2025, 06:31 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, 03-03-2025, 01:15 PM
    0 responses
    177 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 02-28-2025, 12:58 PM
    0 responses
    267 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 02-24-2025, 02:48 PM
    0 responses
    652 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 02-21-2025, 02:46 PM
    0 responses
    266 views
    0 likes
    Last Post seqadmin  
    Working...
    X