Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • igwill
    Junior Member
    • Nov 2018
    • 4

    Speeding Up Soapdenovo2

    Hi,
    I am working on some de novo assemblies with Soapdenovo2 with the multi-mer option, and wanted to know if anyone has experience with getting these crunched quickly-ish.
    Specifically, can Soap split itself over multiple nodes on a cluster (via SLURM)? All examples sbatch scripts I see have it use only one node and 8 cpus. I have access to more if it can use it.

    Details on what I'm running currently:

    My data: 33M (x2) reads of paired end Illumina, 150b read length on fragments in the 300-400bp range. Interleaved in a *.fa. Animal genome, estimating ~100-300Mb.

    Relevant SBATCH info:
    Code:
    #SBATCH --nodes=1
    #SBATCH --ntasks-per-node=8
    #SBATCH --time=40:00:00
    #SBATCH --mem-per-cpu=4000
    SOAPdenovo-63mer all -s MYCONFIG -K 63 -m 57 -R -o TESTRUN 1>TEST_ass.log 2>TEST_ass.err
    MYCONFIG:
    Code:
    max_rd_len=150
    [LIB]
    # most options just commented out, assuming defaults are fine for my short paired data
    avg_ins=350
    asm_flags=3
    rank=1
    p=TESTDATA.fa
    For Soapdenovo2, what's the best combination of resources to crank up? Nodes? ntasks (and correspondingly the -p parameter for my run command)? mem-per-cpu?

    Thank you!
  • igwill
    Junior Member
    • Nov 2018
    • 4

    #2
    Just for anyone wandering in later with a similar question, after getting some more info, we are trying this:


    #SBATCH --nodes=4
    #SBATCH --ntasks-per-node=8
    #SBATCH –-mem=128000
    #SBATCH --time=168:00:00


    Should be plenty to let SOAP do it's thing as quickly as it can, hopefully.

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
      by SEQadmin2


      Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


      The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
      ...
      06-02-2026, 10:05 AM
    • SEQadmin2
      Single-Cell Sequencing at an Inflection Point: Early Impacts of New Platforms and Emerging Trends
      by SEQadmin2


      With the launch of new single-cell sequencing platforms in 2026, the field stands at an exciting inflection point. This article surveys the most impactful advances in the field and discusses how they’re reshaping research in cancer, immunology, and beyond.


      Introduction

      Single-cell sequencing technologies have undergone remarkable advances over the past decade, transitioning from low-throughput experimental approaches to highly scalable platforms capable of...
      05-22-2026, 06:42 AM
    • SEQadmin2
      Environmental Genomics in the Age of NGS: From Microbes to Conservation Strategies
      by SEQadmin2

      Studying ecosystems means dealing with complex, multi-species communities that are hard to observe at scale. This complexity, however, hides many important questions to be answered, from how biogeochemical cycles work and how climate change can affect species distribution to how conservation strategies can work best.


      Genomics, particularly since the expansion of NGS, has transformed ecosystem ecology. By sequencing environmental DNA, we can now assess biodiversity without direct...
      05-06-2026, 09:04 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, Yesterday, 08:59 AM
    0 responses
    14 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-02-2026, 12:03 PM
    0 responses
    22 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-02-2026, 11:40 AM
    0 responses
    19 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 05-28-2026, 11:40 AM
    0 responses
    32 views
    0 reactions
    Last Post SEQadmin2  
    Working...