Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • igwill
    Junior Member
    • Nov 2018
    • 4

    #1

    Speeding Up Soapdenovo2

    Hi,
    I am working on some de novo assemblies with Soapdenovo2 with the multi-mer option, and wanted to know if anyone has experience with getting these crunched quickly-ish.
    Specifically, can Soap split itself over multiple nodes on a cluster (via SLURM)? All examples sbatch scripts I see have it use only one node and 8 cpus. I have access to more if it can use it.

    Details on what I'm running currently:

    My data: 33M (x2) reads of paired end Illumina, 150b read length on fragments in the 300-400bp range. Interleaved in a *.fa. Animal genome, estimating ~100-300Mb.

    Relevant SBATCH info:
    Code:
    #SBATCH --nodes=1
    #SBATCH --ntasks-per-node=8
    #SBATCH --time=40:00:00
    #SBATCH --mem-per-cpu=4000
    SOAPdenovo-63mer all -s MYCONFIG -K 63 -m 57 -R -o TESTRUN 1>TEST_ass.log 2>TEST_ass.err
    MYCONFIG:
    Code:
    max_rd_len=150
    [LIB]
    # most options just commented out, assuming defaults are fine for my short paired data
    avg_ins=350
    asm_flags=3
    rank=1
    p=TESTDATA.fa
    For Soapdenovo2, what's the best combination of resources to crank up? Nodes? ntasks (and correspondingly the -p parameter for my run command)? mem-per-cpu?

    Thank you!
  • igwill
    Junior Member
    • Nov 2018
    • 4

    #2
    Just for anyone wandering in later with a similar question, after getting some more info, we are trying this:


    #SBATCH --nodes=4
    #SBATCH --ntasks-per-node=8
    #SBATCH –-mem=128000
    #SBATCH --time=168:00:00


    Should be plenty to let SOAP do it's thing as quickly as it can, hopefully.

    Comment

    Latest Articles

    Collapse

    • kinpict.com
      Reply to 16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
      by kinpict.com
      The part about this topic feels surprisingly grounded, and the details on the page is the bit that made me slow down. I’d keep <a href="https://kinpict.com/">ai family photo generator</a> bookmarked for later.
      Yesterday, 06:37 PM
    • SEQadmin2
      16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
      by SEQadmin2





      NGS has revolutionized clinical microbiology by offering new ways to identify and surveil pathogens without prior knowledge of the target. One popular approach is 16S rRNA and ITS amplicon sequencing, which targets specific microbial markers. But studies are increasingly incorporating shotgun metagenomics, a technique that sequences all DNA from a sample without targeting specific microbial markers. This approach allows more detailed taxonomic classification,...
      10-30-2026, 06:46 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, 11-12-2026, 07:59 AM
    0 responses
    29 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 11-05-2026, 09:25 AM
    0 responses
    36 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 11-03-2026, 11:54 AM
    2 responses
    60 views
    0 reactions
    Last Post kinpict.com  
    Started by SEQadmin2, 10-28-2026, 09:57 AM
    0 responses
    176 views
    0 reactions
    Last Post SEQadmin2  
    Working...