Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Try to enhance the efficiency of SAMtools merge option

    Hi Guys,

    Now I have around 100 sorted .bam files (~150MB each one) generated from TopHat.
    Then I need to merge all these .bam files by SAMtools.

    I try to enhance the efficiency on Hadoop cloud platform.
    There are two choices:
    1) Merge all files in one SAMtools merge command (single machine)
    2) Merge each pair of two files in the first level, and then merge each pair of two files (from 1st level) in the second level, and ... (the concept similar to merge sort)

    My question is:
    Whether the second choice can run more faster?
    Does anyone try to further enhance the merge efficiency of SAMtools?
    Thanks.

  • #2
    Another thought would be to try Picard. I do not know if it is faster or not but it may be. It will handle headers more appropriately: http://picard.sourceforge.net/comman...#MergeSamFiles

    Comment


    • #3
      Samtools is faster than Picard for most operations. It also has parallel compression which picard lacks if I am correct.

      I am not sure why you want to merge 100 RNA-seq BAMs. If you have to do that, the two approaches won't differ much. The bottleneck is writing the final BAM. You may try novosort from novocraft which takes better advantage of multi-core, but it is not free. You may also consider to use option "-1". Your output will be ~10% larger but the compression speed will be several times faster.

      Comment


      • #4
        Thanks for the suggestion!!

        Comment

        Latest Articles

        Collapse

        • seqadmin
          Quality Control Essentials for Next-Generation Sequencing Workflows
          by seqadmin




          Like all molecular biology applications, next-generation sequencing (NGS) workflows require diligent quality control (QC) measures to ensure accurate and reproducible results. Proper QC begins at nucleic acid extraction and continues all the way through to data analysis. This article outlines the key QC steps in an NGS workflow, along with the commonly used tools and techniques.

          Nucleic Acid Quality Control
          Preparing for NGS starts with isolating the...
          02-10-2025, 01:58 PM
        • seqadmin
          An Introduction to the Technologies Transforming Precision Medicine
          by seqadmin


          In recent years, precision medicine has become a major focus for researchers and healthcare professionals. This approach offers personalized treatment and wellness plans by utilizing insights from each person's unique biology and lifestyle to deliver more effective care. Its advancement relies on innovative technologies that enable a deeper understanding of individual variability. In a joint documentary with our colleagues at Biocompare, we examined the foundational principles of precision...
          01-27-2025, 07:46 AM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by seqadmin, 02-07-2025, 09:30 AM
        0 responses
        72 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-05-2025, 10:34 AM
        0 responses
        113 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-03-2025, 09:07 AM
        0 responses
        89 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 01-31-2025, 08:31 AM
        0 responses
        49 views
        0 likes
        Last Post seqadmin  
        Working...
        X