Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Multiprocessor samtools

    Hi folks -

    I'm wondering if anyone knows of a way to make samtools utilize all the processors and cores on a machine. I usually run merge, index, mpileup, and pass the results to bcftools on a machine with 16 cores, but top shows that these programs use only 1 core. For large bam files (~10GB merged), this can mean hours of extra compute time. And if you're paying for compute time by the hour, this means lots of extra $. Has anyone figured out a way to make samtools more "parallel"? Barring a straightforward way to do that, does anyone know of other tools that will merge, index, and do variant discovery/genotyping in a parallel manner from bam files? Thanks.

  • #2
    I am looking for the same answer, have you figured it out yet?

    Comment


    • #3
      We just normally run many processes at once. I haven't heard of anyline parallelising Samtools.

      Comment


      • #4
        Most of the time, SAMTools is probably waiting on disk (IO-bound) & multithreading might offer little advantage.

        Comment


        • #5
          Krobison : if samtools is IO limited do you know of any performance related settings to put more into memory ? As far as I know it does quite a lot of calculation eg local realignment of reads as well.

          Comment


          • #6
            One way to do it could be to run it per chromosome. You'll gain some time by this way.

            Comment

            Latest Articles

            Collapse

            • seqadmin
              The Impact of AI in Genomic Medicine
              by seqadmin



              Artificial intelligence (AI) has evolved from a futuristic vision to a mainstream technology, highlighted by the introduction of tools like OpenAI's ChatGPT and Google's Gemini. In recent years, AI has become increasingly integrated into the field of genomics. This integration has enabled new scientific discoveries while simultaneously raising important ethical questions1. Interviews with two researchers at the center of this intersection provide insightful perspectives into...
              02-26-2024, 02:07 PM
            • seqadmin
              Multiomics Techniques Advancing Disease Research
              by seqadmin


              New and advanced multiomics tools and technologies have opened new avenues of research and markedly enhanced various disciplines such as disease research and precision medicine1. The practice of merging diverse data from various ‘omes increasingly provides a more holistic understanding of biological systems. As Maddison Masaeli, Co-Founder and CEO at Deepcell, aptly noted, “You can't explain biology in its complex form with one modality.”

              A major leap in the field has
              ...
              02-08-2024, 06:33 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by seqadmin, Today, 06:12 AM
            0 responses
            13 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 02-23-2024, 04:11 PM
            0 responses
            67 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 02-21-2024, 08:52 AM
            0 responses
            70 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 02-20-2024, 08:57 AM
            0 responses
            61 views
            0 likes
            Last Post seqadmin  
            Working...
            X