Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Samtools pileup filesize limit

    Is there a file size limitation for samtools pileup command? I converted a 82GB sam file (output from bowtie) into a 25 GB compressed bam and then sorted it using samtools. Now when I try running samtools pileup on the sorted file (25GB), samtools quits saying memory leak. If samtools cannot handle large file, is there a way to split the sorted bam, analyze it with samtools pileup separately and then merge the output.
    Thanks.

  • #2
    what is your computer config ? how much RAM ?

    Comment


    • #3
      Hi Nicobxl,
      I am running samtools on a 16 core 64 bit linux server with 256 GB RAM. Going through the samtools manual, I did not notice any performance related command/options. Please let me know if you have any suggestions.
      Thanks,

      Comment


      • #4
        error message? I am sure 200GB BAMs have no problems. Pileup only uses tiny amount of memory.

        Comment


        • #5
          Hi Ih3,
          I am using this command to generate a txt file.
          samtools pileup -vcf filename.fas filename_sorted.bam > rawsnp.txt

          I ran samtools on a 1.7 GB file under 32 bit linux system and it worked fine. When I tried running the same file on the 64 bit server, samtools quits saying memory leak 1. continue anyway and then quits.

          Can you suggest some solution to this.
          Thanks,

          Comment


          • #6
            I also had a memory leak, I could solve this by sorting my bam files.

            (this was highest hit when googeling memory leak of mpileup and this is a common mistake)

            Comment

            Latest Articles

            Collapse

            • seqadmin
              Essential Discoveries and Tools in Epitranscriptomics
              by seqadmin




              The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist...
              04-22-2024, 07:01 AM
            • seqadmin
              Current Approaches to Protein Sequencing
              by seqadmin


              Proteins are often described as the workhorses of the cell, and identifying their sequences is key to understanding their role in biological processes and disease. Currently, the most common technique used to determine protein sequences is mass spectrometry. While still a valuable tool, mass spectrometry faces several limitations and requires a highly experienced scientist familiar with the equipment to operate it. Additionally, other proteomic methods, like affinity assays, are constrained...
              04-04-2024, 04:25 PM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by seqadmin, Yesterday, 11:49 AM
            0 responses
            15 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 04-24-2024, 08:47 AM
            0 responses
            16 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 04-11-2024, 12:08 PM
            0 responses
            62 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 04-10-2024, 10:19 PM
            0 responses
            60 views
            0 likes
            Last Post seqadmin  
            Working...
            X