No announcement yet.
  • Filter
  • Time
  • Show
Clear All
new posts

  • samtools sort [bam_merge_core] [bam_sort_core] errors?

    Okay, I've run out of ideas. I cannot get this BAM file to sort. I have a reference sequence in FASTA format that has 2 'Chromosomes' that are actually just scaffolds from a genome that isn't finished yet. The first time I ran my illumina reads through the workflow (BWA>SAM>BAM>sort>index... etc) Then when I tried to view it, it failed because there were replications in the BAM headers. I discovered that these were my fault from the python script I wrote to pull out the FASTA scaffolds that matched the gene I was looking for in the pile of scaffolds. Anyway: I fixed the script, and got the new reference, that is the same as the old one, but without the repetitive '>header' accidentally added 11 times. I ran BWA, no problem. I converted the SAM to BAM with samtools, no problem. But now I am trying to sort and index the BAM so I can look at it an whatnot, and the command I am running is:

    samtools sort M6scaff_BWA.bam M6scaff_BWA.bam.sorted

    the error I get is:

    [bam_sort_core] merging from 142 files...
    [W::bam_hdr_read] EOF marker is absent. The input is probably truncated.
    [E::hts_open] fail to open file 'M6scaff_BWA.sorted.0118.bam'
    [bam_merge_core] fail to open file M6scaff_BWA.sorted.0118.bam

    I have looked around the interwebs for a solution, and most of the people that have this error are using the -f argument in samtool sort, and when they remove it, it's fixed. I am not using the -f argument, so I have no recourse. Can someone please suggest something to try? I am banging my head against a wall for a whole weekend now, and I just don't know what to do.

    Thanks so much

  • #2
    Does the header on your BAM look right (when you do samtools view on it)? Are you running out of resources anywhere (/tmp, disk, memory etc) in this process? What is the size of the BAM file? What version of samtools are you using?


    • #3
      samtools view -H looks like this:

      @SQ SN:scaffold_829 LN:219473
      @SQ SN:scaffold_4279 LN:55059
      @PG ID:bwa PN:bwa VN:0.7.5a-r405

      (the scaffold_###) is the fasta header in my reference

      How could I check if I am running out of resources? Does anything like that get printed in the log file somewhere? I re-ran the sort with -m 8GB to ensure that it wouldn't run out of RAM (16 on the machine) but I got this error:

      [E::hts_open] fail to open file 'M6scaff_BWA.bam.sorted.0001.bam'

      The BAM is 25G

      samtools v 1.2

      Thanks for the help. Anything helps at this point.

      Edit: I can see the temporary M6scaff_BWA.bam.sorted.####.bam files in the folder, Why then, would it have trouble opening it?
      Last edited by nimrod337; 04-20-2015, 11:09 AM. Reason: New info


      • #4
        That header looks good. Is it possible for you to try the older version of samtools (0.1.19) for the sort? If you are certain ample disk space is available then this may be worth a try.


        • #5
          Unfortunately, I started on the older samtools, and upgraded to 1.2 to see if that fixed the problem. It did not. I have cleared up some disk space, and rebooted to clear the RAM. Cross your fingers!!


          Latest Articles


          • seqadmin
            Advanced Methods for the Detection of Infectious Disease
            by seqadmin

            The recent pandemic caused worldwide health, economic, and social disruptions with its reverberations still felt today. A key takeaway from this event is the need for accurate and accessible tools for detecting and tracking infectious diseases. Timely identification is essential for early intervention, managing outbreaks, and preventing their spread. This article reviews several valuable tools employed in the detection and surveillance of infectious diseases.
            Yesterday, 01:15 PM
          • seqadmin
            Strategies for Investigating the Microbiome
            by seqadmin

            Microbiome research has led to the discovery of important connections to human and environmental health. Sequencing has become a core investigational tool in microbiome research, a subject that we covered during a recent webinar. Our expert speakers shared a number of advancements including improved experimental workflows, research involving transmission dynamics, and invaluable analysis resources. This article recaps their informative presentations, offering insights...
            11-09-2023, 07:02 AM





          Topics Statistics Last Post
          Started by seqadmin, Yesterday, 08:12 AM
          0 responses
          Last Post seqadmin  
          Started by seqadmin, 11-22-2023, 09:29 AM
          1 response
          Last Post VilliamPast  
          Started by seqadmin, 11-22-2023, 08:53 AM
          0 responses
          Last Post seqadmin  
          Started by seqadmin, 11-21-2023, 08:24 AM
          0 responses
          Last Post seqadmin