Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Capturing bowtie stats / samtools pipe / file IO?

    Hi all,

    I've been working on tweaking our NGS analysis pipeline and came across this minor issue for which I could not find a solution.

    The current pipeline scripts do some I/O redirection (2>&1) to capture the stats from bowtie alignment (which are printed to stderr): This works fine if you simply issue a command to run bowtie.

    bowtie -q -S index fqsequence >> stats.txt 2>&1

    stats.txt
    # reads processed: 1679207
    # reads with at least one reported alignment: 1487157 (88.56%)
    # reads that failed to align: 155467 (9.26%)
    # reads with alignments suppressed due to -m: 36583 (2.18%)
    Reported 1487157 alignments to 1 output stream(s)

    As part of the upgrade, I want to pipe the bowtie output directly to SAMtools (instead of creating an intermediate SAM file) to produce the BAM file on the fly. No problem, this also works fine.

    bowtie -q -S index fqsequence | samtools view -bS -o testoutput.bam -

    [samopen] SAM header is present: 14543 sequences.
    # reads processed: 1679207
    # reads with at least one reported alignment: 1487157 (88.56%)
    # reads that failed to align: 155467 (9.26%)
    # reads with alignments suppressed due to -m: 36583 (2.18%)
    Reported 1487157 alignments to 1 output stream(s)

    I figured it would be easy to capture the stderr output from this pipe and send it to the stats file as before, but appending this command with >> stats.txt 2>&1 only shunts the SAMtools information to the file. The bowtie stats are still printed to the screen. I've played around with the i/o redirect commands and can't get it to work. Any suggestions?

    bowtie -q -S index fqsequence | samtools view -bS -o testoutput.bam - >> stats.txt 2>&1

    stats.txt
    [samopen] SAM header is present: 14543 sequences.

    screen output:
    # reads processed: 1679207
    # reads with at least one reported alignment: 1487157 (88.56%)
    # reads that failed to align: 155467 (9.26%)
    # reads with alignments suppressed due to -m: 36583 (2.18%)
    Reported 1487157 alignments to 1 output stream(s)

  • #2
    demo.pl
    Code:
    #! /usr/bin/perl
    print STDERR "error";
    print "out";
    Code:
    ./demo.pl 2> stderr.txt | cat > stdout.txt

    Comment


    • #3
      Thanks for the example... hadn't thought of piping the output to cat, but unfortunately, that syntax didn't work either.

      Comment


      • #4
        (bowtie genome --sam <(gunzip -c file.fastq.gz) | samtools view -bS -o results.bam - ) 2> bowtie.err

        This worked for me (with bash).

        There may also be some way to use tee here, but I don't know exactly.

        I know how to use tee to write the output (standard output) of aaa.sh to bbb.out, while still displaying it in the terminal: ./aaa.sh | tee bbb.out How would I now also write standard error to a f...
        Last edited by mgogol; 09-22-2011, 07:28 AM.

        Comment

        Latest Articles

        Collapse

        • seqadmin
          Best Practices for Single-Cell Sequencing Analysis
          by seqadmin



          While isolating and preparing single cells for sequencing was historically the bottleneck, recent technological advancements have shifted the challenge to data analysis. This highlights the rapidly evolving nature of single-cell sequencing. The inherent complexity of single-cell analysis has intensified with the surge in data volume and the incorporation of diverse and more complex datasets. This article explores the challenges in analysis, examines common pitfalls, offers...
          06-06-2024, 07:15 AM
        • seqadmin
          Latest Developments in Precision Medicine
          by seqadmin



          Technological advances have led to drastic improvements in the field of precision medicine, enabling more personalized approaches to treatment. This article explores four leading groups that are overcoming many of the challenges of genomic profiling and precision medicine through their innovative platforms and technologies.

          Somatic Genomics
          “We have such a tremendous amount of genetic diversity that exists within each of us, and not just between us as individuals,”...
          05-24-2024, 01:16 PM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by seqadmin, Yesterday, 06:54 AM
        0 responses
        10 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 06-14-2024, 07:24 AM
        0 responses
        16 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 06-13-2024, 08:58 AM
        0 responses
        16 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 06-12-2024, 02:20 PM
        0 responses
        17 views
        0 likes
        Last Post seqadmin  
        Working...
        X