Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • yumtaoist
    Member
    • Dec 2011
    • 10

    Bowtie2 cannot read gzip format files

    Hey, everyone!

    The help document of bowtie2 have said that the files of reads could be gzip'ed.

    When I use the paired reads and try the argument ( -1 <m1> -2 <m2>), the bowtie2 can read the gzip'ed files.

    However, if I use the gzip'ed unpaired reads and apply the argument (-U <r>), the bowtie2 suggest that "Error: reads file does not look like a FASTQ file". The gzip'ed file can not be recognized.

    Does anyone have come up with this problem?

    Thank You!
  • earonesty
    Member
    • Mar 2011
    • 52

    #2
    # HOW to add GUNZIP support to ANY program that doesn't have it:

    mkfifo file1.fifo
    mkfifo file2.fifo
    gunzip file1.gz > file.fifo &
    gunzip file2.gz > file.fifo &
    bowtie -1 file1.fifo -2 file2.fifo

    Comment

    • yumtaoist
      Member
      • Dec 2011
      • 10

      #3
      Originally posted by earonesty View Post
      # HOW to add GUNZIP support to ANY program that doesn't have it:

      mkfifo file1.fifo
      mkfifo file2.fifo
      gunzip file1.gz > file.fifo &
      gunzip file2.gz > file.fifo &
      bowtie -1 file1.fifo -2 file2.fifo
      Thank You Very Much!

      This is very useful!

      Comment

      • gringer
        David Eccles (gringer)
        • May 2011
        • 845

        #4
        Originally posted by earonesty View Post
        # HOW to add GUNZIP support to ANY program that doesn't have it:

        mkfifo file1.fifo
        mkfifo file2.fifo
        gunzip file1.gz > file.fifo &
        gunzip file2.gz > file.fifo &
        bowtie -1 file1.fifo -2 file2.fifo
        In many cases this will work, but not all cases. This doesn't work for programs that attempt to seek through files (low-memory fastq randomisation being one example that I've recently seen).

        Comment

        • dsenalik
          Carrot Scientist
          • Nov 2009
          • 42

          #5
          I needed to add a "-c" to that command, otherwise gunzip will delete the original compressed file, i.e.
          Code:
          mkfifo file1.fifo
          mkfifo file2.fifo
          gunzip -c file1.gz > file1.fifo &
          gunzip -c file2.gz > file2.fifo &

          Comment

          • earonesty
            Member
            • Mar 2011
            • 52

            #6
            Originally posted by dsenalik View Post
            I needed to add a "-c" to that command, otherwise gunzip will delete the original compressed file, i.e.
            Code:
            mkfifo file1.fifo
            mkfifo file2.fifo
            gunzip -c file1.gz > file1.fifo &
            gunzip -c file2.gz > file2.fifo &


            this patch fixes fifo support, and also adds built-in gzip support to bowtie 1.0 (which remains the fastest, fastq->sam program out there)

            An ultrafast memory-efficient short read aligner. Contribute to earonesty/bowtie development by creating an account on GitHub.

            Comment

            • westerman
              Rick Westerman
              • Jun 2008
              • 1104

              #7
              FYI, zcat is often a shortcut to 'gunzip -c'

              Also under BASH you should be able do something like:

              bowtie -1 <( zcat file1.gz ) -2 <( zcat file2.gz )

              or in the original posters question

              bowtie2 -U <( zcat file.gz )

              Comment

              • earonesty
                Member
                • Mar 2011
                • 52

                #8
                actually there's a bug in bowtie ... a race condition that can make it unreliable. you should not use fifo's unless you used the patched version that supports them

                An ultrafast memory-efficient short read aligner. Contribute to earonesty/bowtie development by creating an account on GitHub.

                Comment

                Latest Articles

                Collapse

                • SEQadmin2
                  Nine Things a Sample Prep Scientist Thinks About Before Sequencing
                  by SEQadmin2


                  I’m not a sequencing expert. I’m a purification scientist who uses NGS to evaluate workflows my group develops. With this perspective, we think about the sample first and the NGS workflow second. The sequencer is an exceptionally honest reporter, but it can only report on what you give it, so whether you get clean, interpretable data from an NGS workflow is largely determined before you begin.

                  Here are nine questions we think about, in roughly the order they matter, before...
                  06-18-2026, 07:11 AM
                • SEQadmin2
                  From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
                  by SEQadmin2


                  Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


                  The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
                  ...
                  06-02-2026, 10:05 AM

                ad_right_rmr

                Collapse

                News

                Collapse

                Topics Statistics Last Post
                Started by SEQadmin2, 06-17-2026, 06:09 AM
                0 responses
                40 views
                0 reactions
                Last Post SEQadmin2  
                Started by SEQadmin2, 06-09-2026, 11:58 AM
                0 responses
                102 views
                0 reactions
                Last Post SEQadmin2  
                Started by SEQadmin2, 06-05-2026, 10:09 AM
                0 responses
                123 views
                0 reactions
                Last Post SEQadmin2  
                Started by SEQadmin2, 06-04-2026, 08:59 AM
                0 responses
                114 views
                0 reactions
                Last Post SEQadmin2  
                Working...