Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • jmpi
    Junior Member
    • Jul 2011
    • 3

    Merging Paired-End FastQ Files

    Hi,

    I want to merge the two corresponding FastQ files to get longer reads (with FLASh or COPE).

    It seems like I have to sort the FastQ files before.

    Does anyone have an idea how I can sort FastQ files by their identifier?

    Thank you.
  • yangliao
    Member
    • May 2013
    • 13

    #2
    If you want to sort the reads in every FastQ file by the read ids, I would like to use awk:

    # cat my_input.fastq | awk 'BEGIN{line_no=0;} line_no<=3{line_str = line_str $_ "\t"; line_no ++;} line_no == 4{print line_str; line_str="";line_no = 0}'| cut -f 1-4|sort -k 1,1 | sed 's/\t/\n/g' > my_output.fastq

    I tested this command on a short FastQ file; it should be OK for longer ones.
    Last edited by yangliao; 05-22-2013, 04:20 AM.

    Comment

    • kmcarr
      Senior Member
      • May 2008
      • 1181

      #3
      Originally posted by jmpi View Post
      Hi,

      I want to merge the two corresponding FastQ files to get longer reads (with FLASh or COPE).

      It seems like I have to sort the FastQ files before.

      Does anyone have an idea how I can sort FastQ files by their identifier?

      Thank you.
      First, what do you mean by "sorted" and are you sure you need to do any kind of sorting? All current sequencers output paired end read data in ordered files. By ordered I mean that the first read in the R1 file matches the first read in the R2 file, second R1 == second R2 and so on. This is what almost all tools which take paired input files expect. The reads do not have to "sorted" in any conventional sense (e.g. alphabetically, numerically) they just have to be in matched order.

      Unless something was done to your read files after they were output by the sequencer they will be in matched order and you shouldn't have to do anything with them to input them to FLASH or COPE.

      Comment

      • jmpi
        Junior Member
        • Jul 2011
        • 3

        #4
        I just found out that I did not get the original sequence. So, my problem is solved. Thank you both for your help.

        Comment

        Latest Articles

        Collapse

        • SEQadmin2
          From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
          by SEQadmin2


          Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


          The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
          ...
          Yesterday, 10:05 AM
        • SEQadmin2
          Single-Cell Sequencing at an Inflection Point: Early Impacts of New Platforms and Emerging Trends
          by SEQadmin2


          With the launch of new single-cell sequencing platforms in 2026, the field stands at an exciting inflection point. This article surveys the most impactful advances in the field and discusses how they’re reshaping research in cancer, immunology, and beyond.


          Introduction

          Single-cell sequencing technologies have undergone remarkable advances over the past decade, transitioning from low-throughput experimental approaches to highly scalable platforms capable of...
          05-22-2026, 06:42 AM
        • SEQadmin2
          Environmental Genomics in the Age of NGS: From Microbes to Conservation Strategies
          by SEQadmin2

          Studying ecosystems means dealing with complex, multi-species communities that are hard to observe at scale. This complexity, however, hides many important questions to be answered, from how biogeochemical cycles work and how climate change can affect species distribution to how conservation strategies can work best.


          Genomics, particularly since the expansion of NGS, has transformed ecosystem ecology. By sequencing environmental DNA, we can now assess biodiversity without direct...
          05-06-2026, 09:04 AM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by SEQadmin2, Yesterday, 12:03 PM
        0 responses
        19 views
        0 reactions
        Last Post SEQadmin2  
        Started by SEQadmin2, Yesterday, 11:40 AM
        0 responses
        14 views
        0 reactions
        Last Post SEQadmin2  
        Started by SEQadmin2, 05-28-2026, 11:40 AM
        0 responses
        29 views
        0 reactions
        Last Post SEQadmin2  
        Started by SEQadmin2, 05-26-2026, 10:12 AM
        0 responses
        31 views
        0 reactions
        Last Post SEQadmin2  
        Working...