Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • rohan_1925
    Junior Member
    • Dec 2013
    • 7

    merging two fastq files from exome sequencing

    Hi ,

    I have 50 samples,each having paired end reads,Do you know of using "cat" command of merging paired end reads for each sample in one command? for example merging the 2 files below in one command in this post using some regular expression?

    Discussion of next-gen sequencing related bioinformatics: resources, algorithms, open source efforts, etc



    Else I have to merge each sample one by one.

    Thanks,
    Rohan
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    If your file names follow some pattern then you can possibly use a shell script that can "cat" the files for the samples together using a loop. If you post representative example of the names then someone can help you.

    Now the question. Why do you want to do this? Most programs do not need the reads to be in a single file (in fact that may cause you problems down the road).

    Comment

    • rohan_1925
      Junior Member
      • Dec 2013
      • 7

      #3
      Hi,

      Below are some of the samples.

      51772BL1_R1.fastq
      51772BL1_R2.fastq
      51805BL1_R1.fastq
      51805BL1_R2.fastq
      52451BL1_R1.fastq
      52451BL1_R2.fastq


      Since,I am new to this kind of analysis and have dealt with very few files till now to set up my workflow, I did the analysis after merging the files only.
      Can you elaborate on what kind of problems might come so I can think more on this?


      Thanks

      Comment

      • vivek_
        PhD Student
        • Jul 2012
        • 164

        #4
        That example is not very helpful since looking at the file names, it appears that each Fwd/Rev fastq file appears to be from a different sample.

        You do not want to concatenate those prior to alignment and if you have a HPC cluster where you do the analysis, its much faster to do the alignments on multiple fastq files in parallel and then merge the alignments depending on your workflow.

        Comment

        • maubp
          Peter (Biopython etc)
          • Jul 2009
          • 1544

          #5
          It is also wise to keep track of the different samples/replicates for later analysis (for example it could be one of these samples/replicates has problems). This is much harder if you start by merging everything (pooling the reads).

          Comment

          Latest Articles

          Collapse

          • SEQadmin2
            From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
            by SEQadmin2


            Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


            The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
            ...
            Yesterday, 10:05 AM
          • SEQadmin2
            Single-Cell Sequencing at an Inflection Point: Early Impacts of New Platforms and Emerging Trends
            by SEQadmin2


            With the launch of new single-cell sequencing platforms in 2026, the field stands at an exciting inflection point. This article surveys the most impactful advances in the field and discusses how they’re reshaping research in cancer, immunology, and beyond.


            Introduction

            Single-cell sequencing technologies have undergone remarkable advances over the past decade, transitioning from low-throughput experimental approaches to highly scalable platforms capable of...
            05-22-2026, 06:42 AM
          • SEQadmin2
            Environmental Genomics in the Age of NGS: From Microbes to Conservation Strategies
            by SEQadmin2

            Studying ecosystems means dealing with complex, multi-species communities that are hard to observe at scale. This complexity, however, hides many important questions to be answered, from how biogeochemical cycles work and how climate change can affect species distribution to how conservation strategies can work best.


            Genomics, particularly since the expansion of NGS, has transformed ecosystem ecology. By sequencing environmental DNA, we can now assess biodiversity without direct...
            05-06-2026, 09:04 AM

          ad_right_rmr

          Collapse

          News

          Collapse

          Topics Statistics Last Post
          Started by SEQadmin2, Yesterday, 12:03 PM
          0 responses
          19 views
          0 reactions
          Last Post SEQadmin2  
          Started by SEQadmin2, Yesterday, 11:40 AM
          0 responses
          14 views
          0 reactions
          Last Post SEQadmin2  
          Started by SEQadmin2, 05-28-2026, 11:40 AM
          0 responses
          29 views
          0 reactions
          Last Post SEQadmin2  
          Started by SEQadmin2, 05-26-2026, 10:12 AM
          0 responses
          31 views
          0 reactions
          Last Post SEQadmin2  
          Working...