Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • thh32
    Member
    • Feb 2014
    • 60

    #1

    How to make all files joined?

    Basically I have 28 files of r1 and r2 data which I want merged. I am planning on using ea-utils fastq-join but am wondering if anyone knows of a way to make a program go through each pair of files joining them and then moving onto the next automatically?

    I have heard of for loops and was thinking of trying to write one but know very little so is it possible to get something like this working:

    for Library$_read1 and Library$_read2

    do fastq-join -p 1 -o Library$_merged

    done


    That way it could work its way through all the pairs of files using $ so it goes Library1, Library2 etc

    Any help would be greatly appreciated.

    Thanks,
    Tom
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    Tom: Following will need adjustment based on the exact file names you have but example below works for tcshell.

    Code:
    $ ls -1 *.fq
    test1_r1.fq
    test1_r2.fq
    test2_r1.fq
    test2_r2.fq
    test3_r1.fq
    test3_r2.fq
    
    $ foreach i ( `ls -1 *r1* | cut -d"_" -f1` )
    foreach? fastq-join $i\_r1.fq $i\_r2.fq -o $i\_merged.fq
    foreach? end
    For Bash (assuming the same file names above):

    Code:
    $ for A in `ls -1 *r1*`; do fastq-join "${A%%_*}"_r1.fq "${A%%_*}"_r2.fq -o "${A%%_*}"_combined.fq ;done
    Last edited by GenoMax; 04-30-2014, 05:08 AM. Reason: added example for bash shell

    Comment

    • volks
      Member
      • Jun 2010
      • 80

      #3
      i quite like xargs:
      Code:
      ls -1 *fq | cut -d _ -f 1 | sort | uniq | xargs -I '{}' -P 4 sh -c "echo processing '{}'; fastq-join '{}'_r1.fq '{}'_r2.fq -o '{}'_merged.fq"
      .. will run four commands in parallel.

      Comment

      • rnaeye
        Member
        • May 2011
        • 80

        #4
        I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

        cat file1 file2 file3 > combined-files.fastq

        Comment

        • GenoMax
          Senior Member
          • Feb 2008
          • 7142

          #5
          Originally posted by rnaeye View Post
          I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

          cat file1 file2 file3 > combined-files.fastq
          thh32 wants to use "fastq-join" utility from ea-utils that merges R1/R2 reads using the overlapping ends.

          Comment

          • rnaeye
            Member
            • May 2011
            • 80

            #6
            Thanks GenoMax. It seems to be a useful tool to have. Best,

            Comment

            Latest Articles

            Collapse

            • SEQadmin2
              Beyond CRISPR/Cas9: Understand, Choose, and Use the Right Genome Editing Tool
              by SEQadmin2



              CRISPR/Cas9 sparked the gene editing revolution for both research and therapeutics.1 But this system still showed severe issues that limited its applications. The most prominent were the heavy reliance on PAM sequences, delivery limitations, double-stranded breaks that prompt unintended edits and cell death, and editing inefficiency (both in targeting and in knock-in reliability).

              Despite this, “CRISPR helped turn genome editing from a specialized technique into
              ...
              07-31-2026, 11:01 AM
            • SEQadmin2
              Proteomic Platforms: How to Choose the Right Analytical Strategy to Improve Detection and Clinical Applications
              by SEQadmin2


              Proteomics platforms are evolving rapidly, with advances in mass spectrometry and affinity-based approaches expanding what researchers can detect and at what scale. As the field moves toward deeper proteome coverage and clinical applications, scientists face an increasingly complex landscape of tools. This article will explore how researchers are navigating these choices to find the right platform for their work.

              The systematic characterization of the human proteome has
              ...
              07-20-2026, 11:48 AM
            • SEQadmin2
              Advanced Sequencing Platforms Tackle Neuroscience’s Toughest Genomics Problems
              by SEQadmin2



              Genomics studies in neuroscience face a special challenge due to the brain’s complexity and scarcity of samples. Mapping changes in cell type and state using conventional next-generation sequencing methods remains challenging. Advances in technologies like single-cell sequencing, spatial transcriptomics, and long-read sequencing have opened the door to deeper studies of the brain and diseases like Alzheimer’s, amyotrophic lateral sclerosis (ALS), and schizophrenia.
              ...
              07-09-2026, 11:10 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by SEQadmin2, Yesterday, 07:41 AM
            0 responses
            12 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 08-03-2026, 10:13 AM
            0 responses
            27 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 07-31-2026, 02:55 AM
            0 responses
            39 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 07-24-2026, 12:17 PM
            0 responses
            25 views
            0 reactions
            Last Post SEQadmin2  
            Working...