Seqanswers Leaderboard Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • thh32
    Member
    • Feb 2014
    • 60

    How to make all files joined?

    Basically I have 28 files of r1 and r2 data which I want merged. I am planning on using ea-utils fastq-join but am wondering if anyone knows of a way to make a program go through each pair of files joining them and then moving onto the next automatically?

    I have heard of for loops and was thinking of trying to write one but know very little so is it possible to get something like this working:

    for Library$_read1 and Library$_read2

    do fastq-join -p 1 -o Library$_merged

    done


    That way it could work its way through all the pairs of files using $ so it goes Library1, Library2 etc

    Any help would be greatly appreciated.

    Thanks,
    Tom
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    Tom: Following will need adjustment based on the exact file names you have but example below works for tcshell.

    Code:
    $ ls -1 *.fq
    test1_r1.fq
    test1_r2.fq
    test2_r1.fq
    test2_r2.fq
    test3_r1.fq
    test3_r2.fq
    
    $ foreach i ( `ls -1 *r1* | cut -d"_" -f1` )
    foreach? fastq-join $i\_r1.fq $i\_r2.fq -o $i\_merged.fq
    foreach? end
    For Bash (assuming the same file names above):

    Code:
    $ for A in `ls -1 *r1*`; do fastq-join "${A%%_*}"_r1.fq "${A%%_*}"_r2.fq -o "${A%%_*}"_combined.fq ;done
    Last edited by GenoMax; 04-30-2014, 05:08 AM. Reason: added example for bash shell

    Comment

    • volks
      Member
      • Jun 2010
      • 80

      #3
      i quite like xargs:
      Code:
      ls -1 *fq | cut -d _ -f 1 | sort | uniq | xargs -I '{}' -P 4 sh -c "echo processing '{}'; fastq-join '{}'_r1.fq '{}'_r2.fq -o '{}'_merged.fq"
      .. will run four commands in parallel.

      Comment

      • rnaeye
        Member
        • May 2011
        • 80

        #4
        I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

        cat file1 file2 file3 > combined-files.fastq

        Comment

        • GenoMax
          Senior Member
          • Feb 2008
          • 7142

          #5
          Originally posted by rnaeye View Post
          I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

          cat file1 file2 file3 > combined-files.fastq
          thh32 wants to use "fastq-join" utility from ea-utils that merges R1/R2 reads using the overlapping ends.

          Comment

          • rnaeye
            Member
            • May 2011
            • 80

            #6
            Thanks GenoMax. It seems to be a useful tool to have. Best,

            Comment

            Latest Articles

            Collapse

            • seqadmin
              New Genomics Tools and Methods Shared at AGBT 2025
              by seqadmin


              This year’s Advances in Genome Biology and Technology (AGBT) General Meeting commemorated the 25th anniversary of the event at its original venue on Marco Island, Florida. While this year’s event didn’t include high-profile musical performances, the industry announcements and cutting-edge research still drew the attention of leading scientists.

              The Headliner
              The biggest announcement was Roche stepping back into the sequencing platform market. In the years since...
              03-03-2025, 01:39 PM
            • seqadmin
              Investigating the Gut Microbiome Through Diet and Spatial Biology
              by seqadmin




              The human gut contains trillions of microorganisms that impact digestion, immune functions, and overall health1. Despite major breakthroughs, we’re only beginning to understand the full extent of the microbiome’s influence on health and disease. Advances in next-generation sequencing and spatial biology have opened new windows into this complex environment, yet many questions remain. This article highlights two recent studies exploring how diet influences microbial...
              02-24-2025, 06:31 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by seqadmin, 03-20-2025, 05:03 AM
            0 responses
            17 views
            0 reactions
            Last Post seqadmin  
            Started by seqadmin, 03-19-2025, 07:27 AM
            0 responses
            18 views
            0 reactions
            Last Post seqadmin  
            Started by seqadmin, 03-18-2025, 12:50 PM
            0 responses
            19 views
            0 reactions
            Last Post seqadmin  
            Started by seqadmin, 03-03-2025, 01:15 PM
            0 responses
            185 views
            0 reactions
            Last Post seqadmin  
            Working...