Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • thh32
    Member
    • Feb 2014
    • 60

    #1

    How to make all files joined?

    Basically I have 28 files of r1 and r2 data which I want merged. I am planning on using ea-utils fastq-join but am wondering if anyone knows of a way to make a program go through each pair of files joining them and then moving onto the next automatically?

    I have heard of for loops and was thinking of trying to write one but know very little so is it possible to get something like this working:

    for Library$_read1 and Library$_read2

    do fastq-join -p 1 -o Library$_merged

    done


    That way it could work its way through all the pairs of files using $ so it goes Library1, Library2 etc

    Any help would be greatly appreciated.

    Thanks,
    Tom
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    Tom: Following will need adjustment based on the exact file names you have but example below works for tcshell.

    Code:
    $ ls -1 *.fq
    test1_r1.fq
    test1_r2.fq
    test2_r1.fq
    test2_r2.fq
    test3_r1.fq
    test3_r2.fq
    
    $ foreach i ( `ls -1 *r1* | cut -d"_" -f1` )
    foreach? fastq-join $i\_r1.fq $i\_r2.fq -o $i\_merged.fq
    foreach? end
    For Bash (assuming the same file names above):

    Code:
    $ for A in `ls -1 *r1*`; do fastq-join "${A%%_*}"_r1.fq "${A%%_*}"_r2.fq -o "${A%%_*}"_combined.fq ;done
    Last edited by GenoMax; 04-30-2014, 05:08 AM. Reason: added example for bash shell

    Comment

    • volks
      Member
      • Jun 2010
      • 80

      #3
      i quite like xargs:
      Code:
      ls -1 *fq | cut -d _ -f 1 | sort | uniq | xargs -I '{}' -P 4 sh -c "echo processing '{}'; fastq-join '{}'_r1.fq '{}'_r2.fq -o '{}'_merged.fq"
      .. will run four commands in parallel.

      Comment

      • rnaeye
        Member
        • May 2011
        • 80

        #4
        I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

        cat file1 file2 file3 > combined-files.fastq

        Comment

        • GenoMax
          Senior Member
          • Feb 2008
          • 7142

          #5
          Originally posted by rnaeye View Post
          I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

          cat file1 file2 file3 > combined-files.fastq
          thh32 wants to use "fastq-join" utility from ea-utils that merges R1/R2 reads using the overlapping ends.

          Comment

          • rnaeye
            Member
            • May 2011
            • 80

            #6
            Thanks GenoMax. It seems to be a useful tool to have. Best,

            Comment

            Latest Articles

            Collapse

            • kinpict.com
              Reply to 16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
              by kinpict.com
              The part about this topic feels surprisingly grounded, and the details on the page is the bit that made me slow down. I’d keep <a href="https://kinpict.com/">ai family photo generator</a> bookmarked for later.
              Yesterday, 06:37 PM
            • SEQadmin2
              16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
              by SEQadmin2





              NGS has revolutionized clinical microbiology by offering new ways to identify and surveil pathogens without prior knowledge of the target. One popular approach is 16S rRNA and ITS amplicon sequencing, which targets specific microbial markers. But studies are increasingly incorporating shotgun metagenomics, a technique that sequences all DNA from a sample without targeting specific microbial markers. This approach allows more detailed taxonomic classification,...
              10-30-2026, 06:46 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by SEQadmin2, 11-12-2026, 07:59 AM
            0 responses
            29 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 11-05-2026, 09:25 AM
            0 responses
            36 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 11-03-2026, 11:54 AM
            2 responses
            60 views
            0 reactions
            Last Post kinpict.com  
            Started by SEQadmin2, 10-28-2026, 09:57 AM
            0 responses
            176 views
            0 reactions
            Last Post SEQadmin2  
            Working...