Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • thh32
    Member
    • Feb 2014
    • 60

    #1

    How to make all files joined?

    Basically I have 28 files of r1 and r2 data which I want merged. I am planning on using ea-utils fastq-join but am wondering if anyone knows of a way to make a program go through each pair of files joining them and then moving onto the next automatically?

    I have heard of for loops and was thinking of trying to write one but know very little so is it possible to get something like this working:

    for Library$_read1 and Library$_read2

    do fastq-join -p 1 -o Library$_merged

    done


    That way it could work its way through all the pairs of files using $ so it goes Library1, Library2 etc

    Any help would be greatly appreciated.

    Thanks,
    Tom
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    Tom: Following will need adjustment based on the exact file names you have but example below works for tcshell.

    Code:
    $ ls -1 *.fq
    test1_r1.fq
    test1_r2.fq
    test2_r1.fq
    test2_r2.fq
    test3_r1.fq
    test3_r2.fq
    
    $ foreach i ( `ls -1 *r1* | cut -d"_" -f1` )
    foreach? fastq-join $i\_r1.fq $i\_r2.fq -o $i\_merged.fq
    foreach? end
    For Bash (assuming the same file names above):

    Code:
    $ for A in `ls -1 *r1*`; do fastq-join "${A%%_*}"_r1.fq "${A%%_*}"_r2.fq -o "${A%%_*}"_combined.fq ;done
    Last edited by GenoMax; 04-30-2014, 05:08 AM. Reason: added example for bash shell

    Comment

    • volks
      Member
      • Jun 2010
      • 80

      #3
      i quite like xargs:
      Code:
      ls -1 *fq | cut -d _ -f 1 | sort | uniq | xargs -I '{}' -P 4 sh -c "echo processing '{}'; fastq-join '{}'_r1.fq '{}'_r2.fq -o '{}'_merged.fq"
      .. will run four commands in parallel.

      Comment

      • rnaeye
        Member
        • May 2011
        • 80

        #4
        I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

        cat file1 file2 file3 > combined-files.fastq

        Comment

        • GenoMax
          Senior Member
          • Feb 2008
          • 7142

          #5
          Originally posted by rnaeye View Post
          I am not sure if I understood your question completely, but if you are doing end to end joining you can simply use Unix cat like below:

          cat file1 file2 file3 > combined-files.fastq
          thh32 wants to use "fastq-join" utility from ea-utils that merges R1/R2 reads using the overlapping ends.

          Comment

          • rnaeye
            Member
            • May 2011
            • 80

            #6
            Thanks GenoMax. It seems to be a useful tool to have. Best,

            Comment

            Latest Articles

            Collapse

            • SEQadmin2
              Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
              by SEQadmin2



              Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

              Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
              ...
              10-14-2026, 09:55 AM
            • SEQadmin2
              New Genomics Technologies Take Aim at Long-Standing Limits
              by SEQadmin2


              Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

              We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
              ...
              09-28-2026, 10:25 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by SEQadmin2, 10-15-2026, 10:52 AM
            0 responses
            26 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 10-14-2026, 05:39 AM
            0 responses
            32 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 10-13-2026, 09:56 AM
            0 responses
            31 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 10-09-2026, 11:14 AM
            0 responses
            28 views
            0 reactions
            Last Post SEQadmin2  
            Working...