Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • splitting big paired fastq files

    Hi there,
    I do my 'bioinformatic' work in CLC. Now I sit with many (30) large files with paired end reads (~10GB each direction) and my computer is stalling if I'd try to use all in a de novo assembly. Hence, I am looking for a tool to split the files in, say, 4.
    I am afraid I am not familiar with the linux world. So, I am lookiing for scripts (R preferably, or Perl) that would solve this?

    Thank you.
    jd

  • #2
    If you split your fastq, you aren't going to get a good assembly. You really want a computer with more memory, so it can handle the whole fatq.

    If you really need to split it, use unix built-in programs.

    Code:
    split -l 40000000 myfastq.fq
    should split it into separate files, each with 40,000,000 lines, or 10 million reads.

    Comment


    • #3
      Thank you for your prompt reply!
      There are 150-200 mill reads in each of the paired fastq files and I just expected that to be quite redundant.

      Comment

      Latest Articles

      Collapse

      • seqadmin
        Advanced Methods for the Detection of Infectious Disease
        by seqadmin




        The recent pandemic caused worldwide health, economic, and social disruptions with its reverberations still felt today. A key takeaway from this event is the need for accurate and accessible tools for detecting and tracking infectious diseases. Timely identification is essential for early intervention, managing outbreaks, and preventing their spread. This article reviews several valuable tools employed in the detection and surveillance of infectious diseases.
        ...
        11-27-2023, 01:15 PM
      • seqadmin
        Strategies for Investigating the Microbiome
        by seqadmin




        Microbiome research has led to the discovery of important connections to human and environmental health. Sequencing has become a core investigational tool in microbiome research, a subject that we covered during a recent webinar. Our expert speakers shared a number of advancements including improved experimental workflows, research involving transmission dynamics, and invaluable analysis resources. This article recaps their informative presentations, offering insights...
        11-09-2023, 07:02 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by seqadmin, 12-05-2023, 02:24 PM
      0 responses
      17 views
      0 likes
      Last Post seqadmin  
      Started by seqadmin, 12-05-2023, 07:37 AM
      0 responses
      27 views
      0 likes
      Last Post seqadmin  
      Started by seqadmin, 12-04-2023, 08:23 AM
      0 responses
      13 views
      0 likes
      Last Post seqadmin  
      Started by seqadmin, 12-01-2023, 09:55 AM
      0 responses
      26 views
      0 likes
      Last Post seqadmin  
      Working...
      X