I wonder if anyone knows about tools that allow splitting large fastq into smaller chunks. I found a couple scripts that split fasta, but not fastq.
Unconfigured Ad
Collapse
X
-
in unix use:
wc -l filename ### gets the number of lines
Then calculate how many lines you want in each smaller chunk to generate clean divisions of the data
Then:
split -l {number of lines to split} filename
Comment
-
Last edited by Guest; 02-04-2013, 06:51 AM.
Comment
-
If you aren't using Unix, you can get Unix tools by installing Cygwin.
Like people said, fastq is just a text file, anything that can split a text file will split a fastq file.
sed is generally slower than split, but you could try it:
the "p" after "end" means print, the "-n" means only print the selected lines, if you leave it out the original file is copied over and the selected lines appended to it (so don't leave it out).Code:sed -n 'start,endp' infile > outfile
e.g. you want a file with a million lines starting from the 4 millionth line:
Code:sed -n '4000000,5000000p' infile > outfile
Last edited by Jeremy; 02-05-2013, 11:31 PM.
Comment
Latest Articles
Collapse
-
by SEQadmin2
NGS has revolutionized clinical microbiology by offering new ways to identify and surveil pathogens without prior knowledge of the target. One popular approach is 16S rRNA and ITS amplicon sequencing, which targets specific microbial markers. But studies are increasingly incorporating shotgun metagenomics, a technique that sequences all DNA from a sample without targeting specific microbial markers. This approach allows more detailed taxonomic classification,...-
Channel: Articles
10-30-2026, 06:46 AM -
ad_right_rmr
Collapse
News
Collapse
| Topics | Statistics | Last Post | ||
|---|---|---|---|---|
|
Started by SEQadmin2, Yesterday, 07:59 AM
|
0 responses
18 views
0 reactions
|
Last Post
by SEQadmin2
Yesterday, 07:59 AM
|
||
|
Started by SEQadmin2, 11-05-2026, 09:25 AM
|
0 responses
32 views
0 reactions
|
Last Post
by SEQadmin2
11-05-2026, 09:25 AM
|
||
|
Started by SEQadmin2, 11-03-2026, 11:54 AM
|
0 responses
47 views
0 reactions
|
Last Post
by SEQadmin2
11-03-2026, 11:54 AM
|
||
|
Genome Sequencing Reveals Large, Repeat-Rich DNA in Trapdoor Spider Named for Stephen Colbert
by SEQadmin2
Started by SEQadmin2, 10-28-2026, 09:57 AM
|
0 responses
173 views
0 reactions
|
Last Post
by SEQadmin2
10-28-2026, 09:57 AM
|
Comment