Data format of NGS file

[ron128]

At least from the 2 reads you posted it looks like phred+64, so some variant of illumina before 1.8. You can get an idea of whether it's Solexa by just grepping for ">" or "?", which won't be present in any of the Illumina formats that have offsets of 64.

BTW, it's already a fastq file, you just need to let your aligner know how the quality scores are encoded (though many of the newer aligners only support phred+33).

@ Mr Ryan: I might be mistaken, but i was kinda certain thats not a fastq format file. If you look at the fourth line, it has these weird stretches of "________" characters. what gives? I have not come across such a fastq file, with my limited expertise.

Besides this, when I use a qc program like prinseq, to perform basic QC, it gives me the following error:
"ERROR: input file for -fastq is in UNKNOWN format not in FASTQ format. Exit program."

I wonder what could be the issue here. At first I thought this might be an unix issue, so I ran dos2unix on the files. however prinseq is not able to recognize these files anyways. Thanks for your input Mr Ryan

[GenoMax]

hi, my research is going on short read sequence alignment . how to g.et online short read alignment tools and input data format

Most prevalent input data format is FASTQ: http://en.wikipedia.org/wiki/FASTQ_format

List of NGS tools (look for aligners): http://seqanswers.com/wiki/Software/list

Data can be downloaded from: http://www.ncbi.nlm.nih.gov/sra

[rajajjcet]

short read alignment tools ?

hi, my research is going on short read sequence alignment . how to g.et online short read alignment tools and input data format

Hello,
I have been dealing with some strange data recently. I suspect this might be illumina's older casava (pre 1.8) output from the GAIIX. unfortunately the lab where i work at has no clue about this data, and the service provider has shut shop Can anybody tell me in their experience, what data format is it? I assumed it to be the older solexa data format and tried to convert it to fastq using maq sol2sanger, but I am getting an error which goes like:

"Inconsistent sequence name: HWUSI-EAS1642R_0000:5:1:2782:993#GATCAG/1. Continue anyway.
Segmentation fault (core dumped)"


Sample file:

@HWUSI-EAS1642R_0000:5:1:2782:993#GATCAG/1
NCATTAAAGCAATCATCCATCCTGACCAAGTAGGTTTTATTCCAGGAATGCAGGGATGGTTTAATATACGAAAATCCATCAATGTAATCCACTATATAAA
+HWUSI-EAS1642R_000:5:1:2782:993#GATCAG/1
BGIFGHIHHI[W[YYVYYYYY[Y[[YYYYY[[[Y[VVPVOQQ____________TTVVTVYYYYYYYYYRWWWWW___Y_____PYYYYYWWPWWYYVYR
@HWUSI-EAS1642R_0000:5:1:3250:998#GATCAG/1
NACTATCCAGAGTCACTCAAAAGGGAGACAAGCACTTGGTGCCACATCAACACAAAACTCATAAGAGCTAGAAACACACTCAAAATTGATCATTAATATA
+HWUSI-EAS1642R_000:5:1:3250:998#GATCAG/1
BIGKMLLQRN_________WV___________________NRRTR_Y_________QQY________________[Y[[PWWWWW[YY[[WYYWY_____

ANy inputs will be much appreciated. Thanks!

[paa6]

Thanks a lot for your insight sir! however like i mentioned, the service provider has folded, and the only access to data that we have is this data here. Is there any way I can convert this data to .fastq format? What IS this data format anyways? Thanks for taking the time out to reply. Much Appreciated

ahhh no need to be formal by the way...and I am not sir..I am mam...I have analysed ur file and this is fastq file...and use fastqc for analysis of ur sequence before doing anything further....

http://www.bioinformatics.babraham.ac.uk/projects/fastqc/

[dpryan]

At least from the 2 reads you posted it looks like phred+64, so some variant of illumina before 1.8. You can get an idea of whether it's Solexa by just grepping for ">" or "?", which won't be present in any of the Illumina formats that have offsets of 64.

BTW, it's already a fastq file, you just need to let your aligner know how the quality scores are encoded (though many of the newer aligners only support phred+33).

[ron128]

HMM I will suggest u not to convert the file format because it's really useless from my experience in this case. I had the same problem and infact what i faced that after converting it into fastq i got NNNNN like this kind of bases all over in my reads... so it's kind of very risky...n I will suggest u to get fastq file...for further work else no use...ggod luck
!!!

Thanks a lot for your insight sir! however like i mentioned, the service provider has folded, and the only access to data that we have is this data here. Is there any way I can convert this data to .fastq format? What IS this data format anyways? Thanks for taking the time out to reply. Much Appreciated

[paa6]

A google search for this error reveals the following, but I am not sure how fiddling with original sequencer output files, or raw fastq files will work out.

http://sourceforge.net/p/maq/mailman...u-tokyo.ac.jp/

HMM I will suggest u not to convert the file format because it's really useless from my experience in this case. I had the same problem and infact what i faced that after converting it into fastq i got NNNNN like this kind of bases all over in my reads... so it's kind of very risky...n I will suggest u to get fastq file...for further work else no use...ggod luck
!!!

[ron128]

A google search for this error reveals the following, but I am not sure how fiddling with original sequencer output files, or raw fastq files will work out.

http://sourceforge.net/p/maq/mailman/maq-help/thread/[email protected]/

[ron128]

Hello,
I have been dealing with some strange data recently. I suspect this might be illumina's older casava (pre 1.8) output from the GAIIX. unfortunately the lab where i work at has no clue about this data, and the service provider has shut shop Can anybody tell me in their experience, what data format is it? I assumed it to be the older solexa data format and tried to convert it to fastq using maq sol2sanger, but I am getting an error which goes like:

"Inconsistent sequence name: HWUSI-EAS1642R_0000:5:1:2782:993#GATCAG/1. Continue anyway.
Segmentation fault (core dumped)"


Sample file:

@HWUSI-EAS1642R_0000:5:1:2782:993#GATCAG/1
NCATTAAAGCAATCATCCATCCTGACCAAGTAGGTTTTATTCCAGGAATGCAGGGATGGTTTAATATACGAAAATCCATCAATGTAATCCACTATATAAA
+HWUSI-EAS1642R_000:5:1:2782:993#GATCAG/1
BGIFGHIHHI[W[YYVYYYYY[Y[[YYYYY[[[Y[VVPVOQQ____________TTVVTVYYYYYYYYYRWWWWW___Y_____PYYYYYWWPWWYYVYR
@HWUSI-EAS1642R_0000:5:1:3250:998#GATCAG/1
NACTATCCAGAGTCACTCAAAAGGGAGACAAGCACTTGGTGCCACATCAACACAAAACTCATAAGAGCTAGAAACACACTCAAAATTGATCATTAATATA
+HWUSI-EAS1642R_000:5:1:3250:998#GATCAG/1
BIGKMLLQRN_________WV___________________NRRTR_Y_________QQY________________[Y[[PWWWWW[YY[[WYYWY_____

ANy inputs will be much appreciated. Thanks!