Varscan VCF output bugs(?)

[dkoboldt]

Hello all,

Thank you for following up on this issue -- we certainly do want VarScan's VCF output to meet the specification. I believe that I've already addressed the missing QUAL field, and the way that indels are represented, but I'll need to verify that the alleles-separated-by-slash issue was addressed so that they're separated by commas in VCF output. There will almost certainly be a new release soon that addresses these issues.

Olivia, would you mind sending me your script to dkoboldt (at) genome [dot] wustl [dot] edu ? I could use that to determine if more changes are necessary to meet VCF compliance.

[oliviajm]

Hi Thon,

I've solved the problem by writing a small script to convert the files obtained with VarScan in the "right" vcf format. By this way, it's OK with Annovar.

Concerning the str10 values that you see, they're not in the Qual field, but in the Filter one and mean that this variation would not pass the filter "Less than 10% or more than 90% of variant supporting reads on one strand".
And the Qual field is missing. There should be a "." in this column.

Hope it will help you.

Olivia

[thondeboer]

Problem with VCF file produced by VarScan

I also see the problem with the + and - values for the ALT allele in the VCF produced by VarScan...

I also see "str10' appear in some of the Qual fields as well (See Below).
This does not always appear with the InDels....

i think the +A is to try to signify an insertion, but that needs to be defined as G GA if the A is an insertion after the G...

Conversely, a deletion always includes the base that is left

So: GATC G is a deletion of the 3 bases AFTER the G...

1	228405118	.	G	+A	.	str10	ADP=29;WT=0;HET=0;HOM=1;NC=0	GT:GQ:SDP:DP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR	1/1:0:29:29:1:28:96.55%:9.8E-1:28:30:0:1:0:28
1	237730169	.	C	T	.	str10	ADP=58;WT=0;HET=0;HOM=1;NC=0	GT:GQ:SDP:DP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR	1/1:0:67:58:0:58:100%:9.8E-1:0:17:0:0:3:55

Thanks,

Thon

[oliviajm]

Hi,

I'm wondering if it's valid vcf too.
Actually, the vcf format in the varscan output looks like

chr1 14454194 . C G . str10 ADP=11;WT=0;HET=0;HOM=1;NC=0 GT:GQ:SDPP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR 1/1:5:11:11:0:11:100%:1,4176E-6:0:25:0:0:11:0
chr1 16300817 . A -T . PASS ADP=14;WT=0;HET=1;HOM=0;NC=0 GT:GQ:SDPP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR 0/1:4:14:14:4:10:71,43%:7,6278E-5:40:40:4:0:10:0
chr1 16459021 . G +CA . PASS ADP=13;WT=0;HET=1;HOM=0;NC=0 GT:GQ:SDPP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR 0/1:3:16:13:3:8:53,33%:5,16E-4:40:30:3:0:0:8

But on the vcf format reference page on the 1000genome website (http://www.1000genomes.org/wiki/Anal...mat-version-41) there is no "+CA" or "-T" in the fourth column, but only letters (sometimes separated by a comma, but never with a + or a -).

I'm using annovar after varscan and I get some weird results (no insertion or deletion) and I'm wondering if this strange behaviour could come from this format differences. Does anyone have met the same kind of problem?


Olivia

[tommivat]

Further output problems

Hi,

I was processing varscan vcf output with GATK and got the following error:

##### ERROR MESSAGE: The provided VCF file is malformed at approximately line number 1479: Unparsable vcf record with allele T/C

Apparently, T/C is not valid vcf. Any plans of correcting this in the near future?

br,
Tommi

[dkoboldt]

Hello, I'm the developer of VarScan and this appears to be a bug affecting mpileup2snp, mpileup2indel, and mpileup2cns but not the somatic functions. The QUAL field should contain an empty character (".") but is skipped altogether.

I've already put in a fix and will push that out as soon as possible.

At present, the QUAL value will remain an empty value for multi-sample calling in VarScan. This meets VCF specification, and it seems most appropriate since it's difficult to assess the overall quality of a variant called across multiple samples.

If you have further questions, feel free to e-mail me directly: dkoboldt (at) genome (dot) wustl (dot) edu.

[skilpinen]

Update on the issue

Interestingly, apparently data was not phred+33 even though Tophat claimed so... conversion to phred+33 and redo everything:


##fileformat=VCFv4.0
##source=VarScan2
##INFO=<ID=DP,Number=1,Type=Integer,Description="Total Depth">
##FILTER=<ID=str10,Description="Less than 10% or more than 90% of variant supporting reads on one strand">
##FORMAT=<ID=GT,Number=1,Type=String,Description="Genotype">
##FORMAT=<ID=GQ,Number=1,Type=Integer,Description="Genotype Quality">
##FORMAT=<ID=DP,Number=1,Type=Integer,Description="Read Depth">
#CHROM POS ID REF ALT QUAL FILTER INFO FORMAT Sample1
1 565286 . C T PASS DP=13 GT:GQP 1/1:7:13
1 569492 . T C PASS DP=45 GT:GQP 1/1:26:45
1 22974297 . C A PASS DP=19 GT:GQP 1/1:10:19


Now Varscan produces dot in the ID column (convert2annovar.pl is happy with this), but dot disappeared from QUAL column (which is empty)...?

[skilpinen]

Hello,

This is both observation and question does anybody know (Varscan developers?) is this really a bug or something else.

By using latest Varscan 2.2.11 and mpileup2snp command. Mpileup file from samtools with phred+33 scale quality values produces following VCF file:

##fileformat=VCFv4.0
##source=VarScan2
##INFO=<ID=DP,Number=1,Type=Integer,Description="Total Depth">
##FILTER=<ID=str10,Description="Less than 10% or more than 90% of variant supporting reads on one strand">
##FORMAT=<ID=GT,Number=1,Type=String,Description="Genotype">
##FORMAT=<ID=GQ,Number=1,Type=Integer,Description="Genotype Quality">
##FORMAT=<ID=DP,Number=1,Type=Integer,Description="Read Depth">
#CHROM POS ID REF ALT QUAL FILTER INFO FORMAT Sample1
1 565286 C T . PASS DP=13 GT:GQP 1/1:7:13
1 569492 T C . PASS DP=45 GT:GQP 1/1:26:45


There are two problems:

i) First of all ID column is empty, and I mean that even though header line has "ID" the following lines do not contain that at all => messes up mandatory 8 fields of VCF file => does not work in combination with Annovar (convert2annovar.pl). I managed to get convert2annovar.pl to accept the vcf file from Varscan only by running it through following (basicly add "null" to each row of ID column):

perl -nle 'if ($_ !~ /^#/){@tmp=split(/\t/,$_);$,="\t";print @tmp[0..1],"null",@tmp[2..(scalar(@tmp)-1)]} else {print}' result.vcf > result_fixed.vcf

Does anybody know some other solution or reason for this output?

ii) QUAL column contains dot for every variant. Shouldn't there be a number? (This doesn't seem bother Annovar, but it is potentially problematic bug(?)