Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Varscan VCF output bugs(?)

    Hello,

    This is both observation and question does anybody know (Varscan developers?) is this really a bug or something else.

    By using latest Varscan 2.2.11 and mpileup2snp command. Mpileup file from samtools with phred+33 scale quality values produces following VCF file:

    ##fileformat=VCFv4.0
    ##source=VarScan2
    ##INFO=<ID=DP,Number=1,Type=Integer,Description="Total Depth">
    ##FILTER=<ID=str10,Description="Less than 10% or more than 90% of variant supporting reads on one strand">
    ##FORMAT=<ID=GT,Number=1,Type=String,Description="Genotype">
    ##FORMAT=<ID=GQ,Number=1,Type=Integer,Description="Genotype Quality">
    ##FORMAT=<ID=DP,Number=1,Type=Integer,Description="Read Depth">
    #CHROM POS ID REF ALT QUAL FILTER INFO FORMAT Sample1
    1 565286 C T . PASS DP=13 GT:GQP 1/1:7:13
    1 569492 T C . PASS DP=45 GT:GQP 1/1:26:45


    There are two problems:

    i) First of all ID column is empty, and I mean that even though header line has "ID" the following lines do not contain that at all => messes up mandatory 8 fields of VCF file => does not work in combination with Annovar (convert2annovar.pl). I managed to get convert2annovar.pl to accept the vcf file from Varscan only by running it through following (basicly add "null" to each row of ID column):

    perl -nle 'if ($_ !~ /^#/){@tmp=split(/\t/,$_);$,="\t";print @tmp[0..1],"null",@tmp[2..(scalar(@tmp)-1)]} else {print}' result.vcf > result_fixed.vcf

    Does anybody know some other solution or reason for this output?

    ii) QUAL column contains dot for every variant. Shouldn't there be a number? (This doesn't seem bother Annovar, but it is potentially problematic bug(?)
    Last edited by skilpinen; 05-12-2012, 01:51 AM.

  • #2
    Update on the issue

    Interestingly, apparently data was not phred+33 even though Tophat claimed so... conversion to phred+33 and redo everything:


    ##fileformat=VCFv4.0
    ##source=VarScan2
    ##INFO=<ID=DP,Number=1,Type=Integer,Description="Total Depth">
    ##FILTER=<ID=str10,Description="Less than 10% or more than 90% of variant supporting reads on one strand">
    ##FORMAT=<ID=GT,Number=1,Type=String,Description="Genotype">
    ##FORMAT=<ID=GQ,Number=1,Type=Integer,Description="Genotype Quality">
    ##FORMAT=<ID=DP,Number=1,Type=Integer,Description="Read Depth">
    #CHROM POS ID REF ALT QUAL FILTER INFO FORMAT Sample1
    1 565286 . C T PASS DP=13 GT:GQP 1/1:7:13
    1 569492 . T C PASS DP=45 GT:GQP 1/1:26:45
    1 22974297 . C A PASS DP=19 GT:GQP 1/1:10:19


    Now Varscan produces dot in the ID column (convert2annovar.pl is happy with this), but dot disappeared from QUAL column (which is empty)...?

    Comment


    • #3
      Hello, I'm the developer of VarScan and this appears to be a bug affecting mpileup2snp, mpileup2indel, and mpileup2cns but not the somatic functions. The QUAL field should contain an empty character (".") but is skipped altogether.

      I've already put in a fix and will push that out as soon as possible.

      At present, the QUAL value will remain an empty value for multi-sample calling in VarScan. This meets VCF specification, and it seems most appropriate since it's difficult to assess the overall quality of a variant called across multiple samples.

      If you have further questions, feel free to e-mail me directly: dkoboldt (at) genome (dot) wustl (dot) edu.

      Comment


      • #4
        Further output problems

        Hi,

        I was processing varscan vcf output with GATK and got the following error:

        Code:
        ##### ERROR MESSAGE: The provided VCF file is malformed at approximately line number 1479: Unparsable vcf record with allele T/C
        Apparently, T/C is not valid vcf. Any plans of correcting this in the near future?

        br,
        Tommi

        Comment


        • #5
          Hi,

          I'm wondering if it's valid vcf too.
          Actually, the vcf format in the varscan output looks like

          chr1 14454194 . C G . str10 ADP=11;WT=0;HET=0;HOM=1;NC=0 GT:GQ:SDPP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR 1/1:5:11:11:0:11:100%:1,4176E-6:0:25:0:0:11:0
          chr1 16300817 . A -T . PASS ADP=14;WT=0;HET=1;HOM=0;NC=0 GT:GQ:SDPP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR 0/1:4:14:14:4:10:71,43%:7,6278E-5:40:40:4:0:10:0
          chr1 16459021 . G +CA . PASS ADP=13;WT=0;HET=1;HOM=0;NC=0 GT:GQ:SDPP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR 0/1:3:16:13:3:8:53,33%:5,16E-4:40:30:3:0:0:8

          But on the vcf format reference page on the 1000genome website (http://www.1000genomes.org/wiki/Anal...mat-version-41) there is no "+CA" or "-T" in the fourth column, but only letters (sometimes separated by a comma, but never with a + or a -).

          I'm using annovar after varscan and I get some weird results (no insertion or deletion) and I'm wondering if this strange behaviour could come from this format differences. Does anyone have met the same kind of problem?


          Olivia

          Comment


          • #6
            Problem with VCF file produced by VarScan

            I also see the problem with the + and - values for the ALT allele in the VCF produced by VarScan...

            I also see "str10' appear in some of the Qual fields as well (See Below).
            This does not always appear with the InDels....

            i think the +A is to try to signify an insertion, but that needs to be defined as G GA if the A is an insertion after the G...

            Conversely, a deletion always includes the base that is left

            So: GATC G is a deletion of the 3 bases AFTER the G...

            Code:
            1	228405118	.	G	+A	.	str10	ADP=29;WT=0;HET=0;HOM=1;NC=0	GT:GQ:SDP:DP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR	1/1:0:29:29:1:28:96.55%:9.8E-1:28:30:0:1:0:28
            1	237730169	.	C	T	.	str10	ADP=58;WT=0;HET=0;HOM=1;NC=0	GT:GQ:SDP:DP:RD:AD:FREQ:PVAL:RBQ:ABQ:RDF:RDR:ADF:ADR	1/1:0:67:58:0:58:100%:9.8E-1:0:17:0:0:3:55
            Thanks,

            Thon
            Thon
            __________________________________
            Thon de Boer, Ph.D.
            Director of Product Management, Software
            Strand Life Sciences
            548 Market Street, Suite 82804
            San Francisco, CA 94104, USA
            [email protected]
            www.strandls.com
            Pioneers in Discovery Research Informatics
            _______________________________________

            Comment


            • #7
              Hi Thon,

              I've solved the problem by writing a small script to convert the files obtained with VarScan in the "right" vcf format. By this way, it's OK with Annovar.

              Concerning the str10 values that you see, they're not in the Qual field, but in the Filter one and mean that this variation would not pass the filter "Less than 10% or more than 90% of variant supporting reads on one strand".
              And the Qual field is missing. There should be a "." in this column.

              Hope it will help you.

              Olivia

              Comment


              • #8
                Hello all,

                Thank you for following up on this issue -- we certainly do want VarScan's VCF output to meet the specification. I believe that I've already addressed the missing QUAL field, and the way that indels are represented, but I'll need to verify that the alleles-separated-by-slash issue was addressed so that they're separated by commas in VCF output. There will almost certainly be a new release soon that addresses these issues.

                Olivia, would you mind sending me your script to dkoboldt (at) genome [dot] wustl [dot] edu ? I could use that to determine if more changes are necessary to meet VCF compliance.

                Comment


                • #9
                  Hello Dan and others,

                  First, thanks for the great piece of software! It would space us some work if somaticFilter supported .vcf files as well. I don't know if it is tedious to implement.

                  Another thing I wanted to ask, not related to vcf, concerns false-positive filtering (fpfilter.pl). I'm using bam-readcount to produce input for the script, but even if I do it chromosome by chromosome, the files are too big (>50G) and my computer (with 8Gb memory) just gets jammed when running the fpfilter.pl. Is there a way to do modify the script to support pipeing? And please tell me if it already does.

                  br,
                  Tommi

                  Comment


                  • #10
                    Hello all,

                    I realised that the missing qual field had been added in one of the last versions of VarScan. As I use it in a pipeline, I did not update it recently to avoid compatibility problems.

                    But after a few tests, it seems to me that the insertion and deletion are still coded with + and - in the ref and alt column, which don't match with the vcf specifications. I think an insertion of a T after a C should be written C in the ref field and CT in the alt field (and not by +T) for example.

                    Regards,

                    Olivia

                    Comment


                    • #11
                      Olivia, +/- issue is fixed in the latest version 2.3.4.

                      However, the way variant alleles are coded is still unconventional. vcf format uses comma to separate alleles whereas varscan uses slash so I hope this can be fixed in future releases:

                      Code:
                      A/C -> A,C
                      ACG/CG -> ACG,CG
                      br,
                      Tommi

                      Comment


                      • #12
                        Is it fixed in all VarScan tools?

                        Which one do you use?

                        I use VarScan.v2.3.4.jar mpileup2indel and I still get some "C +AAAG" or "G -AT" in my vcf output file.


                        Olivia

                        Comment


                        • #13
                          Originally posted by oliviajm View Post
                          Is it fixed in all VarScan tools?
                          Which one do you use?

                          I use VarScan.v2.3.4.jar mpileup2indel and I still get some "C +AAAG" or "G -AT" in my vcf output file.
                          That explains.. I use somatic for tumor-normal pairs.

                          Tommi

                          Comment


                          • #14
                            Originally posted by tommivat View Post
                            Olivia, +/- issue is fixed in the latest version 2.3.4.
                            To add to Olivia's comment, I'm also using 2.3.4 and still getting the +/- issue when using mpileup2snp.

                            Comment


                            • #15
                              Originally posted by NestorNotabilis View Post
                              To add to Olivia's comment, I'm also using 2.3.4 and still getting the +/- issue when using mpileup2snp.
                              I am as well when using the somatic/processSomatic functions.

                              Annovar doesn't like this.. can anyone help?

                              Comment

                              Latest Articles

                              Collapse

                              • seqadmin
                                Exploring the Dynamics of the Tumor Microenvironment
                                by seqadmin




                                The complexity of cancer is clearly demonstrated in the diverse ecosystem of the tumor microenvironment (TME). The TME is made up of numerous cell types and its development begins with the changes that happen during oncogenesis. “Genomic mutations, copy number changes, epigenetic alterations, and alternative gene expression occur to varying degrees within the affected tumor cells,” explained Andrea O’Hara, Ph.D., Strategic Technical Specialist at Azenta. “As...
                                07-08-2024, 03:19 PM
                              • seqadmin
                                Exploring Human Diversity Through Large-Scale Omics
                                by seqadmin


                                In 2003, researchers from the Human Genome Project (HGP) announced the most comprehensive genome to date1. Although the genome wasn’t fully completed until nearly 20 years later2, numerous large-scale projects, such as the International HapMap Project and 1000 Genomes Project, continued the HGP's work, capturing extensive variation and genomic diversity within humans. Recently, newer initiatives have significantly increased in scale and expanded beyond genomics, offering a more detailed...
                                06-25-2024, 06:43 AM

                              ad_right_rmr

                              Collapse

                              News

                              Collapse

                              Topics Statistics Last Post
                              Started by seqadmin, Today, 07:20 AM
                              0 responses
                              11 views
                              0 likes
                              Last Post seqadmin  
                              Started by seqadmin, 07-16-2024, 05:49 AM
                              0 responses
                              31 views
                              0 likes
                              Last Post seqadmin  
                              Started by seqadmin, 07-15-2024, 06:53 AM
                              0 responses
                              36 views
                              0 likes
                              Last Post seqadmin  
                              Started by seqadmin, 07-10-2024, 07:30 AM
                              0 responses
                              41 views
                              0 likes
                              Last Post seqadmin  
                              Working...
                              X