Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • indapa
    Junior Member
    • May 2011
    • 5

    #1

    GATK CountCovariates running very slow

    Hi,

    I tried posting this question on GetStatisfaction GATK forum but kept getting an invalid request error in Firefox. I thought I would give SeqAnswers a try (this is my first post here)

    I am trying to recalibrate quality scores with GATK CountCovariates and it is running extremely slow:

    java -Xmx64000m -jar GenomeAnalysisTK.jar -R $REF_BIN/$REF --DBSNP
    $DBSNP_BIN/$DBSNP -l INFO -T CountCovariates -I my.bam
    --max_reads_at_locus 20000 -cov ReadGroupCovariate -cov
    QualityScoreCovariate -cov CycleCovariate -cov DinucCovariate
    -recalFile $CSV > $CSV.stdout 2> $NODE_DIR/$OUTPUT.stderr

    Initially GATK gives an EOF exception for reading a *.rod.idx file

    INFO 08:51:15,032 TribbleRMDTrackBuilder - Loading Tribble index from
    disk for file /scratch/indapa/dbsnp_129_b37.rod
    ERROR 08:51:19,710 LinearIndex - Error reading index file:
    /scratch/indapa/dbsnp_129_b37.rod.idx
    java.io.EOFException

    But then proceeds to the CovariateCounterWalker and starts recording
    the number sites traversed (the bam file I want to recalibrate has ~150M reads and is 11GB in size)

    INFO 08:59:30,757 CovariateCounterWalker - The covariates being used here:
    INFO 08:59:30,758 CovariateCounterWalker - ReadGroupCovariate
    INFO 08:59:30,758 CovariateCounterWalker - QualityScoreCovariate
    INFO 08:59:30,758 CovariateCounterWalker - CycleCovariate
    INFO 08:59:30,759 CovariateCounterWalker - DinucCovariate
    INFO 09:00:25,452 TraversalEngine - [PROGRESS] Traversed to 1:10001,
    processing 1 sites in 545.65 secs (545645000.00 secs per 1M sites)

    It has been traversing human chromosome 1 for >2days. I was initially
    getting out of memory exception and I allocated much more memory to
    the java heap than I had done in the past. I'm not sure why this is taking so much longer than previous bam files I've recalibrated with GATK of similar file size. Has anyone experienced similar behavior with CounCovariates?
  • indapa
    Junior Member
    • May 2011
    • 5

    #2
    figured it out - the rod file index was corrupted. Downloaded new verison of GATK along with resource bundle: http://www.broadinstitute.org/gsa/wi...esource_bundle with dbSNP vcf and it works much better.

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
      by SEQadmin2



      Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

      Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
      ...
      10-14-2026, 09:55 AM
    • SEQadmin2
      New Genomics Technologies Take Aim at Long-Standing Limits
      by SEQadmin2


      Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

      We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
      ...
      09-28-2026, 10:25 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, 10-15-2026, 10:52 AM
    0 responses
    13 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 10-14-2026, 05:39 AM
    0 responses
    20 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 10-13-2026, 09:56 AM
    0 responses
    19 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 10-09-2026, 11:14 AM
    0 responses
    27 views
    0 reactions
    Last Post SEQadmin2  
    Working...