Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Fernas
    Member
    • Apr 2013
    • 74

    #1

    fastq-dump for incomplete files

    Hi All,

    I huave a big list of SRA accession numbers (e.g. SRR651693, ..etc). I used fastq-dump to download all these accessions and convert to directly to fastq (without the need to store sra in the disk).
    However, I Noticed that for some of the files, the number of reads is different than the number of reads for that file in the NCBI website, which means that the download operation for this dataset was incomplete.

    My question is:
    is there any validation tool within sra toolkit that I can call (within a script to iterate through fastq files) so it compares the downloaded fastq file with the metadata in the website?
    (I know there vdb-validate, but it works only for sra files not for fastq files).
  • hdashnow
    Junior Member
    • Dec 2012
    • 3

    #2
    I would like to echo this question. Is there some way to download an md5 sum or similar to check the fastq files against?

    Comment

    • piet
      Member
      • Aug 2014
      • 21

      #3
      Originally posted by hdashnow View Post
      Is there some way to download an md5 sum or similar to check the fastq files against?
      'fastq-dump' will first download the SRA file and store it on your local disk. After download is finished, it will convert the SRA file to FASTQ.

      If you want to check the integrity of the downloaded SRA file, you can break the procedure into several steps. First download the SRA file with 'prefetch'. Then check its integrity with 'vdb-validate'. And finally extract the reads with 'fastq-dump'.

      On the command line you can use the AND operator ('&&') to stop precessing after a failure.
      Code:
      prefetch SRR651693 && vdb-validate SRR651693 && fastq-dump SRR651693

      Comment

      • hdashnow
        Junior Member
        • Dec 2012
        • 3

        #4
        Originally posted by piet View Post
        'fastq-dump' will first download the SRA file and store it on your local disk. After download is finished, it will convert the SRA file to FASTQ.

        If you want to check the integrity of the downloaded SRA file, you can break the procedure into several steps. First download the SRA file with 'prefetch'. Then check its integrity with 'vdb-validate'. And finally extract the reads with 'fastq-dump'.

        On the command line you can use the AND operator ('&&') to stop precessing after a failure.
        Code:
        prefetch SRR651693 && vdb-validate SRR651693 && fastq-dump SRR651693
        Thanks peit. That worked perfectly.

        Comment

        Latest Articles

        Collapse

        • SEQadmin2
          16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
          by SEQadmin2




          NGS has revolutionized clinical microbiology by offering new ways to identify and surveil pathogens without prior knowledge of the target. One popular approach is 16S rRNA and ITS amplicon sequencing, which targets specific microbial markers. But studies are increasingly incorporating shotgun metagenomics, a technique that sequences all DNA from a sample without targeting specific microbial markers. This approach allows more detailed taxonomic classification, detection...
          10-30-2026, 06:46 AM
        • SEQadmin2
          Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
          by SEQadmin2



          Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

          Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
          ...
          10-14-2026, 09:55 AM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by SEQadmin2, 10-28-2026, 09:57 AM
        0 responses
        45 views
        0 reactions
        Last Post SEQadmin2  
        Started by SEQadmin2, 10-28-2026, 09:51 AM
        0 responses
        26 views
        0 reactions
        Last Post SEQadmin2  
        Started by SEQadmin2, 10-22-2026, 11:13 AM
        0 responses
        74 views
        0 reactions
        Last Post SEQadmin2  
        Started by SEQadmin2, 10-22-2026, 10:48 AM
        0 responses
        48 views
        0 reactions
        Last Post SEQadmin2  
        Working...