Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Extracting all microbial sequences from NT

    Hi all,

    I have been trying to find a way to extract all microbial (and eukaryotic) sequences in the NT database but I am running into a bunch of problems.

    I have tried to download the GI lists for all bacterial entries using the NCBI nucleotide database, but the generated files always time out and fail to download the file completely. Then I thought maybe I could get the GI IDs using blastdbcmd, but that also fails. I tried the following:

    Code:
    blastdbcmd -db nt -entry all -outfmt '%g %T' | awk '{ if ($2 == "2") print $1 }' > ../gi/bacteria.gi
    But that also failed, since the individual entries have their species taxon in the %T field, instead of the domain, etc.

    Then I thought maybe I could get a list of all taxon IDs for bacteria, eukaryota, etc., but that also doesn't appear to exist.

    So in short - does anybody have an idea how I can extract all microbial sequences (to make a custom database) from the NT database? Whatever method works....

    Thanks guys!

  • #2
    Hey

    Not a full solution, but MEGAN provides files which map GIs to taxon IDs for nt and nr via this link: http://ab.inf.uni-tuebingen.de/data/...d/welcome.html

    Hope that helps

    Comment


    • #3
      Easiest method to get taxonomy ids ...
      Just check out this directory: ftp://ftp.ncbi.nih.gov/pub/taxonomy/

      ________________
      If you want bacteria and virsus genome in fasta format files ...

      Check out doucmentation here :
      A brief description of file extensions and file formats found at the National Center for Biotechnology Information

      for NCBI file name extensions.

      You can ftp download data from NCBI here :
      ftp://ftp.ncbi.nlm.nih.gov/genomes/Bacteria/
      Look for the all* files. The ftp://ftp.ncbi.nlm.nih.gov/genomes/B...all.fna.tar.gz file should be all bacterial genomes.

      Virae here : ftp://ftp.ncbi.nlm.nih.gov/genomes/Viruses/

      "WGS bacteria OLD" is thereabouts, just look around. Draft genomes there abouts, too.

      _____

      Alternate way to get taxon ids for example bacteria ...

      You can get the file "all rpt" file via wget :
      wget ftp://ftp.ncbi.nlm.nih.gov/genomes/B...all.rpt.tar.gz
      Unzip and untar.

      Run the command
      -bash-3.00$ find . -name '*.rpt' -exec grep Taxid {} \; | sort | uniq
      There you go.

      Comment


      • #4
        Wow, thanks so much guys - this was incredible helpful! I got it all covered now

        Comment

        Latest Articles

        Collapse

        • seqadmin
          The Impact of AI in Genomic Medicine
          by seqadmin



          Artificial intelligence (AI) has evolved from a futuristic vision to a mainstream technology, highlighted by the introduction of tools like OpenAI's ChatGPT and Google's Gemini. In recent years, AI has become increasingly integrated into the field of genomics. This integration has enabled new scientific discoveries while simultaneously raising important ethical questions1. Interviews with two researchers at the center of this intersection provide insightful perspectives into...
          02-26-2024, 02:07 PM
        • seqadmin
          Multiomics Techniques Advancing Disease Research
          by seqadmin


          New and advanced multiomics tools and technologies have opened new avenues of research and markedly enhanced various disciplines such as disease research and precision medicine1. The practice of merging diverse data from various ‘omes increasingly provides a more holistic understanding of biological systems. As Maddison Masaeli, Co-Founder and CEO at Deepcell, aptly noted, “You can't explain biology in its complex form with one modality.”

          A major leap in the field has
          ...
          02-08-2024, 06:33 AM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by seqadmin, 02-23-2024, 04:11 PM
        0 responses
        57 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-21-2024, 08:52 AM
        0 responses
        67 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-20-2024, 08:57 AM
        0 responses
        56 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-14-2024, 09:19 AM
        0 responses
        65 views
        0 likes
        Last Post seqadmin  
        Working...
        X