Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Download all bacteria genomes in .gbk format

    Hello all,

    Sorry if this has been posted before, but after searching the internet I seem to be at a dead end.

    I currently would like to download all bacterial genomes in .gbk or .embl format to use with a program called MultiGeneBlast.

    The current GUI in the program to create your own database doesnt work.
    I have tried https://github.com/kblin/ncbi-genome...ster/README.md website and it does not work either and crashes most of the time.

    I've manually downloaded the gbgbct.seq.gz files individually from https://ftp.ncbi.nlm.nih.gov/genbank/ and changed the extensions of the files to .gbk and when I use the database creation tool within MultiGeneBlast it still doesnt work.

    If I go to https://www.ncbi.nlm.nih.gov/assembl...ll%5Bfilter%5D and choose completed genomes of bacteria it doesnt give me the .gbk format only .gbff and doesnt give me an embl option.

    Maybe it is alot easier and simpler than I'm finding it, but I am not the most computer proficient.

    If anybody would like to extend some help or advice it would be muchly appreciated. All the best!

  • #2
    There is no GUI for Kai Blin's NCBI Genome downloader tool so I am not sure what is crashing for you. That is a command line tool. Install and use on command line. There are thousands of bacterial genomes so be careful with the downloads.

    gbff file format is actually GenBank format.

    NCBI has assembly summary report files available. Here is the file that you can parse for bacteria. You can look at the relevant field to get the FTP download path for particular genome. GenBank format files will be inside that folder.

    Code:
    #   See ftp://ftp.ncbi.nlm.nih.gov/genomes/README_assembly_summary.txt for a description of the columns in this file.
    # assembly_accession    bioproject      biosample       wgs_master      refseq_category taxid   species_taxid   organism_
    name    infraspecific_name      isolate version_status  assembly_level  release_type    genome_rep      seq_rel_date    a
    sm_name submitter       gbrs_paired_asm paired_asm_comp ftp_path        excluded_from_refseq    relation_to_type_material
    GCA_003023565.1 PRJNA351262     SAMN06020791    PXSA00000000.1  na      1919191 1919191 Halobacteriales archaeon QS_9_68_17              QS_9_68_17      latest  Scaffold        Major   Full    2018/03/27      ASM302356v1     None    na      na       ftp://ftp.ncbi.nlm.nih.gov/genomes/all/GCA/003/023/565/GCA_003023565.1_ASM302356v1      derived from metagenome
    GCA_003023575.1 PRJNA351262     SAMN06020787    PXRW00000000.1  na      1919185 1919185 Halobacteriales archaeon QS_7_69_60              QS_7_69_60      latest  Scaffold        Major   Full    2018/03/27      ASM302357v1     None    na      na       ftp://ftp.ncbi.nlm.nih.gov/genomes/all/GCA/003/023/575/GCA_003023575.1_ASM302357v1      derived from metagenome
    Last edited by GenoMax; 06-10-2020, 08:33 AM.

    Comment


    • #3
      Thank you for replying so fast.

      this is the error I had when I used Kai's ncbi genome downloader and I didn't understand it to say the least :P

      Traceback (most recent call last):
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 125, in worker
      result = (True, func(*args, **kwds))
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\ncbi_genome_download\core.py", line 385, in downloadjob_creator_caller
      return create_downloadjob(*args)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\ncbi_genome_download\core.py", line 397, in create_downloadjob
      checksums = grab_checksums_file(entry)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\ncbi_genome_download\core.py", line 465, in grab_checksums_file
      req = requests.get(full_url)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\requests\api.py", line 76, in get
      return request('get', url, params=params, **kwargs)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\requests\api.py", line 61, in request
      return session.request(method=method, url=url, **kwargs)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 516, in request
      prep = self.prepare_request(req)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 449, in prepare_request
      p.prepare(
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 314, in prepare
      self.prepare_url(url, params)
      File "c:\users\g\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 388, in prepare_url
      raise MissingSchema(error)
      requests.exceptions.MissingSchema: Invalid URL 'na/md5checksums.txt': No schema supplied. Perhaps you meant http://na/md5checksums.txt?

      I will try and do the download the ncbi website in gbff format too and see if the multigeneblast program accepts it

      Comment


      • #4
        Looks like you are trying to do this on Windows. That is a different can of worms. Programs like Kai Blin's are written to work on linux/macOS. While some may work on Windows there is no guarantee that they will.

        If you can use WSL2 on Windows 10 which will allow you to use linux on your machine and use most of the programs seamlessly.

        Comment


        • #5
          Okay thank you, I'll give that a go.

          I appreciate you responding so fast, thanks again

          Comment

          Latest Articles

          Collapse

          • seqadmin
            The Impact of AI in Genomic Medicine
            by seqadmin



            Artificial intelligence (AI) has evolved from a futuristic vision to a mainstream technology, highlighted by the introduction of tools like OpenAI's ChatGPT and Google's Gemini. In recent years, AI has become increasingly integrated into the field of genomics. This integration has enabled new scientific discoveries while simultaneously raising important ethical questions1. Interviews with two researchers at the center of this intersection provide insightful perspectives into...
            02-26-2024, 02:07 PM
          • seqadmin
            Multiomics Techniques Advancing Disease Research
            by seqadmin


            New and advanced multiomics tools and technologies have opened new avenues of research and markedly enhanced various disciplines such as disease research and precision medicine1. The practice of merging diverse data from various ‘omes increasingly provides a more holistic understanding of biological systems. As Maddison Masaeli, Co-Founder and CEO at Deepcell, aptly noted, “You can't explain biology in its complex form with one modality.”

            A major leap in the field has
            ...
            02-08-2024, 06:33 AM

          ad_right_rmr

          Collapse

          News

          Collapse

          Topics Statistics Last Post
          Started by seqadmin, 02-28-2024, 06:12 AM
          0 responses
          26 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 02-23-2024, 04:11 PM
          0 responses
          74 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 02-21-2024, 08:52 AM
          0 responses
          81 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 02-20-2024, 08:57 AM
          0 responses
          69 views
          0 likes
          Last Post seqadmin  
          Working...
          X