Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • Zapages
    Member
    • Oct 2012
    • 98

    batch download from NCBI FTP

    Hi guys,

    I know in linux we can do a batch download for certain files with same extension such by doing something like this

    wget genomic.fna.gz ie. ftp://ftp.ncbi.nlm.nih.gov/refseq/release//bacteria/

    But how would I do this in OSX with curl command.

    I have tried curl -0 ftp://ftp.ncbi.nlm.nih.gov/refseq/re...genomic.fna.gz

    as an example and I get 550 error as if I was getting file not found error or no permission.

    But if I try curl genomic.fna.gz -0 ftp://ftp.ncbi.nlm.nih.gov/refseq/re...teria/bacteria.[??].genomic.fna.gz

    I get empty files as I don't know the command to place in between in the ?? to allow it work properly to download all the of the fasta files for bacteria reference set.

    Also it changes to bacteria.1.1 bacteria.2.1 bacteria.2..2 bacteria.3.1


    Thank you in advance.

    -Zapages
  • GenoMax
    Senior Member
    • Feb 2008
    • 7142

    #2
    Try this. Adjust X for the number of files you want to get. It appears there are 152 right now at the FTP link.

    Code:
    $ curl "ftp://ftp.ncbi.nlm.nih.gov/refseq/release//bacteria/bacteria.[1-[COLOR="Red"]X[/COLOR]].1.genomic.fna.gz" -o "bacteria.#1.1.genomic.fna.gz"

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      Nine Things a Sample Prep Scientist Thinks About Before Sequencing
      by SEQadmin2


      I’m not a sequencing expert. I’m a purification scientist who uses NGS to evaluate workflows my group develops. With this perspective, we think about the sample first and the NGS workflow second. The sequencer is an exceptionally honest reporter, but it can only report on what you give it, so whether you get clean, interpretable data from an NGS workflow is largely determined before you begin.

      Here are nine questions we think about, in roughly the order they matter, before...
      06-18-2026, 07:11 AM
    • SEQadmin2
      From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
      by SEQadmin2


      Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


      The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
      ...
      06-02-2026, 10:05 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, 06-26-2026, 11:10 AM
    0 responses
    16 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-17-2026, 06:09 AM
    0 responses
    49 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-09-2026, 11:58 AM
    0 responses
    108 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 06-05-2026, 10:09 AM
    0 responses
    125 views
    0 reactions
    Last Post SEQadmin2  
    Working...