Seqanswers Leaderboard Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • fznajar
    Member
    • Jan 2012
    • 35

    Blast 2.8.0+

    Hi all,
    I have been getting the following error:
    Error memory mapping:/Volumes/cbbc_expansion1/BLASTDB/nt.43.nnd openedFilesCount=251 threadID=0
    BLAST Database error: Error pre-fetching sequence data

    I am using version5 pre-formatted nt data. As you can see above, there seem to be a problem with "nt.43".
    Any ideas what I am doing wrong.
    Best
  • Markiyan
    Senior Member
    • Sep 2010
    • 124

    #2
    1. Make sure the blast volume #43 is not corrupted, check it's md5 sums.
    2. Ensure that your systems has enough RAM available to blast process.
    3. Please put your blast db on the DAS (Direct Attached Storage) volume.
    (Ideally nvme SSD one with good cooling).

    More specifics about the system configuration would be very helpful.
    post the outputs from the following commands:
    (remove dots from the commands):

    l.s.cpu
    u.n.ame -a
    u.li.mit -a
    d.f -h
    c.a.t /e.t.c/m.t.ab
    t.o.p

    Since it is a /Volumes mount point name, I may suspect it is a MacOS system, which probably has 8 or 16GB of RAM, and you would need at least 64 GB for current editions of the nt database.

    Comment

    • GenoMax
      Senior Member
      • Feb 2008
      • 7142

      #3
      Where did you get blast 2.8.0? Current version available from NCBI's FTP site is v. 2.7.1.

      Comment

      • fznajar
        Member
        • Jan 2012
        • 35

        #4
        Thanks a lot Markiyan. You are correct about the 16GB. The checksum is correct.

        Comment

        • fznajar
          Member
          • Jan 2012
          • 35

          #5
          GenoMax. Here are the links:

          For the executables:
          ftp://ftp.ncbi.nlm.nih.gov/blast/exe...t+/2.8.0alpha/

          For the new database the goes with it:
          ftp://ftp.ncbi.nlm.nih.gov/blast/db/v5/

          You would want this version of the database as it allows great features for taxonomy specific blast.
          Best

          Comment

          • fznajar
            Member
            • Jan 2012
            • 35

            #6
            Here the commands outputs that worked Markiyan

            Darwin cbbc.lifesci.nor.ou.edu 16.7.0 Darwin Kernel Version 16.7.0: Tue Jan 30 11:27:06 PST 2018; root:xnu-3789.73.11~1/RELEASE_X86_64 x86_64
            ----------------------------------

            core file size (blocks, -c) 0
            data seg size (kbytes, -d) unlimited
            file size (blocks, -f) unlimited
            max locked memory (kbytes, -l) unlimited
            max memory size (kbytes, -m) unlimited
            open files (-n) 256
            pipe size (512 bytes, -p) 1
            stack size (kbytes, -s) 8192
            cpu time (seconds, -t) unlimited
            max user processes (-u) 709
            virtual memory (kbytes, -v) unlimited
            ---------------------
            Filesystem Size Used Avail Capacity iused ifree %iused Mounted on
            /dev/disk1 233Gi 189Gi 43Gi 82% 2346076 4292621203 0% /
            devfs 196Ki 196Ki 0Bi 100% 678 0 100% /dev
            map -hosts 0Bi 0Bi 0Bi 100% 0 0 100% /net
            map auto_home 0Bi 0Bi 0Bi 100% 0 0 100% /home
            /dev/disk4s2 931Gi 397Gi 534Gi 43% 143983 4294823296 0% /Volumes/cbbc_expansion1
            /dev/disk2s1 1.8Ti 1.4Ti 413Gi 78% 4110506 4290856773 0% /Volumes/BACKUP
            /dev/disk3s2 3.6Ti 2.2Ti 1.4Ti 62% 1103273 4293864006 0% /Volumes/cbbc_expansion_4TB
            -------------------------

            Comment

            • GenoMax
              Senior Member
              • Feb 2008
              • 7142

              #7
              That is an "alpha" version (meaning a "work in progress") of blast+. I would suggest not using that for any serious work. You should switch to the current shipping version. But as @Markian pointed out with 16G you are not going to have enough RAM to do this search.

              Comment

              • fznajar
                Member
                • Jan 2012
                • 35

                #8
                I agree. NCBI released the youtube video explaining how it works. I was impressed with the taxonomy. I am using in house for tests.
                I will upgrade the memory of my MacPro soon.
                Thanks for your suggestions.

                Comment

                • Markiyan
                  Senior Member
                  • Sep 2010
                  • 124

                  #9
                  A couple of points:

                  For taxonomy - specific blast it is way better to create a subset(s) of the blast db in the fasta format and format them as a separate databases... - it would help reduce IO and DB size, and should lower RAM requirements.
                  (Othevice the blast has to look up taxonomy in all nt db volumes on EVERY invocation).

                  PS:
                  So yours blast station is a proper mac pro tower? - it may be able to take a general server grade DDR3 ECC reg or DDR2 FBdimm modules (depending on it's age), which can be found at a very reasonable prices on the ebay (compared to the new ones).
                  But please find first out which types of RAM are compatible with it.

                  I hope that you are not trying to run it off 1tb portable usb drive in plastic casing, since they may not last long if exposed to heavy IO load.

                  Also I would think upgrading a system drive to 1TB+ 3D MLC SSD (like samsung 850/860 pro or even NVME (depends on compatibility with your MAC)).

                  Comment

                  • fznajar
                    Member
                    • Jan 2012
                    • 35

                    #10
                    Thank you Markiyan.
                    Yes it does take DDR3 ECC RDIMM. Appreciate your suggestions. I thought SSD is not good for continuous heavy IO. Actually, I was planning on the portable 1TB USB drive. Glad you mentioned it.
                    Thank you.
                    Last edited by fznajar; 06-11-2018, 03:54 PM.

                    Comment

                    Latest Articles

                    Collapse

                    • seqadmin
                      New Genomics Tools and Methods Shared at AGBT 2025
                      by seqadmin


                      This year’s Advances in Genome Biology and Technology (AGBT) General Meeting commemorated the 25th anniversary of the event at its original venue on Marco Island, Florida. While this year’s event didn’t include high-profile musical performances, the industry announcements and cutting-edge research still drew the attention of leading scientists.

                      The Headliner
                      The biggest announcement was Roche stepping back into the sequencing platform market. In the years since...
                      03-03-2025, 01:39 PM
                    • seqadmin
                      Investigating the Gut Microbiome Through Diet and Spatial Biology
                      by seqadmin




                      The human gut contains trillions of microorganisms that impact digestion, immune functions, and overall health1. Despite major breakthroughs, we’re only beginning to understand the full extent of the microbiome’s influence on health and disease. Advances in next-generation sequencing and spatial biology have opened new windows into this complex environment, yet many questions remain. This article highlights two recent studies exploring how diet influences microbial...
                      02-24-2025, 06:31 AM

                    ad_right_rmr

                    Collapse

                    News

                    Collapse

                    Topics Statistics Last Post
                    Started by seqadmin, 03-20-2025, 05:03 AM
                    0 responses
                    17 views
                    0 reactions
                    Last Post seqadmin  
                    Started by seqadmin, 03-19-2025, 07:27 AM
                    0 responses
                    18 views
                    0 reactions
                    Last Post seqadmin  
                    Started by seqadmin, 03-18-2025, 12:50 PM
                    0 responses
                    19 views
                    0 reactions
                    Last Post seqadmin  
                    Started by seqadmin, 03-03-2025, 01:15 PM
                    0 responses
                    186 views
                    0 reactions
                    Last Post seqadmin  
                    Working...