Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • NUMA v SMP for Sequence Assembly

    Hi, we're increasing the size of the genomes we're assembling using GAII reads. Our old assembly server had an SMP architecture and worked fairly well but was limited in its RAM (96GB). With assemblers such as Velvet we're looking to move up to a 256GB RAM solution and had considered the Dell R910 (1TB Max RAM), Sunfire x4640 and HP DL785.

    However to varying degrees these are all NUMA solutions with banks of RAM associated with a specific CPU/CPUs. I am a little concerned about the possibility of high latency where a single threaded process needs to access close to the entire contents of RAM. Essentially it seems a lot of the data would have to pass through several memory bridges before arriving at the active core with the consequent risk of a stalled CPU pipeline.

    Cold anyone comment on whether this should be a concern or whether technologies such as quickpath can essentially get around this?

    Thanks for your thoughts.

  • #2
    Hmmm...even the largest (100M read) Velvet assemblies on our 256GB Dell Poweredge machine only take about three hours.

    Does anyone make non-NUMA boxes?
    --
    Jeremy Leipzig
    Bioinformatics Programmer
    --
    My blog
    Twitter

    Comment


    • #3
      Thanks - that's reassuring to hear!

      In the x86 world I think you're right, there's not a lot of SMP kit in the 256GB+ range. But in the power (IBM P series) and perhaps in the other high end risc processors I think it's still possible.

      Comment


      • #4
        I had the below from Dell on this topic:

        There are two situations where remote memory accesses are unavoidable. First, processes that require more memory than what is available to a single processor. Second, processes that spawn more threads than available cores within the local socket. CPU and memory affinity are not appropriate in either case. 11G servers have a BIOS feature called Node Interleaving that stripes data across both memory controllers when enabled. Interleaved accesses are slower than local-only accesses because every other operation traverses the QPI link. However, this feature prevents the worst case scenario where a process is forced to access remote memory at every operation.

        Comment

        Latest Articles

        Collapse

        • seqadmin
          Quality Control Essentials for Next-Generation Sequencing Workflows
          by seqadmin




          Like all molecular biology applications, next-generation sequencing (NGS) workflows require diligent quality control (QC) measures to ensure accurate and reproducible results. Proper QC begins at nucleic acid extraction and continues all the way through to data analysis. This article outlines the key QC steps in an NGS workflow, along with the commonly used tools and techniques.

          Nucleic Acid Quality Control
          Preparing for NGS starts with isolating the...
          02-10-2025, 01:58 PM
        • seqadmin
          An Introduction to the Technologies Transforming Precision Medicine
          by seqadmin


          In recent years, precision medicine has become a major focus for researchers and healthcare professionals. This approach offers personalized treatment and wellness plans by utilizing insights from each person's unique biology and lifestyle to deliver more effective care. Its advancement relies on innovative technologies that enable a deeper understanding of individual variability. In a joint documentary with our colleagues at Biocompare, we examined the foundational principles of precision...
          01-27-2025, 07:46 AM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by seqadmin, 02-07-2025, 09:30 AM
        0 responses
        64 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-05-2025, 10:34 AM
        0 responses
        99 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-03-2025, 09:07 AM
        0 responses
        78 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 01-31-2025, 08:31 AM
        0 responses
        44 views
        0 likes
        Last Post seqadmin  
        Working...
        X