Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • Jazzy
    Junior Member
    • Jun 2014
    • 2

    qsub memory allocation

    Hey,

    I intend to write a shell which automatically submit jobs with qsub. One idea is that it'll be better if the shell assigns how much memory each job needs to each qsub command. However, I am not quite sure how much each job needs. Is there anyone out there who knows how to approximate the memory needed?
  • rhinoceros
    Senior Member
    • Apr 2013
    • 372

    #2
    Is there anyone out there who knows how to approximate the memory needed?
    X times Y times Z

    Where X is the estimated single-thread memory usage of your task, Y is the number or threads, and Z is how memory usage scales with threads.

    For example:

    Task takes 4GB
    Two threads
    No thread-effect

    4GB x 2 x 0.5 (two threads share the RAM) = 4GB

    Task takes 4GB
    Two threads
    Each thread takes full RAM

    4GB X 2 x 1 = 8GB


    A clear answer to a clear question.
    Last edited by rhinoceros; 06-10-2014, 03:34 AM.
    savetherhino.org

    Comment

    • Jazzy
      Junior Member
      • Jun 2014
      • 2

      #3
      Originally posted by rhinoceros View Post
      X times Y times Z

      Where X is the estimated single-thread memory usage of your task, Y is the number or threads, and Z is how memory usage scales with threads.

      For example:

      Task takes 4GB
      Two threads
      No thread-effect

      4GB x 2 x 0.5 (two threads share the RAM) = 4GB

      Task takes 4GB
      Two threads
      Each thread takes full RAM

      4GB X 2 x 1 = 8GB


      A clear answer to a clear question.
      hey,rhinoceros, thanks for your answer! and yes I believe you've given a very clear one.

      Comment

      Latest Articles

      Collapse

      • SEQadmin2
        Nine Things a Sample Prep Scientist Thinks About Before Sequencing
        by SEQadmin2


        I’m not a sequencing expert. I’m a purification scientist who uses NGS to evaluate workflows my group develops. With this perspective, we think about the sample first and the NGS workflow second. The sequencer is an exceptionally honest reporter, but it can only report on what you give it, so whether you get clean, interpretable data from an NGS workflow is largely determined before you begin.


        Here are nine questions we think about, in roughly the order they matter, before...
        06-18-2026, 07:11 AM
      • SEQadmin2
        From Collection to Sequencing: Why Sample Preparation and Preservation Define Sequencing Data
        by SEQadmin2


        Data variability is still an issue in sequencing technologies despite the advances in reproducibility and accuracy of these platforms. But the problem does not originate in the sequencing itself, but in the previous steps, before the sample reaches the sequencer.


        The first step is collection, followed by preservation and sample preparation for analysis. Most scientists overlook those steps, but not being careful might just be skewing the experiment’s results.
        ...
        06-02-2026, 10:05 AM
      • SEQadmin2
        Single-Cell Sequencing at an Inflection Point: Early Impacts of New Platforms and Emerging Trends
        by SEQadmin2


        With the launch of new single-cell sequencing platforms in 2026, the field stands at an exciting inflection point. This article surveys the most impactful advances in the field and discusses how they’re reshaping research in cancer, immunology, and beyond.


        Introduction

        Single-cell sequencing technologies have undergone remarkable advances over the past decade, transitioning from low-throughput experimental approaches to highly scalable platforms capable of...
        05-22-2026, 06:42 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by SEQadmin2, 06-17-2026, 06:09 AM
      0 responses
      21 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 06-09-2026, 11:58 AM
      0 responses
      40 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 06-05-2026, 10:09 AM
      0 responses
      46 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 06-04-2026, 08:59 AM
      0 responses
      49 views
      0 reactions
      Last Post SEQadmin2  
      Working...