Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • How best to use --bflyHeapSpaceMax and --bflyGCThreads on Trinity

    I am currently using trinity v2.6.0. My jobs keep crashing at the butterfly stage of the analysis, with such error messages as:
    succeeded(1008), failed(108076) 99.9771% completed. Invalid maximum heap size: -Xmx16G
    The specified size exceeds the maximum representable size.
    Error: Could not create the Java Virtual Machine.
    Error: A fatal exception has occurred. Program will exit.

    There is clearly a problem with assigning enough memory to the JVM. My overall memory and CPU allocation for the last job I ran were:
    #PBS -l procs=64
    #PBS -l mem=1048320mb

    and the run parameters of Trinity were:
    --max_memory 1024G \
    --bflyHeapSpaceMax 16G \
    --bflyGCThreads 16 \
    --normalize_reads \
    --CPU 64 \


    I would like to know what the --bflyHeapSpaceMax option specifies. Is it the maximum JVM heap space overall, or for each thread Trinity has generated?

    Should I simply set the --bflyHeapSpaceMax to the same value as --max_memory?

    I understand that the --bflyGCThreads option removes objects from the JVM once they are no longer in use, and in doing so frees up the memory. Is this correct?

    Should I allocate on butterfly GC thread for each CPU/thread used by Trinity?

    Does Trinity generate more than one butterfly GC thread on a single CPU?

Latest Articles

Collapse

  • seqadmin
    Exploring the Dynamics of the Tumor Microenvironment
    by seqadmin




    The complexity of cancer is clearly demonstrated in the diverse ecosystem of the tumor microenvironment (TME). The TME is made up of numerous cell types and its development begins with the changes that happen during oncogenesis. “Genomic mutations, copy number changes, epigenetic alterations, and alternative gene expression occur to varying degrees within the affected tumor cells,” explained Andrea O’Hara, Ph.D., Strategic Technical Specialist at Azenta. “As...
    07-08-2024, 03:19 PM
  • seqadmin
    Exploring Human Diversity Through Large-Scale Omics
    by seqadmin


    In 2003, researchers from the Human Genome Project (HGP) announced the most comprehensive genome to date1. Although the genome wasn’t fully completed until nearly 20 years later2, numerous large-scale projects, such as the International HapMap Project and 1000 Genomes Project, continued the HGP's work, capturing extensive variation and genomic diversity within humans. Recently, newer initiatives have significantly increased in scale and expanded beyond genomics, offering a more detailed...
    06-25-2024, 06:43 AM

ad_right_rmr

Collapse

News

Collapse

Topics Statistics Last Post
Started by seqadmin, 07-10-2024, 07:30 AM
0 responses
26 views
0 likes
Last Post seqadmin  
Started by seqadmin, 07-03-2024, 09:45 AM
0 responses
201 views
0 likes
Last Post seqadmin  
Started by seqadmin, 07-03-2024, 08:54 AM
0 responses
212 views
0 likes
Last Post seqadmin  
Started by seqadmin, 07-02-2024, 03:00 PM
0 responses
193 views
0 likes
Last Post seqadmin  
Working...
X