Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • bfast match "hangs" while reading index

    When I run bfast match (version 0.7.0a), the program often "hangs" while reading the index (as evidenced by the last line of output to stderr):

    Reading index from /path/to/NFSfilesystem/hg19.fasta.nt.2.1.bif.
    If I look at the process with "top" it is still active. Generally, loading an index file takes 5-8 minutes (from the timing info provided from bfast); but, often times I've had it take up to 15 hours! This most often happens when I submit the processes to our PBS cluster. When I run them 'locally' (but on the same machines/disks that are in the PBS cluster), I don't have this issue (though the sample size is much smaller than when I submit to the cluster, since I'm submitting 20+ bfast match commands at the same time). I realize this could be a consequence of high disk/network usage (the index files and FASTQ files are located on a shared NFS GPFS filesystem on high performance dedicated fileservers), but I thought I would see if anyone else sees this issue.

    An example command line call:

    Code:
    bfast match -A 0 -t -n 16 -f /path/to/NFSfilesystem/hg19.fasta -r /path/to/NFSfilesystem/Sample.fastq.gz  -i 4 -z -T /localdisk/scratch/  > /path/to/NFSfilesystem/D1BUKACXX_MN02_002_4.bmf
    Thanks!

  • #2
    Not directly a problem with BFAST

    I've determined this is not an issue with BFAST per se, but a combination with running BFAST match through my ruffus-based pipeline. A similar issue has been noticed when using SGE (I'm using PBS Pro), also not specific to BFAST. It seems to be related to the submission script polling for input (see http://ruffus.org.uk/faq.html under "qrsh eats up all my processor time under ruffus"). Though, in my pipeline, this only happens when using bfast match (not localalign, postprocess, or merge).

    Comment

    Latest Articles

    Collapse

    • seqadmin
      Exploring the Dynamics of the Tumor Microenvironment
      by seqadmin




      The complexity of cancer is clearly demonstrated in the diverse ecosystem of the tumor microenvironment (TME). The TME is made up of numerous cell types and its development begins with the changes that happen during oncogenesis. “Genomic mutations, copy number changes, epigenetic alterations, and alternative gene expression occur to varying degrees within the affected tumor cells,” explained Andrea O’Hara, Ph.D., Strategic Technical Specialist at Azenta. “As...
      07-08-2024, 03:19 PM
    • seqadmin
      Exploring Human Diversity Through Large-Scale Omics
      by seqadmin


      In 2003, researchers from the Human Genome Project (HGP) announced the most comprehensive genome to date1. Although the genome wasn’t fully completed until nearly 20 years later2, numerous large-scale projects, such as the International HapMap Project and 1000 Genomes Project, continued the HGP's work, capturing extensive variation and genomic diversity within humans. Recently, newer initiatives have significantly increased in scale and expanded beyond genomics, offering a more detailed...
      06-25-2024, 06:43 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, 07-10-2024, 07:30 AM
    0 responses
    30 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 07-03-2024, 09:45 AM
    0 responses
    201 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 07-03-2024, 08:54 AM
    0 responses
    212 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 07-02-2024, 03:00 PM
    0 responses
    194 views
    0 likes
    Last Post seqadmin  
    Working...
    X