Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • bfast match "hangs" while reading index

    When I run bfast match (version 0.7.0a), the program often "hangs" while reading the index (as evidenced by the last line of output to stderr):

    Reading index from /path/to/NFSfilesystem/hg19.fasta.nt.2.1.bif.
    If I look at the process with "top" it is still active. Generally, loading an index file takes 5-8 minutes (from the timing info provided from bfast); but, often times I've had it take up to 15 hours! This most often happens when I submit the processes to our PBS cluster. When I run them 'locally' (but on the same machines/disks that are in the PBS cluster), I don't have this issue (though the sample size is much smaller than when I submit to the cluster, since I'm submitting 20+ bfast match commands at the same time). I realize this could be a consequence of high disk/network usage (the index files and FASTQ files are located on a shared NFS GPFS filesystem on high performance dedicated fileservers), but I thought I would see if anyone else sees this issue.

    An example command line call:

    Code:
    bfast match -A 0 -t -n 16 -f /path/to/NFSfilesystem/hg19.fasta -r /path/to/NFSfilesystem/Sample.fastq.gz  -i 4 -z -T /localdisk/scratch/  > /path/to/NFSfilesystem/D1BUKACXX_MN02_002_4.bmf
    Thanks!

  • #2
    Not directly a problem with BFAST

    I've determined this is not an issue with BFAST per se, but a combination with running BFAST match through my ruffus-based pipeline. A similar issue has been noticed when using SGE (I'm using PBS Pro), also not specific to BFAST. It seems to be related to the submission script polling for input (see http://ruffus.org.uk/faq.html under "qrsh eats up all my processor time under ruffus"). Though, in my pipeline, this only happens when using bfast match (not localalign, postprocess, or merge).

    Comment

    Latest Articles

    Collapse

    • seqadmin
      Best Practices for Single-Cell Sequencing Analysis
      by seqadmin



      While isolating and preparing single cells for sequencing was historically the bottleneck, recent technological advancements have shifted the challenge to data analysis. This highlights the rapidly evolving nature of single-cell sequencing. The inherent complexity of single-cell analysis has intensified with the surge in data volume and the incorporation of diverse and more complex datasets. This article explores the challenges in analysis, examines common pitfalls, offers...
      06-06-2024, 07:15 AM
    • seqadmin
      Latest Developments in Precision Medicine
      by seqadmin



      Technological advances have led to drastic improvements in the field of precision medicine, enabling more personalized approaches to treatment. This article explores four leading groups that are overcoming many of the challenges of genomic profiling and precision medicine through their innovative platforms and technologies.

      Somatic Genomics
      “We have such a tremendous amount of genetic diversity that exists within each of us, and not just between us as individuals,”...
      05-24-2024, 01:16 PM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, 06-17-2024, 06:54 AM
    0 responses
    10 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 06-14-2024, 07:24 AM
    0 responses
    20 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 06-13-2024, 08:58 AM
    0 responses
    17 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 06-12-2024, 02:20 PM
    0 responses
    20 views
    0 likes
    Last Post seqadmin  
    Working...
    X