Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Best deployment method of NGS tools on a cluster?

    Howdy everyone,
    We are building a small rocks cluster (4-5 nodes to start) and I am hoping to configure it to perform some denovo tools (abyss and trinity) but also to be able to run the tuxedo suite(bowtie, tophay, cufflinks). The question I have is there any way to deploy bowtie runs across machines (using something like SGE or PBS)? It seems like using myrna or crossbow would require making the cluster a hadoop cluster correct? Switching to Hadoop seems interchangeable and I'm not sure about having a hadoop cluster if we decide we want run other applications on it. Any advice folks have is muchly appreciated. Thanks!!
    -Rich

  • #2
    Rich: We have been using SGE with rocks for some time. But PBS should work as well.

    I also wanted to put a plug in for "modules" project. It makes management of multiple software versions/environment a breeze. It works well with Rocks http://modules.sourceforge.net/

    Comment


    • #3
      awesome , so you are using SGE with Bowtie? what tools are using with it?

      Comment


      • #4
        Originally posted by greener View Post
        Switching to Hadoop seems interchangeable and I'm not sure about having a hadoop cluster if we decide we want run other applications on it. Any advice folks have is muchly appreciated. Thanks!!
        -Rich
        From what I have seen hadoop doesn't play well with other types of apps, and most informatics apps don't really need the hadoop functionality. Though at a super high level meeting of business managers and non-computational-biologists, you might be able to sell hadoop as a easy and simple way to do high throughput computing in a map reduce framework using general purpose hardware and cheap java labor

        Comment


        • #5
          SGE is the default queuing system on our rocks cluster. We run all jobs through SGE. Primary (CASAVA, PacBio SMRTanalysis) and secondary data analysis.

          BioTeam has info on using SGE. This link should get you started: http://bioteam.net/2009/09/sge-training-slides/

          Originally posted by greener View Post
          awesome , so you are using SGE with Bowtie? what tools are using with it?

          Comment

          Latest Articles

          Collapse

          • seqadmin
            Strategies for Sequencing Challenging Samples
            by seqadmin


            Despite advancements in sequencing platforms and related sample preparation technologies, certain sample types continue to present significant challenges that can compromise sequencing results. Pedro Echave, Senior Manager of the Global Business Segment at Revvity, explained that the success of a sequencing experiment ultimately depends on the amount and integrity of the nucleic acid template (RNA or DNA) obtained from a sample. “The better the quality of the nucleic acid isolated...
            03-22-2024, 06:39 AM
          • seqadmin
            Techniques and Challenges in Conservation Genomics
            by seqadmin



            The field of conservation genomics centers on applying genomics technologies in support of conservation efforts and the preservation of biodiversity. This article features interviews with two researchers who showcase their innovative work and highlight the current state and future of conservation genomics.

            Avian Conservation
            Matthew DeSaix, a recent doctoral graduate from Kristen Ruegg’s lab at The University of Colorado, shared that most of his research...
            03-08-2024, 10:41 AM

          ad_right_rmr

          Collapse

          News

          Collapse

          Topics Statistics Last Post
          Started by seqadmin, Yesterday, 06:37 PM
          0 responses
          7 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, Yesterday, 06:07 PM
          0 responses
          7 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 03-22-2024, 10:03 AM
          0 responses
          49 views
          0 likes
          Last Post seqadmin  
          Started by seqadmin, 03-21-2024, 07:32 AM
          0 responses
          66 views
          0 likes
          Last Post seqadmin  
          Working...
          X