Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Analysis pipeline tools: make? bpipe? snakemike

    I'm interested in putting some of my analysis into an easy to run pipeline. It seems like a make file is the way to go. However, it seems like people have written a number of tools such as snakemake and bpipe to make it easier to run bioinformatic pipeline scripts. I was just wondering if anyone is using any of these and which one is the best?
    Thanks

  • #2
    I use make because

    * I already know the syntax
    * it fulfills my needs
    * it is parallelized (option -j)
    * cluster managers like SGE or SLURM have a specialized version of make


    my problem with make is 'choosing': telling 'make' at runtime that if, e.g, "a Fastq QC failed, then it shouldn't map the reads for this sample"

    Comment


    • #3
      bpipe is great, just make sure the files are clearly named at the start.

      The linux utility "rename" is nice for batch renaming files.

      Comment


      • #4
        I'll give a quick shout out to Bpipe, I use it and recommend it. I have limited experience with make, but don't think I could lean on it as heavily as I do Bpipe to handle my workflows. If nothing else, I like the ability to define a library of named Bpipe methods, then just chain them together by name into a pipeline. You can use some clever parentheses to parallelize a certain subset of steps, then have subsequent steps await the results before continuing. Also, it does useful things like keeping files representing paired-end reads together throughout the workflow.



        To address another important criterion when selecting this type of tool, the authors are very active in the discussion group, and are quick to implement sensible updates per feedback and requests. See their Google Groups entry: https://groups.google.com/forum/#!forum/bpipe-discuss

        My only critique is that sometimes the tips and tricks are still buried in the discussions and not fully described on their FAQ. However, their FAQ is still quite good.

        Comment

        Latest Articles

        Collapse

        • seqadmin
          Essential Discoveries and Tools in Epitranscriptomics
          by seqadmin


          The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist on Modified Bases...
          Yesterday, 07:01 AM
        • seqadmin
          Current Approaches to Protein Sequencing
          by seqadmin


          Proteins are often described as the workhorses of the cell, and identifying their sequences is key to understanding their role in biological processes and disease. Currently, the most common technique used to determine protein sequences is mass spectrometry. While still a valuable tool, mass spectrometry faces several limitations and requires a highly experienced scientist familiar with the equipment to operate it. Additionally, other proteomic methods, like affinity assays, are constrained...
          04-04-2024, 04:25 PM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by seqadmin, 04-11-2024, 12:08 PM
        0 responses
        55 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 04-10-2024, 10:19 PM
        0 responses
        52 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 04-10-2024, 09:21 AM
        0 responses
        45 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 04-04-2024, 09:00 AM
        0 responses
        55 views
        0 likes
        Last Post seqadmin  
        Working...
        X