Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Data Pipeline Automation, what are you using?

    I'm curious to know what type of pipeline workflow automation tool people are using these days. At the start of my career, I started cobbling together various shell scripts which quickly turned into an administrative nightmare. Since then, our institute has implemented SeqWare to perform FASTQ file generation, data QC, alignment and some post-processing.

    It would be nice to know what others are using and some of their experiences.

  • #2
    I prefer to make my own pipeline workflow, so I know exactly what the code is and I can change everything. But when it's really necessary I like to use Galaxy.

    Comment


    • #3
      Lots of pipes in shell scripts.
      savetherhino.org

      Comment


      • #4
        Biopieces -> www.biopieces.org

        Comment


        • #5
          Originally posted by maasha View Post
          Biopieces -> www.biopieces.org
          That's in essence how I construct my pipelines, except that I have individually added all the algorithms to my path. So, for example, instead of 'align_pair_seq' I'd use 'muscle' or 'clustal' or whatever does IMO the best job for the given task..
          savetherhino.org

          Comment


          • #6
            Bash scripts and the queuing system on our cluster.

            Comment


            • #7
              Does anyone use GNU makefiles?

              Comment


              • #8
                bash, perl, python and C.
                /* Shawn Driscoll, Gene Expression Laboratory, Pfaff
                Salk Institute for Biological Studies, La Jolla, CA, USA */

                Comment


                • #9
                  Originally posted by asiangg View Post
                  Does anyone use GNU makefiles?
                  I'm a huge fan of makefiles as a very basic workflow system, especially since it works well with sge's qmake.

                  Comment

                  Latest Articles

                  Collapse

                  • seqadmin
                    Choosing Between NGS and qPCR
                    by seqadmin



                    Next-generation sequencing (NGS) and quantitative polymerase chain reaction (qPCR) are essential techniques for investigating the genome, transcriptome, and epigenome. In many cases, choosing the appropriate technique is straightforward, but in others, it can be more challenging to determine the most effective option. A simple distinction is that smaller, more focused projects are typically better suited for qPCR, while larger, more complex datasets benefit from NGS. However,...
                    10-18-2024, 07:11 AM
                  • seqadmin
                    Non-Coding RNA Research and Technologies
                    by seqadmin




                    Non-coding RNAs (ncRNAs) do not code for proteins but play important roles in numerous cellular processes including gene silencing, developmental pathways, and more. There are numerous types including microRNA (miRNA), long ncRNA (lncRNA), circular RNA (circRNA), and more. In this article, we discuss innovative ncRNA research and explore recent technological advancements that improve the study of ncRNAs.

                    Nobel Prize for MicroRNA Discovery
                    This week,...
                    10-07-2024, 08:07 AM

                  ad_right_rmr

                  Collapse

                  News

                  Collapse

                  Topics Statistics Last Post
                  Started by seqadmin, 11-01-2024, 06:09 AM
                  0 responses
                  11 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 10-30-2024, 05:31 AM
                  0 responses
                  14 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 10-24-2024, 06:58 AM
                  0 responses
                  24 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 10-23-2024, 08:43 AM
                  0 responses
                  52 views
                  0 likes
                  Last Post seqadmin  
                  Working...
                  X