Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Data Pipeline Automation, what are you using?

    I'm curious to know what type of pipeline workflow automation tool people are using these days. At the start of my career, I started cobbling together various shell scripts which quickly turned into an administrative nightmare. Since then, our institute has implemented SeqWare to perform FASTQ file generation, data QC, alignment and some post-processing.

    It would be nice to know what others are using and some of their experiences.

  • #2
    I prefer to make my own pipeline workflow, so I know exactly what the code is and I can change everything. But when it's really necessary I like to use Galaxy.

    Comment


    • #3
      Lots of pipes in shell scripts.
      savetherhino.org

      Comment


      • #4
        Biopieces -> www.biopieces.org

        Comment


        • #5
          Originally posted by maasha View Post
          Biopieces -> www.biopieces.org
          That's in essence how I construct my pipelines, except that I have individually added all the algorithms to my path. So, for example, instead of 'align_pair_seq' I'd use 'muscle' or 'clustal' or whatever does IMO the best job for the given task..
          savetherhino.org

          Comment


          • #6
            Bash scripts and the queuing system on our cluster.

            Comment


            • #7
              Does anyone use GNU makefiles?

              Comment


              • #8
                bash, perl, python and C.
                /* Shawn Driscoll, Gene Expression Laboratory, Pfaff
                Salk Institute for Biological Studies, La Jolla, CA, USA */

                Comment


                • #9
                  Originally posted by asiangg View Post
                  Does anyone use GNU makefiles?
                  I'm a huge fan of makefiles as a very basic workflow system, especially since it works well with sge's qmake.

                  Comment

                  Latest Articles

                  Collapse

                  • seqadmin
                    Recent Advances in Sequencing Technologies
                    by seqadmin







                    Innovations in next-generation sequencing technologies and techniques are driving more precise and comprehensive exploration of complex biological systems. Current advancements include improved accessibility for long-read sequencing and significant progress in single-cell and 3D genomics. This article explores some of the most impactful developments in the field over the past year.

                    Long-Read Sequencing
                    Long-read sequencing has...
                    12-02-2024, 01:49 PM
                  • seqadmin
                    Genetic Variation in Immunogenetics and Antibody Diversity
                    by seqadmin



                    The field of immunogenetics explores how genetic variations influence immune responses and susceptibility to disease. In a recent SEQanswers webinar, Oscar Rodriguez, Ph.D., Postdoctoral Researcher at the University of Louisville, and Ruben Martínez Barricarte, Ph.D., Assistant Professor of Medicine at Vanderbilt University, shared recent advancements in immunogenetics. This article discusses their research on genetic variation in antibody loci, antibody production processes,...
                    11-06-2024, 07:24 PM

                  ad_right_rmr

                  Collapse

                  News

                  Collapse

                  Topics Statistics Last Post
                  Started by seqadmin, 12-02-2024, 09:29 AM
                  0 responses
                  134 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 12-02-2024, 09:06 AM
                  0 responses
                  48 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 12-02-2024, 08:03 AM
                  0 responses
                  38 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 11-22-2024, 07:36 AM
                  0 responses
                  69 views
                  0 likes
                  Last Post seqadmin  
                  Working...
                  X