Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Batch processing of files through tophat etc

    If i have a large amount of files i want to run through tophat, htseq and DEseq or other software, do anyone have a neat way (for example a shell script) for doing batch processing so it will start the next run when the previous have finished, so i do not have to start the programs my self with the new parameters?

    Bjørn
    Bjørn Øst

  • #2
    I have various shell scripts for these sorts of things (I expect that's common). Generally you would need to tailor something like that to whatever your experimental design is and your particular file structure (i.e., where the sequence and annotation files are). If you need some examples to get you started, just send me your email address in a private message and I can send a few examples to you.

    Comment


    • #3
      For most simple batch processing I often just use a simple bash loop which will run the jobs serially. If you're going to do this a lot you might want to look into adding some error checks and reporting so you can track down what went wrong if it doesn't work. If you want to work on a larger scale you could also look at a proper queueing system, but that's a whole other level of work.

      An example of one we did recently to map a pile of fastq files with bowtie would be:

      Code:
      for i in *.fastq.gz
      do zcat $i | bowtie -f -m 1 --strata --best -p 6 --chunkmbs=512 --sam /data/public/Genomes/Mouse/NCBIM37/Mus_musculus.NCBIM37 -  > ${i}.sam
      done

      Comment


      • #4
        Thank you both, that was just what i needed to get started
        Bjørn Øst

        Comment

        Latest Articles

        Collapse

        • seqadmin
          The Impact of AI in Genomic Medicine
          by seqadmin



          Artificial intelligence (AI) has evolved from a futuristic vision to a mainstream technology, highlighted by the introduction of tools like OpenAI's ChatGPT and Google's Gemini. In recent years, AI has become increasingly integrated into the field of genomics. This integration has enabled new scientific discoveries while simultaneously raising important ethical questions1. Interviews with two researchers at the center of this intersection provide insightful perspectives into...
          02-26-2024, 02:07 PM
        • seqadmin
          Multiomics Techniques Advancing Disease Research
          by seqadmin


          New and advanced multiomics tools and technologies have opened new avenues of research and markedly enhanced various disciplines such as disease research and precision medicine1. The practice of merging diverse data from various ‘omes increasingly provides a more holistic understanding of biological systems. As Maddison Masaeli, Co-Founder and CEO at Deepcell, aptly noted, “You can't explain biology in its complex form with one modality.”

          A major leap in the field has
          ...
          02-08-2024, 06:33 AM

        ad_right_rmr

        Collapse

        News

        Collapse

        Topics Statistics Last Post
        Started by seqadmin, 02-28-2024, 06:12 AM
        0 responses
        21 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-23-2024, 04:11 PM
        0 responses
        69 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-21-2024, 08:52 AM
        0 responses
        77 views
        0 likes
        Last Post seqadmin  
        Started by seqadmin, 02-20-2024, 08:57 AM
        0 responses
        67 views
        0 likes
        Last Post seqadmin  
        Working...
        X