Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Checkpointing in Newbler

    Hello Everyone,

    I have a question, may be too simple but I don't know how to do that. I had been running Newbler on the data having reads from 454 and Illumina paired end sequencing. Because of some reason i had to restart the machine and stop the assembly in the middle. Now I want to resume that again from the last checkpoint, but don't know how to do that. Does anyone have any suggestions for that?

  • #2
    I doubt you can resume. Also I did nit try to stop assembly or mapping, several times v.2.7 programs exited with error after computations were essentially complete as all files were present in relevant folders. Yet the assembly or mapping projects could not be opened and considered corrupted after restarting the program. Files can be opened and examined by other programs. There are a whole bunch of invisible files in the result folder with all kinds of metadata, which are unusable if programs did not exit normally.

    Comment


    • #3
      I read it in the blog written by Lex Nederbragt about Newbler:

      http://contig.wordpress.com/about/

      From the following part of the blog, I assume its possible to resume assembly if stopped anyway:

      "After long overlap follows short overlap:

      Setting up overlap detection…
      XXXXXXX reads to align
      Building a tree for YYYYYYYY seeds…
      Computing alignments…

      Then the curious message appears:

      Checkpointing…

      Basically, checkpointing means writing the intermediate results to disc, so that in the case of a crash, you could continue the assembly from the last ‘checkpoint’. "

      Comment


      • #4
        Although I did not read the blog yet (would be interesting though), such role of checkpointing makes a little sense to me. The most computing-intensive job, aligning reads, happens before that. If program crashes at this phase, like running out of memory or whatever, no resume can be done as checkpointing have not started yet. In my crash cases, programs crashed after checkpointing is done, even after the generating output phase, but the whole project still remains corrupted as result.

        Comment


        • #5
          For me it crashed at the end when it was detangling allignments, thats y i was looking for a way to use the already aligned reads and finishing the assembly step.but seems i have to start that again.

          Comment


          • #6
            You could try 'cd' into the folder that newbler created. If you do
            Code:
            ls -la assembly/
            you'll see a bunch of hidden files. You can try to restart the assembly with the runProject command. See http://contig.wordpress.com/2010/06/...novo-assembly/

            Repeat the parameters you gave to runAssembly that are appropriate (use runProject --help to check which ones you can use).

            Good luck!

            Comment

            Latest Articles

            Collapse

            • seqadmin
              Exploring the Dynamics of the Tumor Microenvironment
              by seqadmin




              The complexity of cancer is clearly demonstrated in the diverse ecosystem of the tumor microenvironment (TME). The TME is made up of numerous cell types and its development begins with the changes that happen during oncogenesis. “Genomic mutations, copy number changes, epigenetic alterations, and alternative gene expression occur to varying degrees within the affected tumor cells,” explained Andrea O’Hara, Ph.D., Strategic Technical Specialist at Azenta. “As...
              07-08-2024, 03:19 PM
            • seqadmin
              Exploring Human Diversity Through Large-Scale Omics
              by seqadmin


              In 2003, researchers from the Human Genome Project (HGP) announced the most comprehensive genome to date1. Although the genome wasn’t fully completed until nearly 20 years later2, numerous large-scale projects, such as the International HapMap Project and 1000 Genomes Project, continued the HGP's work, capturing extensive variation and genomic diversity within humans. Recently, newer initiatives have significantly increased in scale and expanded beyond genomics, offering a more detailed...
              06-25-2024, 06:43 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by seqadmin, 07-10-2024, 07:30 AM
            0 responses
            24 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 07-03-2024, 09:45 AM
            0 responses
            201 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 07-03-2024, 08:54 AM
            0 responses
            210 views
            0 likes
            Last Post seqadmin  
            Started by seqadmin, 07-02-2024, 03:00 PM
            0 responses
            192 views
            0 likes
            Last Post seqadmin  
            Working...
            X