Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Data retention policy for Solexa

    With the improving GA and more data coming off the instrument, it becomes even more important to be efficient in what to archive. I think there can be a core set of intensity values and matrices, which can be used at any time with the same version of software to generate the same data. This will obviate the need to save the entire analysis folder.

    Obviously, the assumption here is that images are too large and need to go as soon as they are converted to intensities.

    Any thoughts on this core set of data to back up, which can be later on expanded to the entire run folder for any different analysis? ALso, any other ideas of archiving the 'useful' bit of data off of a solexa run?
    --
    bioinfosm

  • #2
    It should be possible to reconstruct everything from the raw intensity and noise files in the firecrest directory. If you're recalibrating you'd also need to raw data from the control lane as well. So if you store all the raw signals from a run you should be able to reconstruct the processed in intensities, 4 quality scores and basecalls, you'd need to hack the pipeline to do this (or use Swift or another basecaller) but it's entirely possible.

    The crosstalk matrices are calculated from the data itself, so don't need to be stored (though they are small anyway) as are the phasing corrections. The offset matrices are only useful during image analysis. You could store a subset of data from the runlogs which contain Z height and other run information, however this information isn't currently used in my the primary data analysis so isn't really critical.

    Comment

    Latest Articles

    Collapse

    • seqadmin
      Exploring the Dynamics of the Tumor Microenvironment
      by seqadmin




      The complexity of cancer is clearly demonstrated in the diverse ecosystem of the tumor microenvironment (TME). The TME is made up of numerous cell types and its development begins with the changes that happen during oncogenesis. “Genomic mutations, copy number changes, epigenetic alterations, and alternative gene expression occur to varying degrees within the affected tumor cells,” explained Andrea O’Hara, Ph.D., Strategic Technical Specialist at Azenta. “As...
      07-08-2024, 03:19 PM
    • seqadmin
      Exploring Human Diversity Through Large-Scale Omics
      by seqadmin


      In 2003, researchers from the Human Genome Project (HGP) announced the most comprehensive genome to date1. Although the genome wasn’t fully completed until nearly 20 years later2, numerous large-scale projects, such as the International HapMap Project and 1000 Genomes Project, continued the HGP's work, capturing extensive variation and genomic diversity within humans. Recently, newer initiatives have significantly increased in scale and expanded beyond genomics, offering a more detailed...
      06-25-2024, 06:43 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, 07-10-2024, 07:30 AM
    0 responses
    23 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 07-03-2024, 09:45 AM
    0 responses
    200 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 07-03-2024, 08:54 AM
    0 responses
    209 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 07-02-2024, 03:00 PM
    0 responses
    192 views
    0 likes
    Last Post seqadmin  
    Working...
    X