Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • #76
    Its also easy to "encourage" people to help with the process, if you want to download from the main repository, you have to work for it. This will encourage universities to setup a server with a mirror. The NCBI can keep track of who is helping a lot and who is just leeching the system, leechers are put on a low priority. You could even spur companies that could charge for passwords to their mirrors...

    Comment


    • #77
      There's always "petabyte sneakernet" : http://www.codinghorror.com/blog/200...bandwidth.html

      Maybe the Netflix model of a few years ago is the answer; instead of DVDs in the mail, computer cases with 8 bays of 3TB drives using "high bandwidth" Fedex trucks.

      Comment


      • #78
        As previously mentioned, torrents are as good as the number of sites willing to seed. NGS crowd is not that big yet. But if you use seqanswers as a measure of how fast it grows - torrent may become a feasible option in the future. Add to that universities, hospitals, federal agencies other then NIH who are beginnig to wake up to archival of NGS - they do have enough resources to seed the data.

        Fedex solution while making a good joke is impractical. This argument is second only to "use fridge instead of NetApp".

        And about compression. Look at compression not as a general "gzip fastq", but what real information do you really store. In resequencing ~90% of raw sequences perfectly match the reference. In functional sequencing you frequently end up with highly repetitive reads. Do you really care about pixel coordinates of every read? Do you really trust machine quality scores or recalibration approach is more then sufficient? etc...
        Last edited by srasdk; 09-27-2011, 08:08 PM. Reason: thumb-down icon was selected by accident

        Comment


        • #79
          Its just a matter of implementing a system where you give a higher priority to people that help distribute the files, that should be enough to get a wide base of nodes. Regarding compression, it will only get you so far. Think of a world in which sequencing a chromatin mark or a TF is $100, beware big data is comming...

          Comment


          • #80
            Many torrents (especially "Pirate Bay"-style) do prioritize distributors over downloaders. This is not a technical problem.
            Total cost of sequencing needs to include not only reagents, but sample collection and preparation, lab technician time, reproducibility of a sample, time to repeat experiment, etc. When this cost will be low enough to make archival economically senseless, it will stop. Compare it to "blood work": if physician doesn't believe in red cell counts, it is much cheaper to redo the test than to figure out what went wrong.

            Comment


            • #81
              seq more information

              Originally posted by srasdk View Post
              In resequencing ~90% of raw sequences perfectly match the reference.
              1. Will you supply bibliographic citation for this observation?

              Originally posted by srasdk View Post
              When this cost will be low enough to make archival economically senseless, it will stop.
              2. What will do for comparative biological/phylogenetic studies?

              Thanks.

              Comment


              • #82
                1. The observation is general and not precise. It was done while working with the recent 1000 Genomes data. Sorry - the statement was too broad. Homo sapiens is a very inbred species and any personal germline genome is very close to the reference. Somatic changes (cancer) are more unpredictable. If you are interested in in biological diversity other then human, then you were right in confronting the statement, but currently NGS data production is heavily tilted toward human.

                2. Before NGS phylogenetic studies were submitted as final and annotated sequences to GenBank. When community becomes confident that it can extract most of the information from raw data, there will be no point of archiving intermediate results.

                Comment


                • #83

                  Comment

                  Latest Articles

                  Collapse

                  • seqadmin
                    Exploring the Dynamics of the Tumor Microenvironment
                    by seqadmin




                    The complexity of cancer is clearly demonstrated in the diverse ecosystem of the tumor microenvironment (TME). The TME is made up of numerous cell types and its development begins with the changes that happen during oncogenesis. “Genomic mutations, copy number changes, epigenetic alterations, and alternative gene expression occur to varying degrees within the affected tumor cells,” explained Andrea O’Hara, Ph.D., Strategic Technical Specialist at Azenta. “As...
                    07-08-2024, 03:19 PM
                  • seqadmin
                    Exploring Human Diversity Through Large-Scale Omics
                    by seqadmin


                    In 2003, researchers from the Human Genome Project (HGP) announced the most comprehensive genome to date1. Although the genome wasn’t fully completed until nearly 20 years later2, numerous large-scale projects, such as the International HapMap Project and 1000 Genomes Project, continued the HGP's work, capturing extensive variation and genomic diversity within humans. Recently, newer initiatives have significantly increased in scale and expanded beyond genomics, offering a more detailed...
                    06-25-2024, 06:43 AM

                  ad_right_rmr

                  Collapse

                  News

                  Collapse

                  Topics Statistics Last Post
                  Started by seqadmin, 07-19-2024, 07:20 AM
                  0 responses
                  37 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 07-16-2024, 05:49 AM
                  0 responses
                  47 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 07-15-2024, 06:53 AM
                  0 responses
                  59 views
                  0 likes
                  Last Post seqadmin  
                  Started by seqadmin, 07-10-2024, 07:30 AM
                  0 responses
                  43 views
                  0 likes
                  Last Post seqadmin  
                  Working...
                  X