Unconfigured Ad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • uri.laserson
    Junior Member
    • Mar 2011
    • 1

    SQL vs NoSQL databases for next-gen data?

    I am interested in people's best practices in using a database to store sequencing data.

    I perform lots of immune sequencing, and each one of my reads gets highly annotated. Early on, when I would want to compute something, I used to iterated through an entire flatfile, building some data structure in python (typically dictionaries of dictionaries). Then I realized that I am doing exactly what databases were designed for, including searching, grouping, etc.

    So I elected to try MongoDB, which is a noSQL database. It was easy to use, as you can just dump JSON objects into it, which was a very natural conversion from python. So far, the performance has been very fast, and I am quite pleased.

    But I am now preparing to generate a large amount of additional data, and was wondering whether it would make sense to try out a traditional SQL database, like MySQL or Postgres. Any thoughts as to how they all compare for sequencing data? How do people typically organize their data in a relational database?

    Thanks!
    Uri
  • Luyi Tian
    Member
    • Mar 2012
    • 15

    #2
    Maybe you should try an ORM(Object Relational Mapper) that mixes the features of Object and relational database. I strongly recommend sqlalchemy, which is written in python and has clear documents and examples.

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      Advanced Sequencing Platforms Tackle Neuroscience’s Toughest Genomics Problems
      by SEQadmin2



      Genomics studies in neuroscience face a special challenge due to the brain’s complexity and scarcity of samples. Mapping changes in cell type and state using conventional next-generation sequencing methods remains challenging. Advances in technologies like single-cell sequencing, spatial transcriptomics, and long-read sequencing have opened the door to deeper studies of the brain and diseases like Alzheimer’s, amyotrophic lateral sclerosis (ALS), and schizophrenia.
      ...
      Yesterday, 11:10 AM
    • SEQadmin2
      Cancer Drug Resistance: The Lingering Barrier to Rising Survival
      by SEQadmin2



      Cancer survival rates have significantly increased in the last few decades in the United States, reaching a combined 70% 5-year survival rate by 2021. Behind this number, there are years of research to find new therapies, drug targets, and early detection methods. But there is one core challenge that keeps slowing down these advances, and it’s about drug resistance.

      There is no single reason why many patients don’t respond to treatment as expected. Cancer is...
      07-08-2026, 05:17 AM
    • GATTACAT
      Reply to Nine Things a Sample Prep Scientist Thinks About Before Sequencing
      by GATTACAT
      Love this - good data definitely starts from good input, and poor input can only give relatively poor data. I particularly like the mention of Nanodrop/absorbance based methods for quantification. It's such a toss up if you'll get an accurate reading or what amounts to a randomly generated number, and a lot of library/sequencing related issues can be traced back to poor quant.
      07-01-2026, 11:43 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, Yesterday, 10:04 AM
    0 responses
    9 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 07-08-2026, 10:08 AM
    0 responses
    7 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 07-07-2026, 11:05 AM
    0 responses
    12 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 07-02-2026, 11:08 AM
    0 responses
    31 views
    0 reactions
    Last Post SEQadmin2  
    Working...