Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • uri.laserson
    Junior Member
    • Mar 2011
    • 1

    #1

    SQL vs NoSQL databases for next-gen data?

    I am interested in people's best practices in using a database to store sequencing data.

    I perform lots of immune sequencing, and each one of my reads gets highly annotated. Early on, when I would want to compute something, I used to iterated through an entire flatfile, building some data structure in python (typically dictionaries of dictionaries). Then I realized that I am doing exactly what databases were designed for, including searching, grouping, etc.

    So I elected to try MongoDB, which is a noSQL database. It was easy to use, as you can just dump JSON objects into it, which was a very natural conversion from python. So far, the performance has been very fast, and I am quite pleased.

    But I am now preparing to generate a large amount of additional data, and was wondering whether it would make sense to try out a traditional SQL database, like MySQL or Postgres. Any thoughts as to how they all compare for sequencing data? How do people typically organize their data in a relational database?

    Thanks!
    Uri
  • Luyi Tian
    Member
    • Mar 2012
    • 15

    #2
    Maybe you should try an ORM(Object Relational Mapper) that mixes the features of Object and relational database. I strongly recommend sqlalchemy, which is written in python and has clear documents and examples.

    Comment

    Latest Articles

    Collapse

    • SEQadmin2
      Beyond CRISPR/Cas9: Understand, Choose, and Use the Right Genome Editing Tool
      by SEQadmin2



      CRISPR/Cas9 sparked the gene editing revolution for both research and therapeutics.1 But this system still showed severe issues that limited its applications. The most prominent were the heavy reliance on PAM sequences, delivery limitations, double-stranded breaks that prompt unintended edits and cell death, and editing inefficiency (both in targeting and in knock-in reliability).

      Despite this, “CRISPR helped turn genome editing from a specialized technique into
      ...
      07-31-2026, 11:01 AM
    • SEQadmin2
      Proteomic Platforms: How to Choose the Right Analytical Strategy to Improve Detection and Clinical Applications
      by SEQadmin2


      Proteomics platforms are evolving rapidly, with advances in mass spectrometry and affinity-based approaches expanding what researchers can detect and at what scale. As the field moves toward deeper proteome coverage and clinical applications, scientists face an increasingly complex landscape of tools. This article will explore how researchers are navigating these choices to find the right platform for their work.

      The systematic characterization of the human proteome has
      ...
      07-20-2026, 11:48 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by SEQadmin2, Today, 10:05 AM
    0 responses
    5 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 08-13-2026, 12:22 PM
    0 responses
    32 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 08-11-2026, 10:35 AM
    0 responses
    24 views
    0 reactions
    Last Post SEQadmin2  
    Started by SEQadmin2, 08-06-2026, 07:41 AM
    0 responses
    38 views
    0 reactions
    Last Post SEQadmin2  
    Working...