Header Leaderboard Ad

Collapse

Updates on traffic/errors...

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Updates on traffic/errors...

    So if you've been here for the last three days you've probably noticed some sporadic performance...apologies for that.

    I'm continuing to monitor it (and please continue emailing me if you run into problems), but it seems like the cause was that Baidu (search engine) has been indexing the wiki and forums with a crazy amount of robotic power. Meaning 6-8 requests per second, from ~30 different IPs, of different complex wiki pages that bring the database server to it's knees.

    I am now blocking their IPs, we'll see if it holds.

    Grrrrrrrrrr.

  • #2
    I understand that Baiduspider does not respect the robots.txt !

    http://seqanswers.com/robots.txt

    User-agent: *
    Disallow: /w/
    Disallow: /wiki/Special:


    User-agent: Baiduspider
    Disallow: /

    Comment

    Latest Articles

    Collapse

    • seqadmin
      A Brief Overview and Common Challenges in Single-cell Sequencing Analysis
      by seqadmin


      ​​​​​​The introduction of single-cell sequencing has advanced the ability to study cell-to-cell heterogeneity. Its use has improved our understanding of somatic mutations1, cell lineages2, cellular diversity and regulation3, and development in multicellular organisms4. Single-cell sequencing encompasses hundreds of techniques with different approaches to studying the genomes, transcriptomes, epigenomes, and other omics of individual cells. The analysis of single-cell sequencing data i...

      01-24-2023, 01:19 PM
    • seqadmin
      Introduction to Single-Cell Sequencing
      by seqadmin
      Single-cell sequencing is a technique used to investigate the genome, transcriptome, epigenome, and other omics of individual cells using high-throughput sequencing. This technology has provided many scientific breakthroughs and continues to be applied across many fields, including microbiology, oncology, immunology, neurobiology, precision medicine, and stem cell research.

      The advancement of single-cell sequencing began in 2009 when Tang et al. investigated the single-cell transcriptomes
      ...
      01-09-2023, 03:10 PM

    ad_right_rmr

    Collapse
    Working...
    X