Seqanswers Leaderboard Ad
Collapse
Announcement
Collapse
No announcement yet.
X
-
If you don't want to deal with MySQL then you can use FTP directly as pointed by @Markiyan: ftp://ftp.ensembl.org/pub/release-83.../homo_sapiens/ Look for the latest release-NN directory.
-
Yeah, I think it just a random error but for big download, the error quite often. As for my need, I just occacionally need some data but probably I will try to download the mysql because I only need human database and it quite specific.
Leave a comment:
-
Try in the different time of the day/weekend also try develop your ovn error handling
As far, as I remember, some bits of the ensembl used to be hosted on the amazon...
While cloud has some advantages, the correct configuration of these services (supply/demand side management is also extremelly important)...
Othervice it looks like there was not adequate provisioning, when the demant went up or some internet link to their server simply got overloaded...
Another problem is the lack of proper error handling in dome bioperl/biopyhon modules, when the data retrieval error just aborts the whole program instead of returning some error status, so the main program can handle it.
So to overcome the reality of the internet based environment one needs either:
1. If data needed once - make a resilient pipeline, which does data retival as a separate process for each request, and saves the results to separate file on the disk. Then the master process checks the batch, and retries the broken parts.
2. If data needed constantly - than decide which databases are needed, download mysql dump(s) from the ftp.ensembl.org/pub ftp site and setup a local mysql mirror.
Than use DBI/Mysql to query the db(s).
Leave a comment:
-
Latest Articles
Collapse
-
by seqadmin
Innovations in next-generation sequencing technologies and techniques are driving more precise and comprehensive exploration of complex biological systems. Current advancements include improved accessibility for long-read sequencing and significant progress in single-cell and 3D genomics. This article explores some of the most impactful developments in the field over the past year.
Long-Read Sequencing
Long-read sequencing has seen remarkable advancements,...-
Channel: Articles
12-02-2024, 01:49 PM -
ad_right_rmr
Collapse
News
Collapse
Topics | Statistics | Last Post | ||
---|---|---|---|---|
Started by seqadmin, 12-02-2024, 09:29 AM
|
0 responses
158 views
0 likes
|
Last Post
by seqadmin
12-02-2024, 09:29 AM
|
||
Started by seqadmin, 12-02-2024, 09:06 AM
|
0 responses
56 views
0 likes
|
Last Post
by seqadmin
12-02-2024, 09:06 AM
|
||
Started by seqadmin, 12-02-2024, 08:03 AM
|
0 responses
48 views
0 likes
|
Last Post
by seqadmin
12-02-2024, 08:03 AM
|
||
Started by seqadmin, 11-22-2024, 07:36 AM
|
0 responses
76 views
0 likes
|
Last Post
by seqadmin
11-22-2024, 07:36 AM
|
Leave a comment: