Long term backup of RNA seq data files

[Drerio]

We plan to put fastq files generated in several RNA seq projects into long term storage using a local service. Because we are working with hundreds of fastq files, we are trying to determine the best method to store the files. The choice is between grouping all of the files into one giant tarball for storage or to break up the fastq files into individual project. One is easier to store, one is easier to access later (for meta-analyses?). Does anyone have any idea whether it makes sense to spend the extra effort to organize the files now?

[Brian Bushnell]

Trying to recover some specific piece of data would be a nightmare if you make one giant tarball; depending on the overall size, it's faster, cheaper and probably just as useful to simply delete all the data, rather than sending it to long-term storage in a disorganized mess.

[Zapages]

We plan to put fastq files generated in several RNA seq projects into long term storage using a local service. Because we are working with hundreds of fastq files, we are trying to determine the best method to store the files. The choice is between grouping all of the files into one giant tarball for storage or to break up the fastq files into individual project. One is easier to store, one is easier to access later (for meta-analyses?). Does anyone have any idea whether it makes sense to spend the extra effort to organize the files now?

I would break it based on project and with a simple read me file with each folder to describe whats in each folder.

[Drerio]

Thanks very much for responding. Based on your advice, I will break up the files into groups.