Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Issues with CASAVA 1.8.1

    I am having some trouble with the Bcl to FastQ conversion in CASAVA 1.8.1. I imagine it might be a very stupid question (mostly because I couldn't find any trace of it being asked around the web), but how do I use the position files? When I give the command "make" (after making the "SampleSheet" and "make" files), it doesn't return the FastQ files, but instead returns the repeated error "failed to read position from pos file <path to _pos.txt file>". I know CASAVA can also use .locs and .clocs, but those are the _pos.txt appear on my computer already, so I thought of using them in the configureBclToFastq.pl, but for some reason it goes wrong there. Can anyone help me with this?
    "Though it may seem that all's been said and done, originality still lives on" - some unoriginal guy who had nothing better to write as his signature

  • #2
    The BCL to fastq converter is supposed to figure out which type of position file it looks for based on the RTA version.

    Do you have access to the entire flowcell data folder for this run?

    Comment


    • #3
      So far as I know, yes.
      Ah, I think I found the problem: I get an "Error:<Date> <Time>: No such file or directory: /<path>/BclReader.cpp". I'll figure it out by myself, thank you.
      "Though it may seem that all's been said and done, originality still lives on" - some unoriginal guy who had nothing better to write as his signature

      Comment


      • #4
        was this issue ever resolved, if so how? - I have the same problem in in v1.8.2

        Comment


        • #5
          Can you be more specific about what problem you are encountering?

          Are you getting the same error as the original poster? Do you have access to the *entire* flowcell folder?

          Originally posted by singhp5 View Post
          was this issue ever resolved, if so how? - I have the same problem in in v1.8.2

          Comment


          • #6
            yes, I have access to the entire flowcell folder, but what I'm doing is running the following command:

            /usr/local/bin/configureBclToFastq.pl --input-dir /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls --output-dir /seqout/c6 --sample-sheet /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/SampleSheet.csv --use-bases-mask Y101,I8,I8,Y101 --tiles s_1_1101 --force

            which runs, but when I go to /seqout/c6 directory and type make -j 6

            I get:

            [2012-06-07 18:01:46] [eggbeater.local] [Temp/L001_R2_demux_summary.xml] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
            [2012-06-07 18:01:46] [eggbeater.local] [Temp/L001_R2_demux_summary.xml] std::exception::what: Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/Ba$
            [2012-06-07 18:01:46] [eggbeater.local] [Temp/L001_R2_demux_summary.xml] : Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L001/C167.1/s_8_1101.bcl
            make: *** [Temp/L001_R2_demux_summary.xml] Error 1
            make: *** Waiting for unfinished jobs....
            [2012-06-07 18:01:48] [eggbeater.local] [Temp/L001_R1_demux_summary.xml] Error: 2012-Jun-07 18:01:48: Operation not permitted: /home/software/CASAVA_v1.8.2/src/c++/lib/alignment/BclReader.cpp(97): Throw in function unsigned int casava::alignment::BclReader::readClusterCount()
            [2012-06-07 18:01:48] [eggbeater.local] [Temp/L001_R1_demux_summary.xml] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
            [2012-06-07 18:01:48] [eggbeater.local] [Temp/L001_R1_demux_summary.xml] std::exception::what: Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L001/C101.1/s_8_1102.bcl
            [2012-06-07 18:01:48] [eggbeater.local] [Temp/L001_R1_demux_summary.xml] : Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L001/C101.1/s_8_1102.bcl
            make: *** [Temp/L001_R1_demux_summary.xml] Error 1

            however both files /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L001/C101.1/s_8_1101.bcl
            and /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L001/C101.1/s_8_1102.bcl are present
            Last edited by singhp5; 06-08-2012, 04:30 AM.

            Comment


            • #7
              Originally posted by singhp5 View Post
              --use-bases-mask Y101,I8,I8,Y101
              The format on this command option may be incorrect (unless you are using dual indexing, are you?).

              You should use Y101,I7n,Y101 (or Y101,I8,Y101 if you must). Illumina has generally recommended ignoring the last base in the index read (thus I7n).

              Also did you make sure that the relevant folders/files are readable by the "user" account that is running the demultiplexing command.
              Last edited by GenoMax; 06-08-2012, 05:49 AM.

              Comment


              • #8
                yes, using dual indexing , so have to keep all 4 components in the line

                I'm using the root account, which has full read/write access on all folder/file, haven't setup any users yet, was planning to once I had successful output.

                Still have the same error as above when I try a smaller run:

                /usr/local/bin/configureBclToFastq.pl
                --input-dir /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls
                --output-dir /seqout/DengTest
                --sample-sheet /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/Deng_3.csv
                --use-bases-mask Y101,I8,I8,Y101 --tiles s_3_111[0-3]

                any other ideas?

                Comment


                • #9
                  (a) Try to convert without '--tiles' , just for testing. Do you get the same errors?
                  (b) And you should have a look at the make output; the real error occurs earlier as
                  posted before. (c) Just retyping make after the conversion crash should "isolate" the
                  real error from the other stuff.

                  my 2p, Sven

                  Comment


                  • #10
                    I ran without '--tiles', then repeated make, took the output and looked for the first error message, still the same outcome:

                    [2012-06-11 10:22:40] [localserv] [ecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt] make Cmd: cat /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/Matrix/s_1_3_2111_matrix.txt >Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt.tmp && mv Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt.tmp Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt
                    [2012-06-11 10:22:40] [localserv] [ecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt] make Cmd: cat /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/Matrix/s_1_3_2110_matrix.txt >Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt.tmp && mv Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt.tmp Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt
                    [2012-06-11 10:22:40] [localserv] [ecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt] cat: /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/Matrix/s_1_3_2111_matrix.txt: Operation not permitted
                    Need a job token; we have children
                    Duplicate the job FD
                    Live child 0x01fa3530 (Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt) PID 4244
                    Live child 0x01fa5190 (Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt) PID 4243
                    Live child 0x01f44910 (Temp/L003_R2_demux_summary.xml) PID 31067
                    Live child 0x01f36c70 (Temp/L003_R1_demux_summary.xml) PID 30999
                    Reaping losing child 0x01fa3530 PID 4244
                    make: *** [Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt] Error 1
                    Removing child 0x01fa3530 PID 4244 from chain.
                    Released token for child 0x01fa3530 (Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2111_matrix.txt).
                    make: *** Waiting for unfinished jobs....
                    Live child 0x01fa5190 (Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt) PID 4243
                    Live child 0x01f44910 (Temp/L003_R2_demux_summary.xml) PID 31067
                    Live child 0x01f36c70 (Temp/L003_R1_demux_summary.xml) PID 30999
                    [2012-06-11 10:22:40] [localserv] [ecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt] cat: /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/Matrix/s_1_3_2110_matrix.txt: Operation not permitted
                    Reaping losing child 0x01fa5190 PID 4243
                    make: *** [Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt] Error 1
                    Removing child 0x01fa5190 PID 4243 from chain.
                    Released token for child 0x01fa5190 (Basecall_Stats_C0RAPACXX/Matrix/s_1_3_2110_matrix.txt).
                    Live child 0x01f44910 (Temp/L003_R2_demux_summary.xml) PID 31067
                    Live child 0x01f36c70 (Temp/L003_R1_demux_summary.xml) PID 30999
                    Live child 0x01f44910 (Temp/L003_R2_demux_summary.xml) PID 31067
                    Live child 0x01f36c70 (Temp/L003_R1_demux_summary.xml) PID 30999
                    [2012-06-11 10:22:40] [localserv] [Temp/L003_R2_demux_summary.xml] Error: 2012-Jun-11 10:22:40: Operation not permitted: /software/CASAVA_v1.8.2/src/c++/lib/alignment/BclReader.cpp(97): Throw in function unsigned int casava::alignment::BclReader::readClusterCount()
                    [2012-06-11 10:22:40] [localserv] [Temp/L003_R2_demux_summary.xml] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
                    [2012-06-11 10:22:40] [localserv] [Temp/L003_R2_demux_summary.xml] std::exception::what: Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L003/C168.1/s_3_1101.bcl.
                    [2012-06-11 10:22:40] [localserv] [Temp/L003_R2_demux_summary.xml] : Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L003/C168.1/s_3_1101.bcl.
                    Reaping losing child 0x01f44910 PID 31067
                    make: *** [Temp/L003_R2_demux_summary.xml] Error 1
                    Removing child 0x01f44910 PID 31067 from chain.
                    Released token for child 0x01f44910 (Temp/L003_R2_demux_summary.xml).
                    Live child 0x01f36c70 (Temp/L003_R1_demux_summary.xml) PID 30999
                    Live child 0x01f36c70 (Temp/L003_R1_demux_summary.xml) PID 30999
                    [2012-06-11 10:22:43] [localserv] [Temp/L003_R1_demux_summary.xml] Error: 2012-Jun-11 10:22:43: Operation not permitted: /software/CASAVA_v1.8.2/src/c++/lib/alignment/BclReader.cpp(97): Throw in function unsigned int casava::alignment::BclReader::readClusterCount()
                    [2012-06-11 10:22:43] [localserv] [Temp/L003_R1_demux_summary.xml] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
                    [2012-06-11 10:22:43] [localserv] [Temp/L003_R1_demux_summary.xml] std::exception::what: Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L003/C101.1/s_3_1101.bcl.
                    [2012-06-11 10:22:43] [localserv] [Temp/L003_R1_demux_summary.xml] : Couldn't open BCL file /output/120101_SNL151_0018_AC0RAPACXX/Data/Intensities/BaseCalls/L003/C101.1/s_3_1101.bcl.
                    Reaping losing child 0x01f36c70 PID 30999
                    make: *** [Temp/L003_R1_demux_summary.xml] Error 1
                    Removing child 0x01f36c70 PID 30999 from chain.

                    Comment


                    • #11
                      hey folks,

                      I think I may have solved it,

                      I was using sshfs mount to output directory on storage array,

                      I switched to nfs mount method and it seems to be running without any error during make process thus far *fingers crossed*

                      Comment


                      • #12
                        I with the same problem... what can I do?

                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] opening /home/servidor/Documentos/Unaligned/Project_RNA-JOAS/Sample_not_demultiplexed/not_demultiplexed_NoIndex_L006_R1_001.fastq.tmp.gz
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz]
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] opening /home/servidor/Documentos/Unaligned/Project_RNA-JOAS/Sample_not_demultiplexed/not_demultiplexed_NoIndex_L003_R1_001.fastq.tmp.gz
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] Processing BCL files for lane 6, tile 1101, read 1
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] opening /home/servidor/Documentos/Unaligned/Project_RNA-JOAS/Sample_not_demultiplexed/not_demultiplexed_NoIndex_L004_R1_001.fastq.tmp.gz
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] Processing BCL files for lane 4, tile 1101, read 1
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] Error: 2013-Nov-21 19:38:06: No such file or directory: /tmp/BclToFastq/src/c++/lib/alignment/BclReader.cpp(391): Throw in function casava::alignment::PositionsReaderCompressed::PositionsReaderCompressed(const boost::filesystem2:ath&, unsigned int)
                        Processing BCL files for lane 3, tile 1101, read 1
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] std::exception::what: Failed to read version from clocs file /home/servidor/Documentos/Gabriela/../L006/s_6_1101.clocs
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] Error: 2013-Nov-21 19:38:06: No such file or directory: /tmp/BclToFastq/src/c++/lib/alignment/BclReader.cpp(391): Throw in function casava::alignment::PositionsReaderCompressed::PositionsReaderCompressed(const boost::filesystem2:ath&, unsigned int)
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] : Failed to read version from clocs file /home/servidor/Documentos/Gabriela/../L006/s_6_1101.clocs
                        make: ** [Project_RNA-JOAS/Sample_not_demultiplexed/not_demultiplexed_NoIndex_L006_R1_001.fastq.gz] Erro 1
                        make: ** Esperando que outros processos terminem.
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] Error: 2013-Nov-21 19:38:06: No such file or directory: /tmp/BclToFastq/src/c++/lib/alignment/BclReader.cpp(391): Throw in function casava::alignment::PositionsReaderCompressed::PositionsReaderCompressed(const boost::filesystem2:ath&, unsigned int)
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] std::exception::what: Failed to read version from clocs file /home/servidor/Documentos/Gabriela/../L004/s_4_1101.clocs
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] Dynamic exception type: boost::exception_detail::clone_impl<casava::common::IoException>
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] : Failed to read version from clocs file /home/servidor/Documentos/Gabriela/../L004/s_4_1101.clocs
                        make: ** [Project_RNA-JOAS/Sample_not_demultiplexed/not_demultiplexed_NoIndex_L004_R1_001.fastq.gz] Erro 1
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] std::exception::what: Failed to read version from clocs file /home/servidor/Documentos/Gabriela/../L003/s_3_1101.clocs
                        [2013-11-21 19:38:06] [servidor] [xed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] : Failed to read version from clocs file /home/servidor/Documentos/Gabriela/../L003/s_3_1101.clocs
                        make: ** [Project_RNA-JOAS/Sample_not_demultiplexed/not_demultiplexed_NoIndex_L003_R1_001.fastq.gz] Erro 1

                        I need help here!

                        Comment


                        • #13
                          What is "the same problem"? What have you done? Which version of CASAVA are you using? Which OS? What is " /home/servidor/", local FS, NFS or? Your output seems not to be complete.

                          Comment


                          • #14
                            As Sven suggested some more information is required. But at a minimum you seem to be missing (or do not have permission to read) several ".clocs" files. Is this a full folder from an illumina run? Have you used this install of CASAVA before? If this is a first time install have you checked it with the included test data?

                            Comment


                            • #15
                              Hi

                              I'm having the same errors described by singhp5. I'm using for the first time CASAVA 1.8.2. I checked the test data. All my data were in a external media and I passed all files to a local directory, in my server. I used this commands:

                              configureBclToFastq.pl --input-dir /home/servidor/Documentos/Gabriela --output-dir /home/servidor/Documentos/Unaligned --use-bases-mask Y*

                              The first message was:

                              ...
                              [2013-11-21 21:40:22] [configureBclToFastq.pl] INFO: Read 1: length = 100: mask = Y*
                              [2013-11-21 21:40:22] [configureBclToFastq.pl] INFO: Read 2: length = 7: mask = n*
                              [2013-11-21 21:40:22] [configureBclToFastq.pl] INFO: Running self tests: 'make self_test'
                              [2013-11-21 21:40:24] [configureBclToFastq.pl] INFO: Running self tests on /home/servidor/Documentos/Unaligned completed with no problems

                              After that, I did the make command in Unaligned folder

                              Thank you.

                              Comment

                              Latest Articles

                              Collapse

                              • seqadmin
                                Recent Developments in Metagenomics
                                by seqadmin





                                Metagenomics has improved the way researchers study microorganisms across diverse environments. Historically, studying microorganisms relied on culturing them in the lab, a method that limits the investigation of many species since most are unculturable1. Metagenomics overcomes these issues by allowing the study of microorganisms regardless of their ability to be cultured or the environments they inhabit. Over time, the field has evolved, especially with the advent...
                                09-23-2024, 06:35 AM
                              • seqadmin
                                Understanding Genetic Influence on Infectious Disease
                                by seqadmin




                                During the COVID-19 pandemic, scientists observed that while some individuals experienced severe illness when infected with SARS-CoV-2, others were barely affected. These disparities left researchers and clinicians wondering what causes the wide variations in response to viral infections and what role genetics plays.

                                Jean-Laurent Casanova, M.D., Ph.D., Professor at Rockefeller University, is a leading expert in this crossover between genetics and infectious...
                                09-09-2024, 10:59 AM

                              ad_right_rmr

                              Collapse

                              News

                              Collapse

                              Topics Statistics Last Post
                              Started by seqadmin, Yesterday, 04:51 AM
                              0 responses
                              8 views
                              0 likes
                              Last Post seqadmin  
                              Started by seqadmin, 10-01-2024, 07:10 AM
                              0 responses
                              11 views
                              0 likes
                              Last Post seqadmin  
                              Started by seqadmin, 09-30-2024, 08:33 AM
                              0 responses
                              16 views
                              0 likes
                              Last Post seqadmin  
                              Started by seqadmin, 09-26-2024, 12:57 PM
                              0 responses
                              16 views
                              0 likes
                              Last Post seqadmin  
                              Working...
                              X