Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • parser needed for bcl2fastq2 output

    I'm looking for a parser to compile basic stats from the various html/xml/text output files from NextSeq runs. Looking for a text file to archive with fastq files that includes sample name, sample ID, indexes, total clusters per sample not per lane since NextSeq lanes are not independent. Thanks.

  • #2
    Take a look at MultiQC if you want to look at many runs.

    Following is true for local bcl2fastq analysis. I am not familiar with BaseSpace but I suppose a similar structure can be found there as well.

    Otherwise the index.html file found in (FCID/Unaligned/Reports/html) directory has all the stats or if you prefer a standalone file then (FCID/Unaligned/Reports/html/FC_BARCODE/all/all/all/laneBarcode.html).

    JSON format results are in (FCID/Unaligned/Stats/Json.stats).
    Last edited by GenoMax; 03-05-2018, 11:22 AM.

    Comment


    • #3
      Thanks GenoMax. We are running our NextSeq standalone.

      The html file displays the metrics per lane per sample...I'd like to have the information for each sample combined into one row, e.g. Lane 1 Sample A, Lane 2 Sample A, Lane 3 Sample A, Lane 4 Sample A -> Sample A.

      If you know of an html to csv or json to csv script I could handle this in Excel.

      Comment


      • #4
        While there appear to be many (?) online tools following may be safer.

        1. Download Atom programmers editor here.
        2. Find "Settings" tab after installing Atom and click on +Install.
        3. Search for a package called "json-converter" and install it.
        4. Download and open Stats.json file in Atom.
        5. Use Packages menu drop down, find "Json Converter" and select "Json to csv".
        6. Write the converted data out to file and then do what you need to in Excel.

        Comment


        • #5
          As a side-note, when running bcl2fastq you can use the option "--no-lane-splitting" to create fastqs that don't separate your samples by lane. This is useful to avoid having to combine them downstream.

          Comment


          • #6
            Originally posted by lac302 View Post
            I'm looking for a parser to compile basic stats from the various html/xml/text output files from NextSeq runs. Looking for a text file to archive with fastq files that includes sample name, sample ID, indexes, total clusters per sample not per lane since NextSeq lanes are not independent. Thanks.
            Hello lac302,

            I have attached a perl script I use for this purpose, however when dealing with NextSeq run data the stats are still divided by lane. The script reads the DemultiplexingStats.xml and ConversionStats.xml files within the Stats/ directory created by bcl2fastq2. It requires Perl Modules Getopt::Long and XML::LibXML. It has one mandatory input, the path to the Stats/ directory and one optional argument for parsing data from single end runs.

            Code:
            # parseBcl2FastqStatsXml.pl [-s] -i <path>/Stats/ > output.txt
            
            The argument for -i must end in /Stats/
            -s is optional for single read runs
            The output is a tab delimited text file with relevant per sample, per lane stats.
            Attached Files
            Last edited by kmcarr; 03-06-2018, 09:06 AM.

            Comment


            • #7
              Guess what?...You can copy and paste from html to excel.

              I was making it harder than it needed to be.

              Comment


              • #8
                @kmcarr, thanks for that useful parser! One quick question: is there any way to sum each line instead of showing them separately?

                Thanks!

                Comment


                • #9
                  Originally posted by jgarces View Post
                  @kmcarr, thanks for that useful parser! One quick question: is there any way to sum each line instead of showing them separately?

                  Thanks!
                  By "sum each line" do you mean the total output per lane? If so then that information is provided directly in the HiSeq output summary before running BCL2FastqQ.

                  Comment


                  • #10
                    Thanks for you reply, @kmcarr. Our sequencing were performed in a different lab and we haven't the BCL and this kind of run information... but at the end, with your parser and a bit of R, I was able to extract the information I wanted.

                    Thanks again!

                    Comment

                    Latest Articles

                    Collapse

                    • seqadmin
                      Recent Advances in Sequencing Technologies
                      by seqadmin







                      Innovations in next-generation sequencing technologies and techniques are driving more precise and comprehensive exploration of complex biological systems. Current advancements include improved accessibility for long-read sequencing and significant progress in single-cell and 3D genomics. This article explores some of the most impactful developments in the field over the past year.

                      Long-Read Sequencing
                      Long-read sequencing has...
                      12-02-2024, 01:49 PM
                    • seqadmin
                      Genetic Variation in Immunogenetics and Antibody Diversity
                      by seqadmin



                      The field of immunogenetics explores how genetic variations influence immune responses and susceptibility to disease. In a recent SEQanswers webinar, Oscar Rodriguez, Ph.D., Postdoctoral Researcher at the University of Louisville, and Ruben Martínez Barricarte, Ph.D., Assistant Professor of Medicine at Vanderbilt University, shared recent advancements in immunogenetics. This article discusses their research on genetic variation in antibody loci, antibody production processes,...
                      11-06-2024, 07:24 PM

                    ad_right_rmr

                    Collapse

                    News

                    Collapse

                    Topics Statistics Last Post
                    Started by seqadmin, 12-02-2024, 09:29 AM
                    0 responses
                    134 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 12-02-2024, 09:06 AM
                    0 responses
                    48 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 12-02-2024, 08:03 AM
                    0 responses
                    38 views
                    0 likes
                    Last Post seqadmin  
                    Started by seqadmin, 11-22-2024, 07:36 AM
                    0 responses
                    68 views
                    0 likes
                    Last Post seqadmin  
                    Working...
                    X