[sjuzhet]

Fastx_barcode_splitter has --eol (end of line/read) option to check reads at the 3' end. Provide the barcodes appropriately in the barcode file. You will need to run --bol and --eol sequentially (with individual barcode files) since those two options can't be combined.

Yeah, that's what I did. I was hoping to get a report on the number of reads that didn't match to either bol or eol, but I guess I can just calculate it.

[GenoMax]

This might be a basic question, but I thought I'd hop in this topic to ask - half of my reads were read in the opposite direction, so the barcode is reverse complemented at the end of the read. Is there a way to get Fastx Toolkit to incorporate reverse complement barcodes at the end of the line as well, or do I have to do this manually?

Fastx_barcode_splitter has --eol (end of line/read) option to check reads at the 3' end. Provide the barcodes appropriately in the barcode file. You will need to run --bol and --eol sequentially (with individual barcode files) since those two options can't be combined.

[sjuzhet]

This might be a basic question, but I thought I'd hop in this topic to ask - half of my reads were read in the opposite direction, so the barcode is reverse complemented at the end of the read. Is there a way to get Fastx Toolkit to incorporate reverse complement barcodes at the end of the line as well, or do I have to do this manually?

[smitra]

Thank you Luc. I will give it a try.

[luc]

You might want to try Sabre instead:

https://github.com/najoshi/sabre

Works also on paired-end data.

The FASTX toolkit is very old by now.

[smitra]

I haven't tried trimmomatic/bbduk yet. But this barcode splitter is playing strange with me. Yes with N's out they demultiplex but never the whole data. every time some reads remained which is completely unexplainable. If I do again with those unmatched read again some bit match. which is very strange.

But at present i am just doing the N's out for the whole data and seems with two stage I am getting success. Thanks for helping.

[GenoMax]

Did you also remove the corresponding Q-score value? If you used trimmomatic/bbduk they would do this but if you used some other method then you may have an extra Q-score value remaining on line 4 for each fastq record.

I am not sure why you are having a problem but if I use the two reads you posted above I am able to demultiplex them fine (after taking the N's out).

[smitra]

Dear GenoMax,
Thanks. Yes I have tried getting rid of the first base from all reads (yes consistently N) and also keeping them as it is. But both the cases my matching success rate is about 50%. Yes I know few first base pairs have more N in the middle but that will be discarded later in QC protocol. Thus at the first stage I am trying to get as much as read i can for each sample. Do you think I should try allowing more mismatch or partial option. As with the first lines I copies it still should be matched.
Getting really confused with this function.
Thanks,
mitra

[GenoMax]

Getting rid of the first base from all reads (hopefully that is consistently N, have you spot checked?) and then removing the first C from your barcode file may be the way to go.

That said the example reads you posted above have a lot a N' in the middle of the reads (which is a bad sign, likely indicative of low nucleotide diversity during those cycles). Are you going to be able to use this data if it were to get demultiplexed?

If these are amplicons and such you should look into primer schemes that stagger the start by adding random bases so as to overcome the low nucleotide diversity issue.

[smitra]

Now as I am able to match files with the barcode splitter, I tried different combinations.... as with keeping N in the seq and with mismatch --0 works also.
But the problem is only half of my reads match.

N85567:testdata mitras$ cat test_R1.fastq | fastx_barcode_splitter.pl --bcfile mapping2_bcfile.txt --prefix /Volumes/Promise\ Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/ --suffix "_R1.fastq" --bol --mismatches 0
Barcode Count Location
AP1E 61 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP1E_R1.fastq
AP25E 55 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP25E_R1.fastq
AP5D 37 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP5D_R1.fastq
AP8C 27 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP8C_R1.fastq
P29F 40 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P29F_R1.fastq
P30N 40 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P30N_R1.fastq
P31B 35 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P31B_R1.fastq
P35C 55 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P35C_R1.fastq
V2A 36 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/V2A_R1.fastq
V3J 25 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/V3J_R1.fastq
unmatched 589 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/unmatched_R1.fastq
total 1000

So having 589/1000 reads unmatched is not a good option.
When I checked few reads they looks fine
there is no reason for the first few lines not to be matched (barcode file is copied again bellow and bold letter for the barcode that should be matched in first two lines).

N85567:unmatched_try mitras$ less unmatched.fastq 

@M02542:124:000000000-AKFBJ:1:1101:13841:1000 1:N:0:5
NGTACCCAAGGGTTTGATCATGGCTCAGATTGAACGCTGGCGGCAGGCCTAACACANNCNNGTCGAACGGTAGCNCAGAGAGCTTGCTCTNGGNTGACGAGTGGCGGACGGGNGANTAATGTCTGGGAAACTGCCCGATGGAGGGGGATANCTACTGGANANNGNNGCTAATACCGCATAACGNCGCAAGACCAAAGAGGGNGANNTCAGGGCCTCTTGNCATCGGATGNNCCCAGATGGGATNGGCTTGTAGGTGAGGTAAGNGCTCACGCNGGCGACGATCCCTAGCTTGGNNGNGAGG
+
#8ABCFGGGGGGGGEEGGGGGGGG<FGGGFFGFGFGFGGEG@FGEEGGCFGGGGG?##:##6:CFFGGGDG<CG#:CCFFGEGGGGFAFG#:<#:BBFF7FFGDGGGGGGGD#8+#+:BFGGGGGGGCFFGDGG<FGGGECCGDEGGGF@#611:D,>>#6##6##66<1CF@7FFFGEGF7E#41=8=EGFFG7*?CF>>#22##2*2;@;8C8CFC<#/2AC=E*:5##/2:CFCG+8**+#*1*1552<+*+0+8D6D4+#1**)**)*#*15/*//7>5:5<.*,*)0)##1#..73
@M02542:124:000000000-AKFBJ:1:1101:12174:1002 1:N:0:5
NGTAACCAAGGGTTTGATCCTGGCTCAGGATGAACGCTAGCTACAGGCTTAACACANNCNNGTCGAGGGGCAGCATTTCAGTTTGCTTGCNAANTGGAGATGGCGACCGGCGNACNGGTGAGTAACACGTATCCAACCTGCCGATAACTCNGGGATAGCNTNNCNNAAGAAAGATTGATACCCNATGGTATAATCAGACCGNATGGTCTTATTATTAAANAATTTCGGTNNTCGATGGGGATGNGTTCCATTAGGCAGTTGGTGTGTTAATGNCGCACCAAACCTTCCTGTGANNGNGTTT
+
#8ACCGGGGGGGCFGGGGGGGGGGGGGGGGGGGFGGGGDGGGGGGGGGFGGGGGGG##:##6:CFGFDEGGGGDGGGFGGGFGGGGGGGG#:C#66=,CFFFGGGG@FGEE7#++#:BBFFGGGFCFGGGGGGCGDGGGFGGGGGGGGC=#8@<<<FGG#5##8##86DCF<FCCC:BFCFFF#6>F>FGG92;@CFFGF@#116*=CF<CG?@CFFFG#3;5375:CG##212**<5C5/::#11:91A>+<>C6CE<FC:*****0:FB<#1*)//75<F30762*-2)**##1#0)0.

#SampleID BarcodeSequence
AP1E CGTAACCA
AP25E CGTACCCA
AP5D CGTAAGAA
AP8C CGTAGATA
P29F CGTAGGCT
P30N CGTATTCA
P31B CGTCAAGA
P35C CGTATTTC
V2A CGTCCAGG
V3J CGTCACAG

I don’t have any idea why this is getting so messy. And getting half of the reads matched is not a good idea. So just still keeping this post alive for any further help. Thanks a lot. smitra

[smitra]

Yes re-creating the barcode files works..there must have some problem with tab...
Now I got more realistic result

N85567:testdata mitras$ cat test_out_R1.fastq | fastx_barcode_splitter.pl --bcfile mapping2_bcfile_new.txt --prefix /Volumes/Promise\ Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/ --bol --mismatches 0
Barcode Count Location
AP1E 63 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP1E
AP25E 57 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP25E
AP5D 39 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP5D
AP8C 27 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/AP8C
P29F 40 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P29F
P30N 40 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P30N
P31B 38 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P31B
P35C 57 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/P35C
V2A 37 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/V2A
V3J 25 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/V3J
unmatched 577 /Volumes/Promise Pegasus/IFR/Cristina/Mr.DNA_2016/fastq_files/testdata/unmatched

Thank you so very much

[GenoMax]

If you made the barcode file on a PC/Mac it may have some additional (invisible) characters. Use the dos2unix (or dos2unix -c for OSX files) utility to remove those characters or just create the file on the server.

[smitra]

hmm looks good. May be I will re-create the barcode file again.
My version fastx_toolkit-0.0.14
Thanks for helping

[GenoMax]

Barcode file with 2 sequences you posted earlier.

#SampleID       BarcodeSequence
tse1    GTACCCAA
tse2    GTAACCAA

Command I used

$ cat test.fq | fastx_barcode_splitter.pl --bcfile bar --prefix /path_to/ --bol --mismatches 0
Barcode Count   Location
tse1    1       /path_to/tse1
tse2    1       /path_to/tse2
unmatched       0       /path_to/unmatched

[GenoMax]

And also the same is happening if I replace the first C with an N in barcode file

The N idea does not work but otherwise I am able to split your example reads into two files. What version of fastx_toolkit are you using?