Reliable gap closure of scaffolds with GapFiller

[luisgls]

I have a finished genome assembled de novo (actually I also used SSPACE to identify maximal connections between final scaffolds). When I used GapFiller instead of reducing the number of Ns, it increased them. I compare the new N list with the original, and it correct some gaps, but sometimes in the original I had just 1 N, and now I have 7 Ns in this position. Can I turn off this sort of parameter?, why is it extending with 6 Ns?
Thanks

[avt_oxford]

Problems trying to run GapFiller

Hi,

I have been trying to get gapfiller to work but have run in to real difficulties. I keep getting the following:


zool1059@ubuntu:~/Documents/Kelly$ perl /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/GapFiller.pl -l library2 -s 18C_3_scaf.fasta -m 30 -b Lib1
Your inserted inputs on [GapFiller_v1-10] at Sat Sep 22 18:15:48 2012:
-s 18C_3_scaf.fasta
-l library2
-b Lib1
-o 2
-m 30
-r 0.7
-n 10
-T 1
-g 1
-d 50
-t 10
-i 10


=>Sat Sep 22 18:15:48 2012: Reading and processing paired-read files

ITERATION 1:

=>Sat Sep 22 18:15:59 2012: Mapping reads to scaffolds, reading bowtie output and storing unmapped reads
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 2: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: ���D�=�*3o'X4~b,f Zn%S��s[@gYCj
dKF P�a>l2T8 NRum /z?e(UJ h+�&O\^�]pwIWG�kVL_{
�r - q�}0x¬t A6Q�y1B <9c 7|ME;
5 #. p��0!B�3 �r
: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 1: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: ELF : not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 3: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: Ҟ p�yIk�: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 4: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: @ ��� ���B�O �RLt�E����S � �
C�c������M : not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 5: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: � �: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 1: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: � T
: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 2: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: b
K�
C�
�F: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 3: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: }�: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 4: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 2� : not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 1: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: nd: not found
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 13: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: � �

�
(U
lG � �
%� � ¬ !:
� R �2
,6 �� J � �[
$ �
� t �� � �E x
^� H �N D �
36 �� |� � � v _ D�
� � c
�[ 4 � � �0 � �
�
Z� �
�� �� ��
� �� � �� � � � M
e �
t z
�
F l
�� i!
� �g
1 �� i � �u
|� ��
l
�g � z 1�
%� Zsd D! td � ! �md�� ! �ndP! tdPl!A I
! �pd n ! �rd �A! �nd s
�qd �: File name too long
/home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: 14: /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/bowtie/bowtie-build: Syntax error: ")" unexpected

Bowtie-build error; 512 at /home/zool1059/Software/GapFiller_v1-10_linux-x86_64/GapFiller.pl line 242.

I don't really understand what's going on. As far as I can tell bowtie is installed properly. I created the scaffold file by aligning my velvet contigs.fa against a reference using ABACAS. Any help would be gratefully accepted.

Cheers,

Andries

[boetsie]

Hi LadyGlory,

sorry for my late reply, I was away for some weeks.

I'm not really sure what you mean. Did you align your contigs to a close reference genome and now have only scaffold with varying N's? If so, you can use this scaffold without a problem. Though, be careful that the gapsize estimation could not be correct if there is large deletion/insertion in your sample compared with your reference. In addition, you will probably end up with large gaps corresponding to regions that are not within your sample, as well as (as you already mentioned) contigs that could not align to your reference genome.

I think the best option is to first use GapFiller on this scaffold, and see how well the gapclosure went. Otherwise, I would suggest to do a scaffolding based on paired-read information (e.g. with SSPACE, Bambus, SOPRA...), since these programs are not influenced by genomic rearrangements between your reference genome and your sample, such as large inversions, deletions, insertions and translocations.

Regards,
Boetsie

Hi Boetsie/Marten,

I'm new to using GapFiller and have some questions about the input files. I am working with a bacterial genome, thus I only truly have one scaffold. My data consist of multiple contigs that when aligned to a reference genome produce scaffolds with gaps of varying length. I also have several contigs with no apparent synteny to my reference strain and I'm not sure how to treat them with GapFiller.

1) Does GapFiller require the same no. of N's between contigs?
2) How would GapFiller know to join contigs separated by N's if I'm working with a single super scaffold as with the bacterial genome?
3) Is it best to make a fasta file containing all my contigs with each contig containing a preset no. of N's at the 3'end of the oriented contig (i.e. add 100 N's to the 3' end of each of my contigs), and if so, do I also need to add the same no. of preset N's to the 5'end?

Thank you.

[LadyGlory]

Hi Boetsie/Marten,

I'm new to using GapFiller and have some questions about the input files. I am working with a bacterial genome, thus I only truly have one scaffold. My data consist of multiple contigs that when aligned to a reference genome produce scaffolds with gaps of varying length. I also have several contigs with no apparent synteny to my reference strain and I'm not sure how to treat them with GapFiller.

1) Does GapFiller require the same no. of N's between contigs?
2) How would GapFiller know to join contigs separated by N's if I'm working with a single super scaffold as with the bacterial genome?
3) Is it best to make a fasta file containing all my contigs with each contig containing a preset no. of N's at the 3'end of the oriented contig (i.e. add 100 N's to the 3' end of each of my contigs), and if so, do I also need to add the same no. of preset N's to the 5'end?

Thank you.

[boetsie]

Hi dnajuice,

thank you for your question, and for using our software. It is not necessary to extend the contigs before gapclosure. GapFiller will simply extract the scaffolds and tries to fill them. The extension step of SSPACE is only to further extend the contigs to improve scaffolding.

The extension of SSPACE is based on unmapped single-reads (reads that do not map to any of the contigs), while GapFiller makes use of paired-reads, making the extension more reliable. In addition, GapFiller is able to fill repeated regions, while the extension of SSPACE can not do this, since it uses reads only once. I don't think the extension step of SSPACE will affect the gapclosing, as long as the extension is correct of course, so do not set the extension settings too low.

Regards,
Marten

Hi Boetsie/Marten,

I'm using SSPACE for contig extension and scaffolding, and it works pretty well. I am also interested in GapFiller. However, I'm a bit confused about the utility of contig extension and gap closure. For example, before running GapFiller, is it necessary to run SSPACE first to extend the contigs? Or should I use non-extended scaffolds directly for GapFiller? Will these two different SSPACE scaffold inputs (extended vs. non-extended) affect GapFiller result?

Thank you and look forward to having your feedback.

[dnajuice]

Hi Boetsie/Marten,

I'm using SSPACE for contig extension and scaffolding, and it works pretty well. I am also interested in GapFiller. However, I'm a bit confused about the utility of contig extension and gap closure. For example, before running GapFiller, is it necessary to run SSPACE first to extend the contigs? Or should I use non-extended scaffolds directly for GapFiller? Will these two different SSPACE scaffold inputs (extended vs. non-extended) affect GapFiller result?

Thank you and look forward to having your feedback.

[boetsie]

Thank you for the kind reply. We hope our programs can be of any use, and we are continuously trying to improve our programs as well as developing new ones.

[boetsie]

Hi all,

after a successful release of SSPACE (http://seqanswers.com/forums/showthread.php?t=8350) we have generated a new tool, called GapFiller, for closing the remaining gaps produced after scaffolding.

GapFiller seeks to find reads that potentially fall within gaps by aligning paired-reads with Bowtie or BWA(-sw). Per gap, it extends both sides until a user-defined overlap is find, and the number of gaps corresponds to the initial number of gapped nucleotides in the scaffolds (allowing a user-defined deviation).

The main features;

* Inputs are simple FASTA scaffold sequences as well as (multiple) FASTA/FASTQ paired-read data
* Multiple library input of both paired-end and/or mate pair datasets
* High-quality closing of gaps
* High reduction of the number of gaps, and the number of gapped nucleotides
* Detailed output of the gaps, e.g.number of reads used, number of nucleotides, remaining gapped nucleotides
* Detailed output of the gapclosing process.

GapFiller has been tested and compared with various datasets (PE and MP), *different gapclosure tools (IMAGE and SOAP's GapClosure ) and different species. GapFiller was tested on four prokaryotes; E.coli,* (E.coli, S.coelicolor, S. aureus, R.* sphaeroides) and two eukaryotes (S.cerevisiae, human chromosome 14).

The results, using the quality metrics of GAGE ( http://gage.cbcb.umd.edu/results/index.html), show that the quality of the closure of GapFiller is more accurate than IMAGE and SOAP's GapClosure.
Although GapFiller yields similar results in terms of the number of gaps/nucleotides closed as SOAP's GapClosure, the smaller error rate indicates that our tool is more appropriate for reliable gap filling.


Further details are provided in our paper in biology (http://genomebiology.com/2012/13/6/R56/abstract). The program can be obtained from our website (http://www.baseclear.com/bioinformatics-tools/) and is free for academic users.

Hope it could be useful and any comments or questions are welcome.

Regards,
Marten Boetzer a.k.a. Boetsie