genometools parallel

[hugh_hang]

Hi, I am using genometools and find it quite slow with an 1G fasta file.
When running:
$ gt suffixerator ...
It simply used one cpu and was quite slow. Then I tried:
$ gt -j 4 suffixerator ...
But nothing changed.
So I'm really confused whether gt could use parallel processors to accelerate working, just like RepeatMasker (who has -pa to set number of parallel processors)?

[SES]

Hi, I am using genometools and find it quite slow with an 1G fasta file.
When running:
$ gt suffixerator ...
It simply used one cpu and was quite slow. Then I tried:
$ gt -j 4 suffixerator ...
But nothing changed.
So I'm really confused whether gt could use parallel processors to accelerate working, just like RepeatMasker (who has -pa to set number of parallel processors)?

I'm curious how you decided to use the "-j" option for gt suffixerator because I have never seen that and it does not appear to be documented. Depending on what task you are trying accomplish, there are ways of running jobs in parallel but I'm not aware of any genometools applications that will use multiple processors.

[hugh_hang]

I'm curious how you decided to use the "-j" option for gt suffixerator because I have never seen that and it does not appear to be documented. Depending on what task you are trying accomplish, there are ways of running jobs in parallel but I'm not aware of any genometools applications that will use multiple processors.

I saw '-j' in LTRdigest User’s Manual where write:

To run the protein domain search in a parallel fashion, use the -j parameter to gt to specify the number of concurrent threads to use:
gt -j 3 ltrdigest [options] GFF3 file indexname

I thought '-j' is an option of 'gt' command that can be added into all gt tools. Maybe I was so naive for it can only added into the command of 'gt ltrdigest'.

[rhinoceros]

I don't know what genometools does, but maybe it would be possible to parallelize it with gnu parallel. Have a look here to get an idea how it works..

[hugh_hang]

I don't know what genometools does, but maybe it would be possible to parallelize it with gnu parallel. Have a look here to get an idea how it works..

It is really awesome. I know what to do next, thanks!

[SES]

I saw '-j' in LTRdigest User’s Manual where write:

I thought '-j' is an option of 'gt' command that can be added into all gt tools. Maybe I was so naive for it can only added into the command of 'gt ltrdigest'.

LTRdigest uses HMMER for the protein domain search, so I think that "-j" option applies specifically to that routine of the LTRdigest tool.

[hugh_hang]

LTRdigest uses HMMER for the protein domain search, so I think that "-j" option applies specifically to that routine of the LTRdigest tool.

Thanks, I suddenly realized.

[sst]

Currently LTRdigest is the only tool to use the parallelization option -j for now, but that might change in the future.

[hugh_hang]

Currently LTRdigest is the only tool to use the parallelization option -j for now, but that might change in the future.

do you know if the change will occur in the newest version in 2014?

[sst]

do you know if the change will occur in the newest version in 2014?

Currently there are no plans multithreading the existing tools -- what I am saying is that there might be new tools using that option if they use multithreading -- sorry if my comment was misleading