Welcome to the Open Genomics Engine Discussion Forum

[KamMothe]

Welcome to the Open Genomics Engine Discussion Forum

Welcome to the Tynon General Discussion Forum

Use this forum for any discussion relating to Tynon you like Feel free to discuss anything going on in the game, talk smack or anything else. Just keep it clean and constructive

[sklages]

Yepp, .. project development has been discontinued..

Latest news is:

Download OpenGE version 0.4
May 23, 2013
OpenGE 0.4 features improved speed and stability…

[zee]

This post seems pretty out-of-date.

[gsgs]

Hi all,

I'm excited to announce that SEQanswers will act as the official discussion host for the Open Genomics Engine project. See the official announcement below:



As always, feedback and input are welcome.

-=Eric

in what language are the programs written, what compiler is needed,
what operation system, do the programs work from command line,
can they be joined in batch files, is there a simple example of some
such program, and the typical size of a data-file which it handles

[dhfx]

What is the status of OpenGE? Is development continuing?

[BobFreemanMA]

It has been a year since I posted that message and since then we decided against developing a GUI. We have functionality that allows you to plug-in external tools into OpenGE (bpipe style) and this is great for simple command-line based workflows. It is definitely not intended to be a replacement for Galaxy, which is one the best workflow managers around.

The focus of OpenGE was to speed up and optimize certain steps of the genome analysis pipeline. I think we achieved that. The code is not 100% bug-free but it has been a continuous work in progress

Sounds great. Thanks!

[adaptivegenome]

This seems very exciting and promising, but I hope that you can tell me how this project is different from Galaxy. And it seems to have a significant advantage in terms of release time, users, development, etc.

Tx,
Bob

It has been a year since I posted that message and since then we decided against developing a GUI. We have functionality that allows you to plug-in external tools into OpenGE (bpipe style) and this is great for simple command-line based workflows. It is definitely not intended to be a replacement for Galaxy, which is one the best workflow managers around.

The focus of OpenGE was to speed up and optimize certain steps of the genome analysis pipeline. I think we achieved that. The code is not 100% bug-free but it has been a continuous work in progress

[BobFreemanMA]

And this is different from Galaxy in what ways???

Hi gringer,

Certainly one aspect of OpenGE will be the management of analysis pipelines composed of existing tools. Much like the recently released bpipe project, the aim would be to incorporate existing tools into workflows. We want to eventually build a web-based GUI (in development right now) that allows for the dynamic creation of workflows (currently this is implemented at the command line) and we would like it to feature things like: versioning of tools, progress tracking, recovery and restarting from errors, etc.

Rewriting everyone's code is inefficient and unnecessary, but OpenGE also will feature modifications of existing code from projects like bamtools. We have implemented a multithreaded BAM compression method, a multithread combined merge-sort, and some other low-level tools for operating on BAM files. I know Heng Li has begun introducing some of this into samtools and I believe Nils Homer may be working on this as well. I would love to see how our code stacks up since a secondary goal of the project is to accelerate the analysis of genomes.

One nice thing about the project is that we will have funding to continue development of the GUI as well as optimization and addition of other tools to the software. I am hoping that via SEQanswers we can get direction from the community on prioritizing what to do next. Furthermore we hope to write adapters/plugins for existing tools and to encourage others to join in the development, etc.

The project is completely open source and will be hosted on GitHub. We are hoping that the combination of fast code and a easy to use package manager/workflow GUI will put all this analysis in the hands everyone...

Sorry for the long post, but hopefully that sort answers your question?

This seems very exciting and promising, but I hope that you can tell me how this project is different from Galaxy. And it seems to have a significant advantage in terms of release time, users, development, etc.

Tx,
Bob

[adaptivegenome]

So, what is the role of NVIDIA in Open GE?

NVIDIA Corporation is not involved, however the NVIDIA Foundation (philanthropic non-profit) funded the pilot project.

The foundation will continue to fund us in the short-term but we will need to recruit additional sources of extramural funding from the NIH, NSF, etc. for the long-term sustainment of the project.

[rezaf_2000]

So, what is the role of NVIDIA in Open GE?

[adaptivegenome]

Although the project officially goes live on Monday, June 4th, the code is available on github now.

The main code featuring multithreaded processing of BAM files is located here:

https://github.com/adaptivegenome/openge

Binaries are here:

https://github.com/adaptivegenome/openge/downloads

The preliminary release of a bpipe-compatible workflow system is located:

https://github.com/adaptivegenome/OGE-Workflows

The main code is based on bamtools and so for those that are familiar with samtools or bamtools, it should be easy to start using right away. Please feel free to submit comments/suggestions via the github site (under Issues) or discuss here in this forum. We would be grateful to hear of bugs or simply feedback on speed increases with different input data.

[adaptivegenome]

Thanks for the feedback. I'll see if we can get the website updated a bit.

[gringer]

Sorry for the long post, but hopefully that sort answers your question?

Yes, thank you. The description on the website (and posted here) was a bit vague. Your explanation makes me feel a bit more positive about the project.

[adaptivegenome]

Hi gringer,

Certainly one aspect of OpenGE will be the management of analysis pipelines composed of existing tools. Much like the recently released bpipe project, the aim would be to incorporate existing tools into workflows. We want to eventually build a web-based GUI (in development right now) that allows for the dynamic creation of workflows (currently this is implemented at the command line) and we would like it to feature things like: versioning of tools, progress tracking, recovery and restarting from errors, etc.

Rewriting everyone's code is inefficient and unnecessary, but OpenGE also will feature modifications of existing code from projects like bamtools. We have implemented a multithreaded BAM compression method, a multithread combined merge-sort, and some other low-level tools for operating on BAM files. I know Heng Li has begun introducing some of this into samtools and I believe Nils Homer may be working on this as well. I would love to see how our code stacks up since a secondary goal of the project is to accelerate the analysis of genomes.

One nice thing about the project is that we will have funding to continue development of the GUI as well as optimization and addition of other tools to the software. I am hoping that via SEQanswers we can get direction from the community on prioritizing what to do next. Furthermore we hope to write adapters/plugins for existing tools and to encourage others to join in the development, etc.

The project is completely open source and will be hosted on GitHub. We are hoping that the combination of fast code and a easy to use package manager/workflow GUI will put all this analysis in the hands everyone...

Sorry for the long post, but hopefully that sort answers your question?

[gringer]

Will this be a frontend to manage a number of different FOSS HTS analysis packages with one program, or a rebuilt chariot for HTS analysis?