Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • mpiro
    Member
    • Nov 2009
    • 10

    #1

    Galaxy configuration with SGE cluster

    Hi all,

    We are using an instance of galaxy workflow management system (http://galaxy.psu.edu/) that will launch jobs on our local SGE based cluster. The initial setup went smooth and the Galaxy seemed to be working fine with the cluster and MySQL database.
    The issue we are facing is that sometimes in a workflow, a second step queued job starts without waiting for finishing the first step. I assume it is related to our galaxy config file and we might misconfigured it somewhere.
    Below is our galaxy config file (univers_wsgi.ini).

    If someone here has experience with this tool, any help would be greatly appreciated.

    Code:
    [server:main]
    use = egg:Paste
    host = 0.0.0.0
    use_threadpool = True
    threadpool_workers = 10
    
    [filter:gzip]
    use = egg:Paste#gzip
    
    [filter:proxy-prefix]
    use = egg:PasteDeploy#prefix
    prefix = /galaxy
    
    [app:main]
    paste.app_factory = galaxy.web.buildapp:app_factory
    database_connection = mysql://galaxy:galaxy@localhost/galaxydb1?unix_socket=/var/lib/mysql/mysql.sock
    database_engine_option_pool_recycle = 7200
    file_path = database/files
    new_file_path = database/tmp
    smtp_server = /usr/sbin/sendmail
    mailing_join_addr = 
    error_email_to = 
    brand = NGS 
    static_enabled = True
    static_cache_time = 360
    static_dir = %(here)s/static/
    static_images_dir = %(here)s/static/images
    static_favicon_dir = %(here)s/static/favicon.ico
    static_scripts_dir = %(here)s/static/scripts/
    static_style_dir = %(here)s/static/june_2007_style/blue
    debug = False
    use_interactive = False
    library_import_dir = database/upload_directory
    user_library_import_dir = database/user_library_import
    allow_library_path_paste = true
    admin_users = 
    require_login = True
    allow_user_creation = False
    allow_user_deletion = True
    enable_pages = True
    track_jobs_in_database = True
    enable_job_recovery = True
    set_metadata_externally = True
    retry_metadata_internally = False
    local_job_queue_workers = 5
    start_job_runners = drmaa
    default_cluster_job_runner = drmaa:///
    cluster_job_queue_workers = 1
    
    [galaxy:tool_runners]
    biomart = local:///
    encode_db1 = local:///
    hbvar = local:///
    microbial_import1 = local:///
    ucsc_table_direct1 = local:///
    ucsc_table_direct_archaea1 = local:///
    ucsc_table_direct_test1 = local:///
    upload1 = local:///
  • jgoecks
    Member
    • Jan 2010
    • 28

    #2
    Hi mpiro,

    I recommend you post your question to (and subscribe to) the galaxy-dev mailing list: http://lists.bx.psu.edu/listinfo/galaxy-dev The Galaxy team reads and responds to email on this list, and it serves a forum for discussion about the technical aspects of Galaxy as well.

    Thanks,
    J.

    Emory University
    Galaxy Team

    Originally posted by mpiro View Post
    Hi all,

    We are using an instance of galaxy workflow management system (http://galaxy.psu.edu/) that will launch jobs on our local SGE based cluster. The initial setup went smooth and the Galaxy seemed to be working fine with the cluster and MySQL database.
    The issue we are facing is that sometimes in a workflow, a second step queued job starts without waiting for finishing the first step. I assume it is related to our galaxy config file and we might misconfigured it somewhere.
    Below is our galaxy config file (univers_wsgi.ini).

    If someone here has experience with this tool, any help would be greatly appreciated.

    Code:
    [server:main]
    use = egg:Paste
    host = 0.0.0.0
    use_threadpool = True
    threadpool_workers = 10
    
    [filter:gzip]
    use = egg:Paste#gzip
    
    [filter:proxy-prefix]
    use = egg:PasteDeploy#prefix
    prefix = /galaxy
    
    [app:main]
    paste.app_factory = galaxy.web.buildapp:app_factory
    database_connection = mysql://galaxy:galaxy@localhost/galaxydb1?unix_socket=/var/lib/mysql/mysql.sock
    database_engine_option_pool_recycle = 7200
    file_path = database/files
    new_file_path = database/tmp
    smtp_server = /usr/sbin/sendmail
    mailing_join_addr = 
    error_email_to = 
    brand = NGS 
    static_enabled = True
    static_cache_time = 360
    static_dir = %(here)s/static/
    static_images_dir = %(here)s/static/images
    static_favicon_dir = %(here)s/static/favicon.ico
    static_scripts_dir = %(here)s/static/scripts/
    static_style_dir = %(here)s/static/june_2007_style/blue
    debug = False
    use_interactive = False
    library_import_dir = database/upload_directory
    user_library_import_dir = database/user_library_import
    allow_library_path_paste = true
    admin_users = 
    require_login = True
    allow_user_creation = False
    allow_user_deletion = True
    enable_pages = True
    track_jobs_in_database = True
    enable_job_recovery = True
    set_metadata_externally = True
    retry_metadata_internally = False
    local_job_queue_workers = 5
    start_job_runners = drmaa
    default_cluster_job_runner = drmaa:///
    cluster_job_queue_workers = 1
    
    [galaxy:tool_runners]
    biomart = local:///
    encode_db1 = local:///
    hbvar = local:///
    microbial_import1 = local:///
    ucsc_table_direct1 = local:///
    ucsc_table_direct_archaea1 = local:///
    ucsc_table_direct_test1 = local:///
    upload1 = local:///

    Comment

    • mpiro
      Member
      • Nov 2009
      • 10

      #3
      Thanks J. .. appreciate your advice.

      .

      Comment

      Latest Articles

      Collapse

      • kinpict.com
        Reply to 16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
        by kinpict.com
        The part about this topic feels surprisingly grounded, and the details on the page is the bit that made me slow down. I’d keep <a href="https://kinpict.com/">ai family photo generator</a> bookmarked for later.
        Today, 06:37 PM
      • SEQadmin2
        16S/ITS Profiling vs. Shotgun Metagenomics: What Changes in Your Workflow?
        by SEQadmin2





        NGS has revolutionized clinical microbiology by offering new ways to identify and surveil pathogens without prior knowledge of the target. One popular approach is 16S rRNA and ITS amplicon sequencing, which targets specific microbial markers. But studies are increasingly incorporating shotgun metagenomics, a technique that sequences all DNA from a sample without targeting specific microbial markers. This approach allows more detailed taxonomic classification,...
        10-30-2026, 06:46 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by SEQadmin2, 11-12-2026, 07:59 AM
      0 responses
      26 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 11-05-2026, 09:25 AM
      0 responses
      35 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 11-03-2026, 11:54 AM
      2 responses
      56 views
      0 reactions
      Last Post kinpict.com  
      Started by SEQadmin2, 10-28-2026, 09:57 AM
      0 responses
      175 views
      0 reactions
      Last Post SEQadmin2  
      Working...