Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • mpiro
    Member
    • Nov 2009
    • 10

    #1

    Galaxy configuration with SGE cluster

    Hi all,

    We are using an instance of galaxy workflow management system (http://galaxy.psu.edu/) that will launch jobs on our local SGE based cluster. The initial setup went smooth and the Galaxy seemed to be working fine with the cluster and MySQL database.
    The issue we are facing is that sometimes in a workflow, a second step queued job starts without waiting for finishing the first step. I assume it is related to our galaxy config file and we might misconfigured it somewhere.
    Below is our galaxy config file (univers_wsgi.ini).

    If someone here has experience with this tool, any help would be greatly appreciated.

    Code:
    [server:main]
    use = egg:Paste
    host = 0.0.0.0
    use_threadpool = True
    threadpool_workers = 10
    
    [filter:gzip]
    use = egg:Paste#gzip
    
    [filter:proxy-prefix]
    use = egg:PasteDeploy#prefix
    prefix = /galaxy
    
    [app:main]
    paste.app_factory = galaxy.web.buildapp:app_factory
    database_connection = mysql://galaxy:galaxy@localhost/galaxydb1?unix_socket=/var/lib/mysql/mysql.sock
    database_engine_option_pool_recycle = 7200
    file_path = database/files
    new_file_path = database/tmp
    smtp_server = /usr/sbin/sendmail
    mailing_join_addr = 
    error_email_to = 
    brand = NGS 
    static_enabled = True
    static_cache_time = 360
    static_dir = %(here)s/static/
    static_images_dir = %(here)s/static/images
    static_favicon_dir = %(here)s/static/favicon.ico
    static_scripts_dir = %(here)s/static/scripts/
    static_style_dir = %(here)s/static/june_2007_style/blue
    debug = False
    use_interactive = False
    library_import_dir = database/upload_directory
    user_library_import_dir = database/user_library_import
    allow_library_path_paste = true
    admin_users = 
    require_login = True
    allow_user_creation = False
    allow_user_deletion = True
    enable_pages = True
    track_jobs_in_database = True
    enable_job_recovery = True
    set_metadata_externally = True
    retry_metadata_internally = False
    local_job_queue_workers = 5
    start_job_runners = drmaa
    default_cluster_job_runner = drmaa:///
    cluster_job_queue_workers = 1
    
    [galaxy:tool_runners]
    biomart = local:///
    encode_db1 = local:///
    hbvar = local:///
    microbial_import1 = local:///
    ucsc_table_direct1 = local:///
    ucsc_table_direct_archaea1 = local:///
    ucsc_table_direct_test1 = local:///
    upload1 = local:///
  • jgoecks
    Member
    • Jan 2010
    • 28

    #2
    Hi mpiro,

    I recommend you post your question to (and subscribe to) the galaxy-dev mailing list: http://lists.bx.psu.edu/listinfo/galaxy-dev The Galaxy team reads and responds to email on this list, and it serves a forum for discussion about the technical aspects of Galaxy as well.

    Thanks,
    J.

    Emory University
    Galaxy Team

    Originally posted by mpiro View Post
    Hi all,

    We are using an instance of galaxy workflow management system (http://galaxy.psu.edu/) that will launch jobs on our local SGE based cluster. The initial setup went smooth and the Galaxy seemed to be working fine with the cluster and MySQL database.
    The issue we are facing is that sometimes in a workflow, a second step queued job starts without waiting for finishing the first step. I assume it is related to our galaxy config file and we might misconfigured it somewhere.
    Below is our galaxy config file (univers_wsgi.ini).

    If someone here has experience with this tool, any help would be greatly appreciated.

    Code:
    [server:main]
    use = egg:Paste
    host = 0.0.0.0
    use_threadpool = True
    threadpool_workers = 10
    
    [filter:gzip]
    use = egg:Paste#gzip
    
    [filter:proxy-prefix]
    use = egg:PasteDeploy#prefix
    prefix = /galaxy
    
    [app:main]
    paste.app_factory = galaxy.web.buildapp:app_factory
    database_connection = mysql://galaxy:galaxy@localhost/galaxydb1?unix_socket=/var/lib/mysql/mysql.sock
    database_engine_option_pool_recycle = 7200
    file_path = database/files
    new_file_path = database/tmp
    smtp_server = /usr/sbin/sendmail
    mailing_join_addr = 
    error_email_to = 
    brand = NGS 
    static_enabled = True
    static_cache_time = 360
    static_dir = %(here)s/static/
    static_images_dir = %(here)s/static/images
    static_favicon_dir = %(here)s/static/favicon.ico
    static_scripts_dir = %(here)s/static/scripts/
    static_style_dir = %(here)s/static/june_2007_style/blue
    debug = False
    use_interactive = False
    library_import_dir = database/upload_directory
    user_library_import_dir = database/user_library_import
    allow_library_path_paste = true
    admin_users = 
    require_login = True
    allow_user_creation = False
    allow_user_deletion = True
    enable_pages = True
    track_jobs_in_database = True
    enable_job_recovery = True
    set_metadata_externally = True
    retry_metadata_internally = False
    local_job_queue_workers = 5
    start_job_runners = drmaa
    default_cluster_job_runner = drmaa:///
    cluster_job_queue_workers = 1
    
    [galaxy:tool_runners]
    biomart = local:///
    encode_db1 = local:///
    hbvar = local:///
    microbial_import1 = local:///
    ucsc_table_direct1 = local:///
    ucsc_table_direct_archaea1 = local:///
    ucsc_table_direct_test1 = local:///
    upload1 = local:///

    Comment

    • mpiro
      Member
      • Nov 2009
      • 10

      #3
      Thanks J. .. appreciate your advice.

      .

      Comment

      Latest Articles

      Collapse

      • SEQadmin2
        Multiomic Liquid Biopsy: What DNA/RNA Panels Reveal That DNA Alone Can’t
        by SEQadmin2



        Tumors contain complex mixtures of cell populations that evolve in response to treatment and host-specific factors. Tissue biopsies provide only static snapshots of a tumor’s state. But what if we could follow that evolution over time using a minimally invasive technique?

        Liquid biopsies can detect tumor-derived material circulating in the bloodstream, providing a way to study treatment response, detect emerging resistance, and discover new biomarkers. Circulating
        ...
        10-14-2026, 09:55 AM
      • SEQadmin2
        New Genomics Technologies Take Aim at Long-Standing Limits
        by SEQadmin2


        Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

        We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
        ...
        09-28-2026, 10:25 AM

      ad_right_rmr

      Collapse

      News

      Collapse

      Topics Statistics Last Post
      Started by SEQadmin2, 10-22-2026, 11:13 AM
      0 responses
      38 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 10-22-2026, 10:48 AM
      0 responses
      28 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 10-15-2026, 10:52 AM
      0 responses
      41 views
      0 reactions
      Last Post SEQadmin2  
      Started by SEQadmin2, 10-14-2026, 05:39 AM
      0 responses
      45 views
      0 reactions
      Last Post SEQadmin2  
      Working...