Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • mcnelson.phd
    replied
    Originally posted by Wallysb01 View Post
    Also, are you running out of RAM? Do you have 96GB installed? I can't imagine that this whole compressed memory thing does much good for serious work. Maybe it saves the OS a GB or 2 for lightly used things that load up in RAM, but in general, if you need stuff in RAM, why would you want it compressed? Then you have to uncompress and recompress it upon every use? If that's how you cram something that needs 128GB into 96GB, its going to be painfully slow. And I don't think that's even what it is doing. This is probably a feature for machines with <8GB of RAM....
    We're currently OK with RAM usage and capacity, and my intention wasn't that compressed memory would allow us to analyze a larger dataset than the system is capable of handling.

    My main line of thought was that compressed memory and AppNap would help keep systems like our iMacs, which are used for light analyses by multiple users, to last longer between hardware replacements. Basically, these systems are used for small genome assemblies, light 16S analysis, Sanger sequence analysis, etc. along with basic things like using MS Office doing statistical analyses. Because most users would have multiple programs open as they work on and analyze their data, something like AppNap could help extend the usable lifespan of these systems so we don't have to buy a whole new system every year or two.

    For heavier analyses we would rely on our linux clusters, so we're not trying to skimp on our computing capabilities.

    And as I thought when I first posted, it looks like I'm better off waiting to see what happens with the first few point updates to stabilize the OS. I've also heard from some colleagues that some older applications that they and we use are no longer supported, so we'll have to look at whether or not we still need them and if it's worth paying for upgrades or if something else is available that we might try instead.

    Leave a comment:


  • Wallysb01
    replied
    Originally posted by mcnelson.phd View Post
    The AppNap and compressed memory features in particular seem like they could give those systems a boost and help extend their usable life span.
    I have to second waiting for the 10.9.1 release at minimum. Often times Apple gets that out inside a month.

    Also, are you running out of RAM? Do you have 96GB installed? I can't imagine that this whole compressed memory thing does much good for serious work. Maybe it saves the OS a GB or 2 for lightly used things that load up in RAM, but in general, if you need stuff in RAM, why would you want it compressed? Then you have to uncompress and recompress it upon every use? If that's how you cram something that needs 128GB into 96GB, its going to be painfully slow. And I don't think that's even what it is doing. This is probably a feature for machines with <8GB of RAM....

    Leave a comment:


  • rhinoceros
    replied
    Originally posted by jimmybee View Post
    Do you use chrome by any chance?

    I had similar issues with my system but has since cleared when I switched to safari. Ive been really throttling the system recently and its been handling parallelisation better than ever. Specially with high memory tasks
    Nah, I use FireFox. But the thing is, with ML I could have had like 10 programs open and not run into memory problems. With Mavericks, I get memory problems even if I have nothing else running..

    Leave a comment:


  • rhinoceros
    replied
    Originally posted by mdobeson View Post
    Bugger! What are your scripts written in? What libraries are you using? Are you hitting swap space?

    My 454 perl scripts use ForkManager extensively and are pretty cpu intenstive but I'm careful to stay away from hitting swap hard for obvious performance reasons. I've had no memory issues thus far, just missing macports. Looks like we have the same spec macbook.

    Mavericks does have that new memory compression feature which seems a possible culprit if this is indeed a mavericks bug. Who knows! YMMV
    These are shell scripts that are basically wrappers for QIIME and indeed, I'm hitting swap space. I think running pick_open_reference_otus.py script from QIIME with 8 threads against 97_greengenes stayed just a little bit under 16GB in ML, however, for whatever reason Mavericks goes way above it. The memory compression thingy was my first idea too..

    Leave a comment:


  • jimmybee
    replied
    Originally posted by rhinoceros View Post
    I updated my work computer and ran into problems.

    Apparently, OS X Mavericks memory management sucks. I can no longer run some scripts I've written for 454-sequence analysis. Instead, in memory heavy phases of these scripts, a warning that I'm out of memory pops up. A few seconds later the computer freezes completely and has to be cold rebooted. Mind you, I never had these problems in Mountain Lion with the same exact parameters and data. The only workaround is to reduce parallelization.

    Computer specs:

    MacBook Pro
    Retina, 15-inch, Early 2013
    Processor 2,7 GHz Intel Core i7
    Memory 16 GB 1600 MHz DDR3
    Graphics NVIDIA GeForce GT 650M 1024 MB
    Software OS X 10.9 (13A603)

    Oh well, back to Mountain Lion. I'm somewhat sad as Mavericks handles multiple screens way better than its predecessor.
    Do you use chrome by any chance?

    I had similar issues with my system but has since cleared when I switched to safari. Ive been really throttling the system recently and its been handling parallelisation better than ever. Specially with high memory tasks

    Leave a comment:


  • mdobeson
    replied
    I can no longer run some scripts I've written for 454-sequence analysis. Instead, in memory heavy phases of these scripts, a warning that I'm out of memory pops up. A few seconds later the computer freezes completely and has to be cold rebooted. Mind you, I never had these problems in Mountain Lion with the same exact parameters and data. The only workaround is to reduce parallelization.
    Bugger! What are your scripts written in? What libraries are you using? Are you hitting swap space?

    My 454 perl scripts use ForkManager extensively and are pretty cpu intenstive but I'm careful to stay away from hitting swap hard for obvious performance reasons. I've had no memory issues thus far, just missing macports. Looks like we have the same spec macbook.

    Mavericks does have that new memory compression feature which seems a possible culprit if this is indeed a mavericks bug. Who knows! YMMV

    Leave a comment:


  • rhinoceros
    replied
    I updated my work computer and ran into problems.

    Apparently, OS X Mavericks memory management sucks. I can no longer run some scripts I've written for 454-sequence analysis. Instead, in memory heavy phases of these scripts, a warning that I'm out of memory pops up. A few seconds later the computer freezes completely and has to be cold rebooted. Mind you, I never had these problems in Mountain Lion with the same exact parameters and data. The only workaround is to reduce parallelization.

    Computer specs:

    MacBook Pro
    Retina, 15-inch, Early 2013
    Processor 2,7 GHz Intel Core i7
    Memory 16 GB 1600 MHz DDR3
    Graphics NVIDIA GeForce GT 650M 1024 MB
    Software OS X 10.9 (13A603)

    Oh well, back to Mountain Lion. I'm somewhat sad as Mavericks handles multiple screens way better than its predecessor.

    Leave a comment:


  • mcnelson.phd
    replied
    Looks like my best bet may be to update one of our less crucial systems and see what works and what doesn't.

    Thanks for the info guys!

    Leave a comment:


  • fahmida
    replied
    So far so good, no issues to report yet. GUI one's such as CLC, Tablet etc. seems coped well.Hoping for no dramas.

    Leave a comment:


  • sinnamone
    replied
    I have updated my macbook(mid 2010) and i CLC works fine.

    Leave a comment:


  • mdobeson
    replied
    The todo list...
    http://trac.macports.org/wiki/MavericksProblems

    Leave a comment:


  • GenoMax
    replied
    Waiting for 10.9.1 to show up may be prudent (at the most a couple of months). Apple generally tackles most of the initial bugs with that minor release.

    That said, commercial software we support seems to all work with Mavericks (just needed the java install which is still on 1.6). There is an Xcode update to go along as well so there should be compatible compiler/libraries in case you need to recompile things. Between the OS and Xcode you are looking at a ~7 GB download.

    Leave a comment:


  • jimmybee
    replied
    Originally posted by JohnN View Post
    Because on my heavy reliance on MacPorts, I'm waiting for verification that MacPorts works with Mavericks. (I have not checked since Friday).
    Ive had no issues

    Leave a comment:


  • PeteH
    replied
    There are known problems with Mavericks and RStudio (http://blog.rstudio.org/2013/10/22/r...0-9-mavericks/). R itself is fine but it's something to bear in mind if you use RStudio and are considering moving to Mavericks.

    Leave a comment:


  • mdobeson
    replied
    There were issues which you could work around by compiling from sources, but i believe macports have released an official installer. as of yesterday i had issues with the mac-qt4 library not compiling. its used for quite a few GUI apps in macports and i'm waiting for them to update. so you've been warned.

    Leave a comment:

Latest Articles

Collapse

  • seqadmin
    Essential Discoveries and Tools in Epitranscriptomics
    by seqadmin




    The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist...
    04-22-2024, 07:01 AM
  • seqadmin
    Current Approaches to Protein Sequencing
    by seqadmin


    Proteins are often described as the workhorses of the cell, and identifying their sequences is key to understanding their role in biological processes and disease. Currently, the most common technique used to determine protein sequences is mass spectrometry. While still a valuable tool, mass spectrometry faces several limitations and requires a highly experienced scientist familiar with the equipment to operate it. Additionally, other proteomic methods, like affinity assays, are constrained...
    04-04-2024, 04:25 PM

ad_right_rmr

Collapse

News

Collapse

Topics Statistics Last Post
Started by seqadmin, 04-25-2024, 11:49 AM
0 responses
19 views
0 likes
Last Post seqadmin  
Started by seqadmin, 04-24-2024, 08:47 AM
0 responses
19 views
0 likes
Last Post seqadmin  
Started by seqadmin, 04-11-2024, 12:08 PM
0 responses
62 views
0 likes
Last Post seqadmin  
Started by seqadmin, 04-10-2024, 10:19 PM
0 responses
60 views
0 likes
Last Post seqadmin  
Working...
X