GithubHelp home page GithubHelp logo

Job does not end about simka HOT 8 CLOSED

gatb avatar gatb commented on July 17, 2024
Job does not end

from simka.

Comments (8)

nick-youngblut avatar nick-youngblut commented on July 17, 2024

I'm using v1.5.1 and am running into the same issue. For instance, the end of the output on my last stalled run was:

83.3 %   elapsed:   0 min 6  sec   remaining:   0 min 1  sec   cpu:   0.5 %   mem: [  17,   17,   17] MB

The job stalled there until I killed it many hours later. The number of input files is 26, so I'm surprised that simka is having a problem. I'm running simka with the following params:

simka -kmer-size 31 -abundance-min 2 -simple-dist -max-reads 1000000 -nb-cores 24 -max-count 24 -max-merge 24 -max-memory 176 -in simka_input.txt -out ./simka/matrices/ -out-tmp ./simka/tmp/

Machine: Ubuntu 18.04.3 LTS with 1Tb of memory

from simka.

rchikhi avatar rchikhi commented on July 17, 2024

hi, please try with a larger -max-memory, perhaps 50000

from simka.

nick-youngblut avatar nick-youngblut commented on July 17, 2024

Larger -max-memory works, but it's the fact that simka freezes instead of dies with a non-zero exit. I have to try and create a time-out error for running simka to deal with this freezing issue.

from simka.

rchikhi avatar rchikhi commented on July 17, 2024

Sorry, just to clarify: a larger -max-memory resulted in a successful run, which effectively solved your problem. Yet when running simka with very low max memory, it freezes. Is that accurate?

from simka.

nick-youngblut avatar nick-youngblut commented on July 17, 2024

Yes. The problem with software freezing instead of throwing an error is that the user doesn't know that there's a problem without manually checking & also knowing about this "low memory causes freezing" issue. It's not optimal, especially for new users of simka who wouldn't necessarily know how long is "too long" for a simka job.

from simka.

rchikhi avatar rchikhi commented on July 17, 2024

I absolutely agree that it is problem. Thanks for the clarifications.

from simka.

nick-youngblut avatar nick-youngblut commented on July 17, 2024

No problem! Since you closed this issue, does that mean that the issue has been fixed in the latest version of simka?

from simka.

rchikhi avatar rchikhi commented on July 17, 2024

in the master branch yes, but not yet the release

from simka.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.