Comments (8)
I'm using v1.5.1 and am running into the same issue. For instance, the end of the output on my last stalled run was:
83.3 % elapsed: 0 min 6 sec remaining: 0 min 1 sec cpu: 0.5 % mem: [ 17, 17, 17] MB
The job stalled there until I killed it many hours later. The number of input files is 26, so I'm surprised that simka is having a problem. I'm running simka with the following params:
simka -kmer-size 31 -abundance-min 2 -simple-dist -max-reads 1000000 -nb-cores 24 -max-count 24 -max-merge 24 -max-memory 176 -in simka_input.txt -out ./simka/matrices/ -out-tmp ./simka/tmp/
Machine: Ubuntu 18.04.3 LTS
with 1Tb of memory
from simka.
hi, please try with a larger -max-memory
, perhaps 50000
from simka.
Larger -max-memory
works, but it's the fact that simka freezes instead of dies with a non-zero exit. I have to try and create a time-out error for running simka to deal with this freezing issue.
from simka.
Sorry, just to clarify: a larger -max-memory resulted in a successful run, which effectively solved your problem. Yet when running simka with very low max memory, it freezes. Is that accurate?
from simka.
Yes. The problem with software freezing instead of throwing an error is that the user doesn't know that there's a problem without manually checking & also knowing about this "low memory causes freezing" issue. It's not optimal, especially for new users of simka who wouldn't necessarily know how long is "too long" for a simka job.
from simka.
I absolutely agree that it is problem. Thanks for the clarifications.
from simka.
No problem! Since you closed this issue, does that mean that the issue has been fixed in the latest version of simka?
from simka.
in the master branch yes, but not yet the release
from simka.
Related Issues (20)
- Issues during linking stage HOT 4
- Issue with test_simkaMin.py HOT 2
- Test regression on Arm64 (Debian Med)
- .fastq.gz support HOT 1
- run for multiple samples on different node on super computer
- SimkaMin output file symmetry HOT 2
- simka crashes with empty files HOT 1
- Can't open object can't open my reads HOT 6
- Add option to trim all reads to a given length HOT 1
- test scripts hang with high cores count
- -max-reads 0
- Several plist problems: It installs the third party executable 'h5cc', etc.
- Include <hdf5/hdf5.h> is wrong, hdf5.h is installed into ${PREFIX}/include/hdf5.h
- Installs hdf headers
- simple test stuck HOT 1
- convert output matrix to triangular format in R HOT 1
- multifasta file as input HOT 1
- Simka k-mers frequencies table HOT 2
- Paired reads input file outputting duplicate rows HOT 1
- Reuse simka merge data on subset of samples HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from simka.